-- Logs begin at Thu 2022-09-08 12:50:36 UTC, end at Thu 2022-09-08 14:12:34 UTC. -- Sep 08 13:33:32.725601 dv-cinder-856463-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 08 13:33:32.733652 dv-cinder-856463-2-smb devstack@keystone.service[88192]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 08 13:33:32.735672 dv-cinder-856463-2-smb devstack@keystone.service[88192]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 8 13:33:32 2022] *** Sep 08 13:33:32.735672 dv-cinder-856463-2-smb devstack@keystone.service[88192]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 08 13:33:32.735672 dv-cinder-856463-2-smb devstack@keystone.service[88192]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 08 13:33:32.735672 dv-cinder-856463-2-smb devstack@keystone.service[88192]: nodename: dv-cinder-856463-2-smb Sep 08 13:33:32.735672 dv-cinder-856463-2-smb devstack@keystone.service[88192]: machine: x86_64 Sep 08 13:33:32.735672 dv-cinder-856463-2-smb devstack@keystone.service[88192]: clock source: unix Sep 08 13:33:32.735672 dv-cinder-856463-2-smb devstack@keystone.service[88192]: pcre jit disabled Sep 08 13:33:32.735672 dv-cinder-856463-2-smb devstack@keystone.service[88192]: detected number of CPU cores: 4 Sep 08 13:33:32.735672 dv-cinder-856463-2-smb devstack@keystone.service[88192]: current working directory: / Sep 08 13:33:32.735672 dv-cinder-856463-2-smb devstack@keystone.service[88192]: detected binary path: /usr/bin/uwsgi-core Sep 08 13:33:32.736318 dv-cinder-856463-2-smb devstack@keystone.service[88192]: your processes number limit is 47680 Sep 08 13:33:32.736318 dv-cinder-856463-2-smb devstack@keystone.service[88192]: your memory page size is 4096 bytes Sep 08 13:33:32.736318 dv-cinder-856463-2-smb devstack@keystone.service[88192]: detected max file descriptor number: 2048 Sep 08 13:33:32.736318 dv-cinder-856463-2-smb devstack@keystone.service[88192]: lock engine: pthread robust mutexes Sep 08 13:33:32.736318 dv-cinder-856463-2-smb devstack@keystone.service[88192]: thunder lock: enabled Sep 08 13:33:32.736318 dv-cinder-856463-2-smb devstack@keystone.service[88192]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 08 13:33:32.736318 dv-cinder-856463-2-smb devstack@keystone.service[88192]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 08 13:33:32.782006 dv-cinder-856463-2-smb devstack@keystone.service[88192]: Python main interpreter initialized at 0x556fca7959c0 Sep 08 13:33:32.782006 dv-cinder-856463-2-smb devstack@keystone.service[88192]: python threads support enabled Sep 08 13:33:32.782006 dv-cinder-856463-2-smb devstack@keystone.service[88192]: your server socket listen backlog is limited to 100 connections Sep 08 13:33:32.782006 dv-cinder-856463-2-smb devstack@keystone.service[88192]: your mercy for graceful operations on workers is 90 seconds Sep 08 13:33:32.782571 dv-cinder-856463-2-smb devstack@keystone.service[88192]: mapped 403077 bytes (393 KB) for 2 cores Sep 08 13:33:32.782755 dv-cinder-856463-2-smb devstack@keystone.service[88192]: *** Operational MODE: preforking *** Sep 08 13:33:32.783228 dv-cinder-856463-2-smb devstack@keystone.service[88192]: *** uWSGI is running in multiple interpreter mode *** Sep 08 13:33:32.783228 dv-cinder-856463-2-smb devstack@keystone.service[88192]: spawned uWSGI master process (pid: 88192) Sep 08 13:33:32.783457 dv-cinder-856463-2-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 08 13:33:32.784802 dv-cinder-856463-2-smb devstack@keystone.service[88192]: spawned uWSGI worker 1 (pid: 88207, cores: 1) Sep 08 13:33:32.784802 dv-cinder-856463-2-smb devstack@keystone.service[88192]: spawned uWSGI worker 2 (pid: 88208, cores: 1) Sep 08 13:33:32.785971 dv-cinder-856463-2-smb devstack@keystone.service[88192]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 08 13:33:37.117211 dv-cinder-856463-2-smb devstack@keystone.service[88208]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 13:33:37.117211 dv-cinder-856463-2-smb devstack@keystone.service[88208]: from cryptography.utils import int_from_bytes Sep 08 13:33:37.118060 dv-cinder-856463-2-smb devstack@keystone.service[88208]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 13:33:37.118060 dv-cinder-856463-2-smb devstack@keystone.service[88208]: from cryptography.utils import int_from_bytes Sep 08 13:33:37.120161 dv-cinder-856463-2-smb devstack@keystone.service[88207]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 13:33:37.120161 dv-cinder-856463-2-smb devstack@keystone.service[88207]: from cryptography.utils import int_from_bytes Sep 08 13:33:37.120944 dv-cinder-856463-2-smb devstack@keystone.service[88207]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 13:33:37.120944 dv-cinder-856463-2-smb devstack@keystone.service[88207]: from cryptography.utils import int_from_bytes Sep 08 13:33:37.176160 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 13:33:37.176366 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 13:33:37.176527 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] command line args: [] {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 13:33:37.176798 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 13:33:37.176977 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ================================================================================ {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 13:33:37.177232 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] admin_token = **** {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.177510 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] config_dir = [] {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.177701 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.177886 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] config_source = [] {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.178067 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] debug = True {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.178265 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.179660 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.179660 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.179660 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.179660 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.179660 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] list_limit = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.179660 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] log_config_append = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.180108 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.180108 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] log_dir = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.180243 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 13:33:37.180328 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] log_file = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.180407 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 13:33:37.180479 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.180554 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] command line args: [] {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 13:33:37.180630 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.180744 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 13:33:37.180867 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.180996 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ================================================================================ {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 13:33:37.181126 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.181468 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] admin_token = **** {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.181538 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.181538 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.181669 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] config_dir = [] {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.181834 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.181915 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.182029 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] config_source = [] {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.182175 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.182265 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] debug = True {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.182426 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.182602 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.182690 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.182774 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.182904 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.183024 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.183139 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.183254 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.183367 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.183495 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.183617 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] list_limit = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.183728 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.183849 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] log_config_append = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.183964 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.184081 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.184081 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] log_dir = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.184314 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] log_file = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.184436 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.69/identity {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.184560 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.184681 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] publish_errors = False {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.184797 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.184911 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.185031 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.185143 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.185143 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.185320 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.185320 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.185596 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.185711 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.185826 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.185939 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.186061 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] standard_threads = False {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.186184 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.186301 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.186420 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.186542 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.186542 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.186767 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.186928 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] use_journal = False {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.187109 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.187253 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] use_json = False {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.187395 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.187563 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] use_stderr = False {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.187563 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] use_syslog = False {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.187843 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.187979 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.188121 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.188266 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.188400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.188516 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.188516 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.188731 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.69/identity {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.188897 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.189015 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] publish_errors = False {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.189015 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.189230 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.189345 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.189501 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.189637 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.189761 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.189877 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.189996 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.190123 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.190246 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.190364 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] standard_threads = False {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.190478 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.190599 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.190714 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.190828 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.190951 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.191073 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.191073 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] use_journal = False {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.191297 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.191414 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] use_json = False {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.191528 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.191634 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] use_stderr = False {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.191634 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] use_syslog = False {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.191847 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.191970 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 13:33:37.192084 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.192199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.192321 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.192444 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.192560 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.192675 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.192788 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.192902 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.193027 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.193144 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.193258 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.193396 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.193527 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.193650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.193776 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.193898 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.194013 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.194126 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.194246 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.194362 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.194548 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.194667 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.194788 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.194909 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.195024 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.195138 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.195261 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.195377 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.195491 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.195614 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.195730 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.195848 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.195973 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.196095 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.196211 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.196331 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.196458 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.197133 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.197325 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.197538 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.197749 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.197908 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.198026 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.198162 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.198281 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.198281 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.198505 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.198633 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.198760 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.198760 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.198986 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.199100 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.199235 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.199351 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.199465 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.199592 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.199721 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.199836 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.199957 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.200072 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.200186 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.200313 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.200436 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.200551 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.200665 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.200779 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.200894 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.201083 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.201200 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.201315 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.201486 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.201613 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.201737 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.201860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.201977 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.202110 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.202227 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.202341 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.202464 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.202601 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.202718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.202839 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.202957 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.203071 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.203185 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.203308 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.203430 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.203545 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.203659 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.203773 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.203888 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.204011 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.204127 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.204242 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.204357 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.204464 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.204606 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.204717 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.204814 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.204910 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.205012 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.205115 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.205213 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.205317 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.205440 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.205555 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.205655 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.205762 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.205877 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.206001 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.206117 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.206239 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.206362 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.206468 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.206582 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.206704 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.206819 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.206935 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.207050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.207155 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.207269 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.207384 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.207498 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.207626 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.207752 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.207868 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.207999 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.208117 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.208242 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.208360 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.208360 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.208594 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.208709 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.208837 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.208966 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.209082 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.209082 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.209322 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.209467 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.209584 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.209703 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.209819 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.209933 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.210048 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.210162 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.210278 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.210278 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.210504 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.210619 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.210740 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.210740 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.210957 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.210957 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.211201 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.211323 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.211439 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.211554 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.211673 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.211797 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.211914 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.211914 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.212138 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.212942 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.213125 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.213459 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.213617 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.213737 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.213853 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.213970 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.214085 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.214215 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.214342 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.214472 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.214591 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.214707 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.214823 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.214939 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.215055 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.215179 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.215296 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.215411 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.215529 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.215644 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.215767 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.215891 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] auth.external = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.216008 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.216008 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.216232 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.216363 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.216493 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.216597 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.216693 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.216798 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.216905 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] auth.password = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.217004 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.217132 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] auth.token = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.217249 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.217421 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.217577 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.217706 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.217808 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.217906 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.218002 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.218114 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.218291 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.218399 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.218500 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.218597 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.218696 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.218806 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.218906 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.219015 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] credential.caching = True {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.219113 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.219213 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.219330 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] auth.external = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.219456 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.219575 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.219692 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.219809 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.219927 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.220044 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.220173 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.220291 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] auth.password = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.220407 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.220524 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] auth.token = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.220640 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.220767 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.220906 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.221038 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.221156 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.221279 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.221423 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.221535 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.221664 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.221784 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.221901 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.222017 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.222132 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.222248 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.223046 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.223190 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] credential.caching = True {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.223190 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.223415 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.223415 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] federation.caching = True {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.224525 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.224660 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.224781 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.224897 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.226023 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.226406 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.226530 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.226662 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.226781 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.227361 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.228045 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.228244 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.228440 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.228605 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.228605 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.228605 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.228941 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.229059 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.229826 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.229955 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.230078 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.230231 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] identity.caching = True {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.230231 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.230231 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.231213 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.231349 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.231478 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.231597 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.231714 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.232464 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.232464 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.232464 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.232464 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.232919 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.233671 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.233802 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] federation.caching = True {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.234005 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.234128 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.234245 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.234999 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.235127 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.235246 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.235372 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.235595 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.236224 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.236224 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.236224 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.236575 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.236702 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.237803 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.238203 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.238326 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.238444 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.238561 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.238561 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.239750 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.240177 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.240302 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.240421 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.240537 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.240537 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.240537 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.240871 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] identity.caching = True {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.241422 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.241422 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.241877 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.242010 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.242129 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.242246 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.242363 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.242896 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.243241 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.243377 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.243571 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.244084 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.244236 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.244572 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.244685 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.244796 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.244905 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.245005 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.245005 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.245005 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.245934 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.246050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.246151 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.246248 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.246346 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.246443 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.246540 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.246655 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.246655 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.246838 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.246936 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.247411 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.247529 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.247639 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.247739 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.247739 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.247739 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.248011 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.248109 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.248474 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.248693 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.248795 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.248893 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.248893 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.248893 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.user = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.249195 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.249315 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.249806 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.249932 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.250051 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.250169 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.250300 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.250419 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.250419 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.250419 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.251104 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.251224 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.251354 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.251473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.251601 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.251720 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.252219 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.252358 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.252477 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.252594 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.252711 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.252827 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.252827 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.252827 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.253519 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.253650 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.253768 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.253885 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.254002 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.254132 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.254251 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.254711 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.254838 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.254956 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.255073 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.255199 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.255318 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.255435 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.255435 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.255435 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.256124 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.256251 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.256251 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.256473 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.256910 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.257428 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.257556 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.257688 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.257808 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.257926 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.258503 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.258890 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.259498 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.259642 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.259830 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.260027 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.260223 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.260370 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.260489 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.260617 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.260850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.260850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.260850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.261807 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.261925 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] resource.caching = True {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.262062 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.262062 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.262511 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.263083 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.263638 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.263638 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.263638 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.264234 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.264351 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.264468 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.user = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.264779 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.265129 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.265260 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.265426 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.265547 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.265664 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.265781 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.265898 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.266091 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] role.caching = True {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.266651 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.266972 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] role.driver = sql {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.267092 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.267209 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.267325 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.267453 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.267766 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.267766 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.268473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.268578 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.268694 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.268821 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.268940 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.269059 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.269059 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.269964 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.270076 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.270191 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.270293 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.270391 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.270488 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.270586 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.270685 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.270685 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.270879 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.270978 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.271083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.271182 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.271280 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.271387 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.271487 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.271584 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.271584 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.271765 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.271942 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.271942 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.272134 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.272241 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.272339 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.272436 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.272436 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.272628 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.272726 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.272823 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.272922 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.273027 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.273133 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.273233 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.273336 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.273459 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.273561 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.273561 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.273755 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.273862 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.273862 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.274045 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.275597 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] resource.caching = True {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.275746 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.275870 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.276001 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.276122 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.276245 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.276365 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.276490 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.276618 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.276736 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.276866 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.276866 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.277093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.277219 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.277338 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.277496 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.277496 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.277682 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.277682 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.277682 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.277967 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] role.caching = True {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.277967 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] role.driver = sql {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.278149 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] token.caching = True {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.278247 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.278345 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.278452 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.278552 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.278552 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.278733 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.278831 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.278984 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.278984 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.279185 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.279283 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.279381 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.279381 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.279563 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.279563 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.279755 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.279860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.279962 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.280059 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.280059 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.280249 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.280792 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.280792 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.281473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.281473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.281473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.282581 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.282704 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.282804 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.282920 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.283046 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.283046 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.283279 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.283405 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.283405 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.283627 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.283753 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.283871 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] database.connection = **** {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.283988 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.284113 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.284113 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.284333 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.284333 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.284553 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.284669 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.284669 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.284900 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.285016 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.285171 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.285289 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.285473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.285605 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.285605 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.285830 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.285947 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.286072 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.286199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.286326 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.286444 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.286560 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.286560 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.287163 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.287163 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] token.caching = True {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.287404 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.287523 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.287640 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.287757 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.287874 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.287874 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.288103 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.288221 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.288342 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.288460 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.288576 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.288576 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.288788 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.288907 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.289023 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 13:33:37.289140 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.289140 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.289140 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.289140 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.289140 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.289140 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.289140 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.289140 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.289140 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.290667 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.290667 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] database.connection = **** {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.290667 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.290667 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.290667 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.290667 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.290667 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.290667 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.290667 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.291990 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.291990 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.291990 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.291990 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.291990 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.291990 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.291990 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.291990 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.291990 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.293357 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.293357 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 13:33:37.293357 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 13:33:37.302008 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.302244 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.302473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.302652 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.302882 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.303109 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.312286 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.314117 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.346878 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.347080 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.351074 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.351307 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.401932 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.402983 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.451842 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.452063 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.452155 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.452304 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.609093 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.609383 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.609552 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.609807 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.609920 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.610001 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.610091 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.610206 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.610328 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.610430 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.610647 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.610862 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.633713 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.633943 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.634157 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.634770 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.634948 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.635086 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.635199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.635319 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.635433 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.635547 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.635674 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.635789 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.635789 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.636056 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.646850 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.647011 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.659657 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.659887 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.660016 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.660119 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.660195 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.660282 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.660418 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.660501 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.660643 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.660725 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.660863 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.660946 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88207) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.661079 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.661292 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88208) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 08 13:33:37.677460 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.677670 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 08 13:33:37.677819 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.678013 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.678101 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 08 13:33:37.678234 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 08 13:33:37.678357 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.678483 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.678569 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 08 13:33:37.678748 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.678837 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.679010 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.679103 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.679270 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.679351 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.679558 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.689434 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.689717 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.689821 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.689994 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.690079 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.690283 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.690367 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.690625 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.697905 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88207) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:33:37.698156 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:33:37.700811 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88207) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:33:37.701047 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:33:37.701148 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.701337 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.701492 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.701649 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.701733 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.701934 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.702030 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.702199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.702288 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.702671 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.702930 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.703022 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.703101 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.703175 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.703251 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.703325 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.703507 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.703592 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.703786 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.704059 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.726470 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.727185 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.727975 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88207) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:33:37.728263 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.728796 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:33:37.729086 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.732926 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88207) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:33:37.733211 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.733525 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.733804 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:33:37.734091 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.734375 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.739846 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88207) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:33:37.740133 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.740833 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:33:37.741124 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.746378 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88207) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:33:37.746682 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.746976 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.747269 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.747530 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:33:37.747615 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.747823 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.747914 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.748103 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.748187 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.748380 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.748464 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.748679 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.748952 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.749225 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.749533 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.765234 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.765544 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.765905 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.766192 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.769418 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88207) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:33:37.770214 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:33:37.772647 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.772947 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.773462 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.773765 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.777197 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88207) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:33:37.778121 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:33:37.780455 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88207) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:33:37.781262 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:33:37.783706 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.784009 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.784300 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.784454 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.784596 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.784756 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.784874 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.785046 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.785149 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.785337 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.785647 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.785934 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.801123 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88207) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:33:37.801436 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.801716 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.801910 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:33:37.801992 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.802203 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.802477 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.802752 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.809482 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.810261 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.811054 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.811774 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.812579 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.812853 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.813287 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.813725 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.815630 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88207) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:33:37.815925 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.816209 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.816398 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:33:37.816479 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.816687 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.816888 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.817009 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.817261 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.817684 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.828774 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88207) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:33:37.829061 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.829349 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.829657 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.829751 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:33:37.829986 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.830073 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.830278 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.830370 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.830567 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.830654 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.830965 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.831266 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.831556 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.846210 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88207) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:33:37.847269 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:33:37.849403 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88207) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:33:37.850461 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:33:37.852289 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.853966 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.854499 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.855480 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.855953 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88207) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:33:37.856240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.856645 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.856950 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:33:37.857239 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.857655 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.863044 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.864161 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.864490 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88207) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:33:37.865653 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:33:37.867383 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.867779 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.868068 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.868372 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.869209 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.869802 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.870092 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.870375 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.876740 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88207) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:33:37.877030 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.877311 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.878341 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:33:37.878636 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.878919 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.884699 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88207) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:33:37.884984 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.885261 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.885562 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.885840 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.886125 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.886402 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.886528 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88208) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 08 13:33:37.886688 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.886818 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.886979 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.887103 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.887256 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.887390 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.887540 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.887647 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.887919 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.888000 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.888203 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.888285 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.888467 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88207) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.888548 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.888763 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.889038 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.889323 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.889617 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.889887 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.890174 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88208) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 08 13:33:37.923257 dv-cinder-856463-2-smb devstack@keystone.service[88207]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556fca7959c0 pid: 88207 (default app) Sep 08 13:33:37.924928 dv-cinder-856463-2-smb devstack@keystone.service[88208]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556fca7959c0 pid: 88208 (default app) Sep 08 13:33:37.926586 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3d697-63f2-47cf-ad7f-750127b389a8 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:33:37.926869 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3d697-63f2-47cf-ad7f-750127b389a8 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:33:37.927142 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3d697-63f2-47cf-ad7f-750127b389a8 None None] PATH_INFO: `/v3` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:33:37.931307 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1/1] 10.222.0.69 () {50 vars in 791 bytes} [Thu Sep 8 13:33:37 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:33:45.011519 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e97066-231a-4df2-adcc-7fb7d8e69846 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:33:45.012236 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e97066-231a-4df2-adcc-7fb7d8e69846 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:33:45.012236 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e97066-231a-4df2-adcc-7fb7d8e69846 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:33:45.016686 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1/2] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:33:45 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:33:45.023273 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5634a7-0a7b-45f8-9576-1717de91dfd5 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:33:45.023935 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5634a7-0a7b-45f8-9576-1717de91dfd5 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:33:45.023935 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5634a7-0a7b-45f8-9576-1717de91dfd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:33:45.112750 dv-cinder-856463-2-smb devstack@keystone.service[88207]: INFO dbcounter [None req-7f5634a7-0a7b-45f8-9576-1717de91dfd5 None None] Registered counter for database keystone Sep 08 13:33:45.134515 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG oslo_db.sqlalchemy.engines [None req-7f5634a7-0a7b-45f8-9576-1717de91dfd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88207) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 13:33:45.144995 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writer thread running {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 13:33:45.378058 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG passlib.handlers.bcrypt [None req-7f5634a7-0a7b-45f8-9576-1717de91dfd5 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88207) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 08 13:33:45.378758 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG passlib.handlers.bcrypt [None req-7f5634a7-0a7b-45f8-9576-1717de91dfd5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88207) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 08 13:33:45.448462 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-7f5634a7-0a7b-45f8-9576-1717de91dfd5 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:33:45.450141 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-7f5634a7-0a7b-45f8-9576-1717de91dfd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:33:45.603537 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 2/3] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:33:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 581 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 08 13:33:46.087569 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e97066-231a-4df2-adcc-7fb7d8e69846 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:33:46.159070 dv-cinder-856463-2-smb devstack@keystone.service[88208]: INFO dbcounter [None req-10e97066-231a-4df2-adcc-7fb7d8e69846 None None] Registered counter for database keystone Sep 08 13:33:46.181708 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG oslo_db.sqlalchemy.engines [None req-10e97066-231a-4df2-adcc-7fb7d8e69846 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88208) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 13:33:46.188282 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writer thread running {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 13:33:46.314905 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e97066-231a-4df2-adcc-7fb7d8e69846 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:33:46.319149 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b3064-ebaf-4eba-aace-db4d8920cd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:33:46.319787 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b3064-ebaf-4eba-aace-db4d8920cd3d admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:33:46.320064 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b3064-ebaf-4eba-aace-db4d8920cd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:33:46.320335 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b3064-ebaf-4eba-aace-db4d8920cd3d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:33:46.329588 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b3064-ebaf-4eba-aace-db4d8920cd3d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:33:46.382908 dv-cinder-856463-2-smb devstack@keystone.service[88208]: WARNING keystone.common.rbac_enforcer.enforcer [None req-234b3064-ebaf-4eba-aace-db4d8920cd3d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 08 13:33:46.383166 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b3064-ebaf-4eba-aace-db4d8920cd3d admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:33:46.394947 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 2/4] 10.222.0.69 () {58 vars in 1324 bytes} [Thu Sep 8 13:33:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 08 13:33:46.401737 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5634a7-0a7b-45f8-9576-1717de91dfd5 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:33:46.418823 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5634a7-0a7b-45f8-9576-1717de91dfd5 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:33:46.423299 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb23623-03d2-4b05-8039-05147b464446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:33:46.424426 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb23623-03d2-4b05-8039-05147b464446 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:33:46.424715 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb23623-03d2-4b05-8039-05147b464446 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:33:46.424987 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb23623-03d2-4b05-8039-05147b464446 admin admin] PATH_INFO: `/v3/projects/a72572f147214da489cf8bb75dc22284` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:33:46.426647 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb23623-03d2-4b05-8039-05147b464446 admin admin] RBAC: Authorizing `identity:get_project(project_id=a72572f147214da489cf8bb75dc22284)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:33:46.482460 dv-cinder-856463-2-smb devstack@keystone.service[88207]: WARNING keystone.common.rbac_enforcer.enforcer [None req-adb23623-03d2-4b05-8039-05147b464446 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 08 13:33:46.482806 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb23623-03d2-4b05-8039-05147b464446 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:33:46.487496 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 3/5] 10.222.0.69 () {56 vars in 1207 bytes} [Thu Sep 8 13:33:46 2022] GET /identity/v3/projects/a72572f147214da489cf8bb75dc22284 => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:33:48.785509 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c397881-7674-4394-8f43-80e9f56fc811 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:33:48.786053 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c397881-7674-4394-8f43-80e9f56fc811 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:33:48.786053 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c397881-7674-4394-8f43-80e9f56fc811 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:33:48.790919 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 3/6] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:33:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:33:48.796674 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e099c-21ec-4b0d-9687-ab53a8a31b99 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:33:48.797062 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e099c-21ec-4b0d-9687-ab53a8a31b99 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:33:48.797224 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e099c-21ec-4b0d-9687-ab53a8a31b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:33:48.817607 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-db3e099c-21ec-4b0d-9687-ab53a8a31b99 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:33:48.819145 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-db3e099c-21ec-4b0d-9687-ab53a8a31b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:33:48.827601 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 4/7] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:33:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 08 13:33:49.096636 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c397881-7674-4394-8f43-80e9f56fc811 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:33:49.109874 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c397881-7674-4394-8f43-80e9f56fc811 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:33:49.114358 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d8d86-699d-4e87-95b8-36dfd3c523b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:33:49.114961 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d8d86-699d-4e87-95b8-36dfd3c523b2 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:33:49.115238 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d8d86-699d-4e87-95b8-36dfd3c523b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:33:49.115509 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d8d86-699d-4e87-95b8-36dfd3c523b2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:33:49.126850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932d8d86-699d-4e87-95b8-36dfd3c523b2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:33:49.128615 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932d8d86-699d-4e87-95b8-36dfd3c523b2 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:33:49.138138 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 4/8] 10.222.0.69 () {58 vars in 1324 bytes} [Thu Sep 8 13:33:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 13:33:49.143920 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e099c-21ec-4b0d-9687-ab53a8a31b99 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:33:49.153961 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e099c-21ec-4b0d-9687-ab53a8a31b99 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:33:49.158301 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e317e1-2c26-40c7-9a8e-6cf886882eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:33:49.158923 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e317e1-2c26-40c7-9a8e-6cf886882eef admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:33:49.159202 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e317e1-2c26-40c7-9a8e-6cf886882eef admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:33:49.159473 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e317e1-2c26-40c7-9a8e-6cf886882eef admin admin] PATH_INFO: `/v3/users/fe0feabca86e4c0ea888e85fba6302d2` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:33:49.160765 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e317e1-2c26-40c7-9a8e-6cf886882eef admin admin] RBAC: Authorizing `identity:get_user(user_id=fe0feabca86e4c0ea888e85fba6302d2)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:33:49.162610 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e317e1-2c26-40c7-9a8e-6cf886882eef admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:33:49.164414 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 5/9] 10.222.0.69 () {56 vars in 1198 bytes} [Thu Sep 8 13:33:49 2022] GET /identity/v3/users/fe0feabca86e4c0ea888e85fba6302d2 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:33:51.449637 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba4d44-08af-46a3-ace7-4c0c0184775f None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:33:51.450174 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba4d44-08af-46a3-ace7-4c0c0184775f None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:33:51.450174 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba4d44-08af-46a3-ace7-4c0c0184775f None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:33:51.451547 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 5/10] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:33:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:33:51.457590 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f801712-cf98-4e8b-8df7-7c217e823475 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:33:51.458079 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f801712-cf98-4e8b-8df7-7c217e823475 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:33:51.458177 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f801712-cf98-4e8b-8df7-7c217e823475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:33:51.476887 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-1f801712-cf98-4e8b-8df7-7c217e823475 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:33:51.478247 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-1f801712-cf98-4e8b-8df7-7c217e823475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:33:51.487540 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88b0a4-bcf8-4ec5-88ac-fa8b32f87733 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:33:51.487845 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88b0a4-bcf8-4ec5-88ac-fa8b32f87733 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:33:51.488119 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88b0a4-bcf8-4ec5-88ac-fa8b32f87733 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:33:51.489475 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 6/11] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:33:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:33:51.495052 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d825f-d365-4fe2-bdd3-03ee3ce5f7ce None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:33:51.495337 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d825f-d365-4fe2-bdd3-03ee3ce5f7ce None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:33:51.495614 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d825f-d365-4fe2-bdd3-03ee3ce5f7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:33:51.540283 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG passlib.handlers.bcrypt [None req-2c3d825f-d365-4fe2-bdd3-03ee3ce5f7ce None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88208) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 08 13:33:51.540561 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG passlib.handlers.bcrypt [None req-2c3d825f-d365-4fe2-bdd3-03ee3ce5f7ce None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88208) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 08 13:33:51.564965 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 6/12] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:33:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:33:51.590454 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-2c3d825f-d365-4fe2-bdd3-03ee3ce5f7ce None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:33:51.592067 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-2c3d825f-d365-4fe2-bdd3-03ee3ce5f7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:33:51.705227 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 7/13] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:33:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:33:51.839112 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f801712-cf98-4e8b-8df7-7c217e823475 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:33:51.865181 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:33:51.949321 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f801712-cf98-4e8b-8df7-7c217e823475 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:33:51.972968 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d825f-d365-4fe2-bdd3-03ee3ce5f7ce None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:33:51.996700 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485b8ac-74cb-469c-857a-8a7f5536c226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:33:51.997355 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485b8ac-74cb-469c-857a-8a7f5536c226 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:33:51.997668 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485b8ac-74cb-469c-857a-8a7f5536c226 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:33:51.997946 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485b8ac-74cb-469c-857a-8a7f5536c226 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:33:52.010080 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485b8ac-74cb-469c-857a-8a7f5536c226 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:33:52.019039 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-7485b8ac-74cb-469c-857a-8a7f5536c226 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:33:52.019039 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:33:52.019039 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:33:52.019039 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:33:52.019039 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:33:52.019039 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:33:52.019039 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:33:52.019039 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:33:52.019039 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:33:52.019039 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:33:52.019039 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:33:52.019039 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:33:52.019039 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:33:52.019039 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:33:52.019039 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:33:52.019039 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:33:52.019990 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:33:52.019990 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:33:52.019990 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:33:52.019990 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:33:52.019990 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:33:52.019990 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:33:52.019990 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:33:52.019990 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:33:52.019990 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:33:52.019990 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:33:52.019990 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:33:52.019990 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:33:52.019990 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:33:52.019990 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:33:52.019990 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:33:52.019990 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:33:52.020810 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:33:52.020810 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:33:52.020810 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:33:52.020810 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:33:52.020810 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:33:52.020810 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:33:52.020810 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:33:52.020810 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:33:52.020810 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:33:52.020810 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:33:52.020810 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:33:52.020810 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:33:52.020810 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 7/14] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 8 13:33:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:33:52.026551 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485b8ac-74cb-469c-857a-8a7f5536c226 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:33:52.079454 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d825f-d365-4fe2-bdd3-03ee3ce5f7ce None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:33:52.081803 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:33:52.112849 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:33:52.120787 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe2b5f0-354d-4720-aa38-6748b49d3c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:33:52.121700 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2b5f0-354d-4720-aa38-6748b49d3c13 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:33:52.121975 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2b5f0-354d-4720-aa38-6748b49d3c13 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:33:52.122250 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2b5f0-354d-4720-aa38-6748b49d3c13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:33:52.134886 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485b8ac-74cb-469c-857a-8a7f5536c226 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:33:52.171633 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd55e1-2185-497f-9ea4-bd48928c87ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:33:52.172246 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd55e1-2185-497f-9ea4-bd48928c87ff None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:33:52.172525 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd55e1-2185-497f-9ea4-bd48928c87ff None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:33:52.172800 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd55e1-2185-497f-9ea4-bd48928c87ff None admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:33:52.173503 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd55e1-2185-497f-9ea4-bd48928c87ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:33:52.173810 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd55e1-2185-497f-9ea4-bd48928c87ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:33:52.175231 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd55e1-2185-497f-9ea4-bd48928c87ff None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:33:52.188477 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 8/15] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:33:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:33:52.194427 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd55e1-2185-497f-9ea4-bd48928c87ff None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:33:52.195290 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe2b5f0-354d-4720-aa38-6748b49d3c13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:33:52.196919 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe2b5f0-354d-4720-aa38-6748b49d3c13 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:33:52.306889 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 8/16] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:33:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 08 13:33:52.312821 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe2b5f0-354d-4720-aa38-6748b49d3c13 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:33:52.314112 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd55e1-2185-497f-9ea4-bd48928c87ff None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:33:52.315756 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:33:52.348263 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3a6a4-fc9e-4da9-8739-d50759f0ca9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:33:52.349153 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3a6a4-fc9e-4da9-8739-d50759f0ca9c None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:33:52.349464 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3a6a4-fc9e-4da9-8739-d50759f0ca9c None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:33:52.349737 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f3a6a4-fc9e-4da9-8739-d50759f0ca9c None admin] PATH_INFO: `/v3/users/fe0feabca86e4c0ea888e85fba6302d2` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:33:52.350901 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3a6a4-fc9e-4da9-8739-d50759f0ca9c None admin] RBAC: Authorizing `identity:get_user(user_id=fe0feabca86e4c0ea888e85fba6302d2)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:33:52.353621 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f3a6a4-fc9e-4da9-8739-d50759f0ca9c None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:33:52.355238 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 9/17] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:33:52 2022] GET /identity/v3/users/fe0feabca86e4c0ea888e85fba6302d2 => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:33:52.360724 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3a6a4-fc9e-4da9-8739-d50759f0ca9c None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:33:52.377180 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:33:52.418927 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe2b5f0-354d-4720-aa38-6748b49d3c13 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:33:52.454880 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a501d-d009-4a79-99a1-7f051566d4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:33:52.455742 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a501d-d009-4a79-99a1-7f051566d4b1 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:33:52.456024 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a501d-d009-4a79-99a1-7f051566d4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:33:52.456338 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a501d-d009-4a79-99a1-7f051566d4b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:33:52.469106 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f3a6a4-fc9e-4da9-8739-d50759f0ca9c None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:33:52.476520 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765a501d-d009-4a79-99a1-7f051566d4b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:33:52.479258 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765a501d-d009-4a79-99a1-7f051566d4b1 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:33:52.502886 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-765a501d-d009-4a79-99a1-7f051566d4b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:33:52.502886 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:33:52.502886 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:33:52.502886 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:33:52.502886 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:33:52.502886 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:33:52.502886 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:33:52.502886 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:33:52.502886 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:33:52.502886 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:33:52.502886 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:33:52.502886 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:33:52.502886 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:33:52.502886 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:33:52.502886 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:33:52.502886 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:33:52.504032 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:33:52.504032 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:33:52.504032 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:33:52.504032 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:33:52.504032 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:33:52.504032 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:33:52.504032 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:33:52.504032 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:33:52.504032 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:33:52.504032 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:33:52.504032 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:33:52.504032 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:33:52.504032 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:33:52.504032 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:33:52.504032 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:33:52.504032 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:33:52.504032 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:33:52.505030 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:33:52.505030 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:33:52.505030 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:33:52.505676 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 9/18] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:33:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:33:52.510187 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b7c640-7ba7-49da-ac16-d7ed250915d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:33:52.510837 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7c640-7ba7-49da-ac16-d7ed250915d4 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:33:52.511116 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7c640-7ba7-49da-ac16-d7ed250915d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:33:52.511387 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7c640-7ba7-49da-ac16-d7ed250915d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:33:52.512301 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a501d-d009-4a79-99a1-7f051566d4b1 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:33:52.512545 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b7c640-7ba7-49da-ac16-d7ed250915d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:33:52.514039 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b7c640-7ba7-49da-ac16-d7ed250915d4 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:33:52.515607 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 10/19] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:33:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:33:52.521423 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b7c640-7ba7-49da-ac16-d7ed250915d4 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:33:52.575830 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:33:52.609752 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:33:52.622908 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a501d-d009-4a79-99a1-7f051566d4b1 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:33:52.629109 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b7c640-7ba7-49da-ac16-d7ed250915d4 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:33:52.658875 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad440ec1-314f-442e-8525-f263e5589e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:33:52.659489 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad440ec1-314f-442e-8525-f263e5589e81 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:33:52.659767 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad440ec1-314f-442e-8525-f263e5589e81 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:33:52.660036 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad440ec1-314f-442e-8525-f263e5589e81 None admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:33:52.660695 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad440ec1-314f-442e-8525-f263e5589e81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:33:52.660996 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad440ec1-314f-442e-8525-f263e5589e81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:33:52.662424 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad440ec1-314f-442e-8525-f263e5589e81 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:33:52.665765 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2135feb-37d7-462a-b481-7529f344217d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:33:52.666937 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2135feb-37d7-462a-b481-7529f344217d None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:33:52.667392 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2135feb-37d7-462a-b481-7529f344217d None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:33:52.667847 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2135feb-37d7-462a-b481-7529f344217d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:33:52.668824 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2135feb-37d7-462a-b481-7529f344217d None admin] RBAC: Adding query filter params (role.id=9c76f398c9e04caeab83842e70eb824b, scope.domain.id=default, user.id=fe0feabca86e4c0ea888e85fba6302d2) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:33:52.669138 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2135feb-37d7-462a-b481-7529f344217d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:33:52.670656 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2135feb-37d7-462a-b481-7529f344217d None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:33:52.678517 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 11/20] 10.222.0.69 () {56 vars in 1322 bytes} [Thu Sep 8 13:33:52 2022] GET /identity/v3/role_assignments?user.id=fe0feabca86e4c0ea888e85fba6302d2&scope.domain.id=default&role.id=9c76f398c9e04caeab83842e70eb824b => generated 233 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:33:52.682138 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 10/21] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:33:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:33:55.380985 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165b0ef-8f03-4309-b10e-579c6273c440 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:33:55.381530 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165b0ef-8f03-4309-b10e-579c6273c440 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:33:55.381619 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165b0ef-8f03-4309-b10e-579c6273c440 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:33:55.382896 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 12/22] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:33:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:33:55.389407 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc9f86e-fed7-4171-a6e7-1892d85ce97f None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:33:55.389882 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc9f86e-fed7-4171-a6e7-1892d85ce97f None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:33:55.389952 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc9f86e-fed7-4171-a6e7-1892d85ce97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:33:55.416186 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-afc9f86e-fed7-4171-a6e7-1892d85ce97f None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:33:55.416761 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd3a92-81a6-4445-bb05-594220c33241 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:33:55.417286 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd3a92-81a6-4445-bb05-594220c33241 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:33:55.417790 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-afc9f86e-fed7-4171-a6e7-1892d85ce97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:33:55.418142 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd3a92-81a6-4445-bb05-594220c33241 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:33:55.419692 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 13/23] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:33:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:33:55.431535 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340eb8da-c9a2-49df-8fd9-7f25b483bf5d None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:33:55.432133 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340eb8da-c9a2-49df-8fd9-7f25b483bf5d None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:33:55.432613 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340eb8da-c9a2-49df-8fd9-7f25b483bf5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:33:55.470646 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-340eb8da-c9a2-49df-8fd9-7f25b483bf5d None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:33:55.472439 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-340eb8da-c9a2-49df-8fd9-7f25b483bf5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:33:55.552456 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 11/24] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:33:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:33:55.624357 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 14/25] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:33:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:33:55.723370 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac34cd-6310-414e-82f0-b62e7fde3bdb None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:33:55.723942 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac34cd-6310-414e-82f0-b62e7fde3bdb None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:33:55.724205 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac34cd-6310-414e-82f0-b62e7fde3bdb None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:33:55.725634 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 12/26] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:33:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:33:55.731800 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfcac19-2140-41c3-a4c5-99d10a84f0f4 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:33:55.732423 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfcac19-2140-41c3-a4c5-99d10a84f0f4 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:33:55.732913 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfcac19-2140-41c3-a4c5-99d10a84f0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:33:55.760700 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-ccfcac19-2140-41c3-a4c5-99d10a84f0f4 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:33:55.762432 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-ccfcac19-2140-41c3-a4c5-99d10a84f0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:33:55.848516 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 15/27] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:33:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:33:55.947435 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a6116-37ef-4f9b-9fed-09b9f6e47bd8 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:33:55.948058 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a6116-37ef-4f9b-9fed-09b9f6e47bd8 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:33:55.948531 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129a6116-37ef-4f9b-9fed-09b9f6e47bd8 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:33:55.950115 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 13/28] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:33:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:33:55.955523 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21d8e4-5f19-45f7-8b4a-b8ffb313f1dc None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:33:55.956045 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21d8e4-5f19-45f7-8b4a-b8ffb313f1dc None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:33:55.956518 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21d8e4-5f19-45f7-8b4a-b8ffb313f1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:33:55.979020 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:33:55.994643 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-1e21d8e4-5f19-45f7-8b4a-b8ffb313f1dc None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:33:55.995847 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-1e21d8e4-5f19-45f7-8b4a-b8ffb313f1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:33:56.102886 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 16/29] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:33:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:33:56.135993 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a6116-37ef-4f9b-9fed-09b9f6e47bd8 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:33:56.184151 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e21d8e4-5f19-45f7-8b4a-b8ffb313f1dc None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:33:56.243581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:33:56.400297 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e21d8e4-5f19-45f7-8b4a-b8ffb313f1dc None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:33:56.405769 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129a6116-37ef-4f9b-9fed-09b9f6e47bd8 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:33:56.479376 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898cf3f6-350d-4753-8952-62e7a034a644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:33:56.480025 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cf3f6-350d-4753-8952-62e7a034a644 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:33:56.480308 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cf3f6-350d-4753-8952-62e7a034a644 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:33:56.480584 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cf3f6-350d-4753-8952-62e7a034a644 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:33:56.482362 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f7356-cc2e-40ab-8248-5fa15d0b1d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:33:56.482993 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f7356-cc2e-40ab-8248-5fa15d0b1d19 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:33:56.483268 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f7356-cc2e-40ab-8248-5fa15d0b1d19 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:33:56.483539 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f7356-cc2e-40ab-8248-5fa15d0b1d19 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:33:56.487596 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:33:56.499368 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f7356-cc2e-40ab-8248-5fa15d0b1d19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:33:56.499554 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898cf3f6-350d-4753-8952-62e7a034a644 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:33:56.500912 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898cf3f6-350d-4753-8952-62e7a034a644 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:33:56.504979 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-235f7356-cc2e-40ab-8248-5fa15d0b1d19 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:33:56.504979 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:33:56.504979 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:33:56.504979 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:33:56.504979 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:33:56.504979 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:33:56.504979 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:33:56.504979 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:33:56.504979 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:33:56.504979 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:33:56.504979 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:33:56.504979 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:33:56.504979 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:33:56.504979 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:33:56.504979 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:33:56.504979 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:33:56.505884 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:33:56.505884 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:33:56.505884 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:33:56.505884 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:33:56.505884 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:33:56.505884 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:33:56.505884 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:33:56.505884 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:33:56.505884 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:33:56.505884 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:33:56.505884 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:33:56.505884 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:33:56.505884 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:33:56.505884 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:33:56.505884 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:33:56.505884 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:33:56.506642 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:33:56.506642 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:33:56.506642 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:33:56.506642 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:33:56.506642 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:33:56.506642 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:33:56.506642 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:33:56.506642 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:33:56.506642 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:33:56.506642 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:33:56.506642 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:33:56.506642 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:33:56.509696 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 17/30] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 8 13:33:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:33:56.515975 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f7356-cc2e-40ab-8248-5fa15d0b1d19 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:33:56.517701 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-898cf3f6-350d-4753-8952-62e7a034a644 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:33:56.517701 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:33:56.517701 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:33:56.517701 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:33:56.517701 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:33:56.517701 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:33:56.517701 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:33:56.517701 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:33:56.517701 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:33:56.517701 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:33:56.517701 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:33:56.517701 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:33:56.517701 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:33:56.517701 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:33:56.517701 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:33:56.517701 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:33:56.518657 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:33:56.518657 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:33:56.518657 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:33:56.518657 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:33:56.518657 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:33:56.518657 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:33:56.518657 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:33:56.518657 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:33:56.518657 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:33:56.518657 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:33:56.518657 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:33:56.518657 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:33:56.518657 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:33:56.518657 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:33:56.518657 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:33:56.518657 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:33:56.518657 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:33:56.519484 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:33:56.519484 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:33:56.519484 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:33:56.519484 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 14/31] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:33:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:33:56.519687 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898cf3f6-350d-4753-8952-62e7a034a644 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:33:56.641511 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f7356-cc2e-40ab-8248-5fa15d0b1d19 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:33:56.646911 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:33:56.652118 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898cf3f6-350d-4753-8952-62e7a034a644 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:33:56.683240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34253e6e-e534-4bd0-8140-bff4cad6f2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:33:56.684372 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34253e6e-e534-4bd0-8140-bff4cad6f2ff None admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:33:56.684862 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34253e6e-e534-4bd0-8140-bff4cad6f2ff None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:33:56.685507 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34253e6e-e534-4bd0-8140-bff4cad6f2ff None admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:33:56.686469 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34253e6e-e534-4bd0-8140-bff4cad6f2ff None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:33:56.688171 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34253e6e-e534-4bd0-8140-bff4cad6f2ff None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:33:56.694119 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817ed33-d3f1-4e9f-9c44-136665d3fa7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:33:56.694720 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817ed33-d3f1-4e9f-9c44-136665d3fa7c None admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:33:56.695004 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817ed33-d3f1-4e9f-9c44-136665d3fa7c None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:33:56.695281 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817ed33-d3f1-4e9f-9c44-136665d3fa7c None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:33:56.696540 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5817ed33-d3f1-4e9f-9c44-136665d3fa7c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:33:56.698966 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5817ed33-d3f1-4e9f-9c44-136665d3fa7c None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:33:56.820153 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 18/32] 10.222.0.69 () {60 vars in 1131 bytes} [Thu Sep 8 13:33:56 2022] POST /identity/v3/roles => generated 225 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:33:56.822337 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34253e6e-e534-4bd0-8140-bff4cad6f2ff None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:33:56.853569 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 15/33] 10.222.0.69 () {60 vars in 1131 bytes} [Thu Sep 8 13:33:56 2022] POST /identity/v3/roles => generated 219 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:33:56.853569 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817ed33-d3f1-4e9f-9c44-136665d3fa7c None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:33:57.005814 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:33:57.116962 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34253e6e-e534-4bd0-8140-bff4cad6f2ff None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:33:57.178343 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817ed33-d3f1-4e9f-9c44-136665d3fa7c None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:33:57.190700 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab76ea95-0479-42ea-af26-06f861b740df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:33:57.191401 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76ea95-0479-42ea-af26-06f861b740df None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:33:57.191688 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76ea95-0479-42ea-af26-06f861b740df None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:33:57.191968 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab76ea95-0479-42ea-af26-06f861b740df None admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:33:57.192778 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab76ea95-0479-42ea-af26-06f861b740df None admin] RBAC: Adding query filter params (name=admin) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:33:57.193090 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab76ea95-0479-42ea-af26-06f861b740df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:33:57.194761 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab76ea95-0479-42ea-af26-06f861b740df None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:33:57.210276 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 19/34] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:33:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:33:57.212365 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da259482-5f99-4a44-8ab4-e2c3cd0ce710 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:33:57.212660 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da259482-5f99-4a44-8ab4-e2c3cd0ce710 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:33:57.213030 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da259482-5f99-4a44-8ab4-e2c3cd0ce710 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:33:57.214574 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 20/35] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:33:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:33:57.219791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da259482-5f99-4a44-8ab4-e2c3cd0ce710 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:33:57.229473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c54160-c3a3-4d8d-9318-0f8608301003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:33:57.230306 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c54160-c3a3-4d8d-9318-0f8608301003 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:33:57.230598 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c54160-c3a3-4d8d-9318-0f8608301003 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:33:57.230879 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c54160-c3a3-4d8d-9318-0f8608301003 None admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:33:57.231689 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c54160-c3a3-4d8d-9318-0f8608301003 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:33:57.232004 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c54160-c3a3-4d8d-9318-0f8608301003 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:33:57.233812 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c54160-c3a3-4d8d-9318-0f8608301003 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:33:57.249907 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 16/36] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:33:57.251480 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd962b7-e709-4b63-9310-299ff16bda38 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:33:57.251773 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd962b7-e709-4b63-9310-299ff16bda38 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:33:57.252357 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd962b7-e709-4b63-9310-299ff16bda38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:33:57.276525 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-6fd962b7-e709-4b63-9310-299ff16bda38 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:33:57.278197 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-6fd962b7-e709-4b63-9310-299ff16bda38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:33:57.297545 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:33:57.360844 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 17/37] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:33:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:33:57.361902 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd962b7-e709-4b63-9310-299ff16bda38 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:33:57.377939 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da259482-5f99-4a44-8ab4-e2c3cd0ce710 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:33:57.482597 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd962b7-e709-4b63-9310-299ff16bda38 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:33:57.524312 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:33:57.525066 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b1486-8cb3-40d5-8596-a59ce7ced117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:33:57.525066 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b1486-8cb3-40d5-8596-a59ce7ced117 None admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:33:57.525432 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b1486-8cb3-40d5-8596-a59ce7ced117 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:33:57.525722 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b1486-8cb3-40d5-8596-a59ce7ced117 None admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:33:57.526823 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b1486-8cb3-40d5-8596-a59ce7ced117 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:33:57.528187 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b1486-8cb3-40d5-8596-a59ce7ced117 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:33:57.545533 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97074d8b-0c57-418b-8d45-d92629405fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:33:57.546207 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97074d8b-0c57-418b-8d45-d92629405fbf None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:33:57.546486 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97074d8b-0c57-418b-8d45-d92629405fbf None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:33:57.546767 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97074d8b-0c57-418b-8d45-d92629405fbf None admin] PATH_INFO: `/v3/users/fe0feabca86e4c0ea888e85fba6302d2` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:33:57.548396 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97074d8b-0c57-418b-8d45-d92629405fbf None admin] RBAC: Authorizing `identity:get_user(user_id=fe0feabca86e4c0ea888e85fba6302d2)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:33:57.550261 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97074d8b-0c57-418b-8d45-d92629405fbf None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:33:57.552561 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 21/38] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:33:57 2022] GET /identity/v3/users/fe0feabca86e4c0ea888e85fba6302d2 => generated 247 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:33:57.553738 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a50dfb-4a03-4c36-9f64-a85202cf8cd8 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:33:57.554025 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a50dfb-4a03-4c36-9f64-a85202cf8cd8 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:33:57.554308 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a50dfb-4a03-4c36-9f64-a85202cf8cd8 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:33:57.556676 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 22/39] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:33:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:33:57.558336 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:33:57.559031 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a50dfb-4a03-4c36-9f64-a85202cf8cd8 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:33:57.566350 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 18/40] 10.222.0.69 () {60 vars in 1141 bytes} [Thu Sep 8 13:33:57 2022] POST /identity/v3/projects => generated 301 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:33:57.568106 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d5cde-490f-48f8-94a3-0edf46ffbc64 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:33:57.568638 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d5cde-490f-48f8-94a3-0edf46ffbc64 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:33:57.569116 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d5cde-490f-48f8-94a3-0edf46ffbc64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:33:57.590140 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-c74d5cde-490f-48f8-94a3-0edf46ffbc64 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:33:57.591418 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-c74d5cde-490f-48f8-94a3-0edf46ffbc64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:33:57.689479 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 19/41] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:33:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:33:57.689479 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d5cde-490f-48f8-94a3-0edf46ffbc64 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:33:57.706391 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a50dfb-4a03-4c36-9f64-a85202cf8cd8 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:33:57.753176 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c9c138-7bd7-4cea-b7d6-a92ef09f51a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:33:57.753862 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9c138-7bd7-4cea-b7d6-a92ef09f51a3 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:33:57.754193 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9c138-7bd7-4cea-b7d6-a92ef09f51a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:33:57.754427 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c9c138-7bd7-4cea-b7d6-a92ef09f51a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:33:57.757041 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c9c138-7bd7-4cea-b7d6-a92ef09f51a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:33:57.758757 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c9c138-7bd7-4cea-b7d6-a92ef09f51a3 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:33:57.760454 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 23/42] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:33:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:33:57.766450 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c9c138-7bd7-4cea-b7d6-a92ef09f51a3 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:33:57.832217 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d5cde-490f-48f8-94a3-0edf46ffbc64 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:33:57.832876 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:33:57.869597 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:33:57.876214 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868fde70-29a2-4e6a-94ba-8f93828fbb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:33:57.876876 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fde70-29a2-4e6a-94ba-8f93828fbb3d None admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:33:57.877160 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fde70-29a2-4e6a-94ba-8f93828fbb3d None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:33:57.877474 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fde70-29a2-4e6a-94ba-8f93828fbb3d None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:33:57.878152 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868fde70-29a2-4e6a-94ba-8f93828fbb3d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:33:57.879546 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868fde70-29a2-4e6a-94ba-8f93828fbb3d None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:33:57.894658 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c9c138-7bd7-4cea-b7d6-a92ef09f51a3 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:33:57.895746 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 20/43] 10.222.0.69 () {60 vars in 1131 bytes} [Thu Sep 8 13:33:57 2022] POST /identity/v3/roles => generated 223 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:33:57.935998 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35fb83a-e90f-4ce7-a769-bd346f25c58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:33:57.936689 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fb83a-e90f-4ce7-a769-bd346f25c58f None admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:33:57.936973 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fb83a-e90f-4ce7-a769-bd346f25c58f None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:33:57.937249 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fb83a-e90f-4ce7-a769-bd346f25c58f None admin] PATH_INFO: `/v3/domains/default/users/fe0feabca86e4c0ea888e85fba6302d2/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:33:57.939354 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35fb83a-e90f-4ce7-a769-bd346f25c58f None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=fe0feabca86e4c0ea888e85fba6302d2, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:33:57.940857 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35fb83a-e90f-4ce7-a769-bd346f25c58f None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:33:57.961097 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 24/44] 10.222.0.69 () {58 vars in 1361 bytes} [Thu Sep 8 13:33:57 2022] PUT /identity/v3/domains/default/users/fe0feabca86e4c0ea888e85fba6302d2/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:33:58.002586 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868fde70-29a2-4e6a-94ba-8f93828fbb3d None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:33:58.138083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868fde70-29a2-4e6a-94ba-8f93828fbb3d None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:33:58.176956 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77ccae-5f4d-4d05-bb45-49bb3f53c579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:33:58.177623 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77ccae-5f4d-4d05-bb45-49bb3f53c579 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:33:58.177906 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77ccae-5f4d-4d05-bb45-49bb3f53c579 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:33:58.178172 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77ccae-5f4d-4d05-bb45-49bb3f53c579 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:33:58.179303 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c77ccae-5f4d-4d05-bb45-49bb3f53c579 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:33:58.181309 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c77ccae-5f4d-4d05-bb45-49bb3f53c579 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:33:58.183006 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 21/45] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:33:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:33:58.188883 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35fb83a-e90f-4ce7-a769-bd346f25c58f None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:33:58.301629 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35fb83a-e90f-4ce7-a769-bd346f25c58f None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:33:58.316206 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:33:58.339525 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be09212-10cf-4141-bb95-3c52baa06277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:33:58.340133 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be09212-10cf-4141-bb95-3c52baa06277 None admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:33:58.340409 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be09212-10cf-4141-bb95-3c52baa06277 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:33:58.340680 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be09212-10cf-4141-bb95-3c52baa06277 None admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:33:58.341347 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be09212-10cf-4141-bb95-3c52baa06277 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:33:58.342836 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be09212-10cf-4141-bb95-3c52baa06277 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:33:58.375235 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 25/46] 10.222.0.69 () {60 vars in 1141 bytes} [Thu Sep 8 13:33:58 2022] POST /identity/v3/projects => generated 312 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:34:00.233514 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70428a4-1dcc-455c-bfb1-011cb23fe25e None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:00.234053 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70428a4-1dcc-455c-bfb1-011cb23fe25e None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:00.234053 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70428a4-1dcc-455c-bfb1-011cb23fe25e None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:00.235406 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 22/47] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:34:00.240637 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b71756-2860-4d23-94a4-347454c3bac5 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:00.241019 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b71756-2860-4d23-94a4-347454c3bac5 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:00.241192 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b71756-2860-4d23-94a4-347454c3bac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:00.260506 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-55b71756-2860-4d23-94a4-347454c3bac5 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:00.262070 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-55b71756-2860-4d23-94a4-347454c3bac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:00.333991 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 26/48] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:34:00.593802 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2b696-3856-4fc6-b171-c96d082de588 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:00.594058 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2b696-3856-4fc6-b171-c96d082de588 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:00.594290 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2b696-3856-4fc6-b171-c96d082de588 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:00.595645 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 23/49] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:34:00.601263 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0064b-e4f6-4b8f-967e-4869447d0701 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:00.601651 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0064b-e4f6-4b8f-967e-4869447d0701 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:00.601971 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c0064b-e4f6-4b8f-967e-4869447d0701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:00.606527 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2b696-3856-4fc6-b171-c96d082de588 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:00.620197 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-f2c0064b-e4f6-4b8f-967e-4869447d0701 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:00.621404 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-f2c0064b-e4f6-4b8f-967e-4869447d0701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:00.669616 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:00.699396 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 27/50] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:34:00.745032 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2b696-3856-4fc6-b171-c96d082de588 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:00.800306 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9fc61-3402-4fb3-afc8-ba32ebd2472c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:00.801328 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9fc61-3402-4fb3-afc8-ba32ebd2472c None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:00.801872 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9fc61-3402-4fb3-afc8-ba32ebd2472c None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:00.802372 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9fc61-3402-4fb3-afc8-ba32ebd2472c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:00.823039 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d9fc61-3402-4fb3-afc8-ba32ebd2472c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:34:00.834716 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-77d9fc61-3402-4fb3-afc8-ba32ebd2472c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:34:00.834716 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:34:00.834716 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:34:00.834716 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:34:00.834716 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:34:00.834716 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:34:00.834716 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:34:00.834716 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:34:00.834716 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:34:00.834716 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:34:00.834716 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:34:00.834716 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:34:00.834716 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:34:00.834716 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:34:00.834716 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:34:00.834716 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:34:00.835876 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:34:00.835876 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:34:00.835876 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:34:00.835876 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:34:00.835876 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:34:00.835876 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:34:00.835876 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:34:00.835876 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:34:00.835876 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:34:00.835876 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:34:00.835876 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:34:00.835876 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:34:00.835876 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:34:00.835876 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:34:00.835876 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:34:00.835876 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:34:00.837769 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:34:00.837769 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:34:00.837769 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:34:00.837769 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:34:00.837769 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:34:00.837769 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:34:00.837769 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:34:00.837769 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:34:00.837769 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:34:00.837769 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:34:00.837769 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:34:00.837769 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:34:00.837769 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 24/51] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 8 13:34:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:34:00.848153 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0064b-e4f6-4b8f-967e-4869447d0701 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:00.875463 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:00.956908 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c0064b-e4f6-4b8f-967e-4869447d0701 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:00.974819 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9fc61-3402-4fb3-afc8-ba32ebd2472c None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:00.994207 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d768c1-6fc1-4764-ab39-b2af29b960fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:00.994818 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d768c1-6fc1-4764-ab39-b2af29b960fe None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:00.995097 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d768c1-6fc1-4764-ab39-b2af29b960fe None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:00.995378 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d768c1-6fc1-4764-ab39-b2af29b960fe None admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:00.996056 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d768c1-6fc1-4764-ab39-b2af29b960fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:00.996357 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d768c1-6fc1-4764-ab39-b2af29b960fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:00.997776 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d768c1-6fc1-4764-ab39-b2af29b960fe None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:01.005940 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 28/52] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:34:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:01.012595 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d768c1-6fc1-4764-ab39-b2af29b960fe None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:01.078976 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9fc61-3402-4fb3-afc8-ba32ebd2472c None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:01.096576 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:01.099571 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:01.115088 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250eb547-9dfb-451f-b631-8ee53515042f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:01.115423 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d768c1-6fc1-4764-ab39-b2af29b960fe None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:01.115717 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250eb547-9dfb-451f-b631-8ee53515042f None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:01.115995 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250eb547-9dfb-451f-b631-8ee53515042f None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:01.116265 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250eb547-9dfb-451f-b631-8ee53515042f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:01.118079 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250eb547-9dfb-451f-b631-8ee53515042f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:01.120349 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250eb547-9dfb-451f-b631-8ee53515042f None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:01.122186 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 25/53] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:34:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:34:01.128083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250eb547-9dfb-451f-b631-8ee53515042f None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:01.152920 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963aaa6c-aa62-41bf-af86-e7678546d480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:01.153592 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963aaa6c-aa62-41bf-af86-e7678546d480 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:01.153879 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963aaa6c-aa62-41bf-af86-e7678546d480 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:01.154149 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963aaa6c-aa62-41bf-af86-e7678546d480 None admin] PATH_INFO: `/v3/users/fe0feabca86e4c0ea888e85fba6302d2` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:01.155397 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963aaa6c-aa62-41bf-af86-e7678546d480 None admin] RBAC: Authorizing `identity:get_user(user_id=fe0feabca86e4c0ea888e85fba6302d2)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:01.156870 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963aaa6c-aa62-41bf-af86-e7678546d480 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:01.158477 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 29/54] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:34:01 2022] GET /identity/v3/users/fe0feabca86e4c0ea888e85fba6302d2 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:01.163928 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963aaa6c-aa62-41bf-af86-e7678546d480 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:01.231337 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250eb547-9dfb-451f-b631-8ee53515042f None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:01.270088 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963aaa6c-aa62-41bf-af86-e7678546d480 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:01.273926 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b67c51-16b1-4414-b417-c53f96799b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:01.274678 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b67c51-16b1-4414-b417-c53f96799b10 None admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:01.274949 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b67c51-16b1-4414-b417-c53f96799b10 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:01.275244 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b67c51-16b1-4414-b417-c53f96799b10 None admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:01.275908 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b67c51-16b1-4414-b417-c53f96799b10 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:01.277376 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b67c51-16b1-4414-b417-c53f96799b10 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:01.310774 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 26/55] 10.222.0.69 () {60 vars in 1140 bytes} [Thu Sep 8 13:34:01 2022] POST /identity/v3/projects => generated 298 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:34:01.324599 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c174ecaf-3fae-4a95-a4b0-38666b119b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:01.325461 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174ecaf-3fae-4a95-a4b0-38666b119b8f None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:01.325749 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174ecaf-3fae-4a95-a4b0-38666b119b8f None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:01.326032 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174ecaf-3fae-4a95-a4b0-38666b119b8f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:01.327335 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c174ecaf-3fae-4a95-a4b0-38666b119b8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:01.328881 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c174ecaf-3fae-4a95-a4b0-38666b119b8f None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:01.330648 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 30/56] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:34:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:34:01.339523 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b67c51-16b1-4414-b417-c53f96799b10 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:01.395633 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:01.490022 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b67c51-16b1-4414-b417-c53f96799b10 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:01.666156 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc18eda-375a-4bf7-916d-485fa64c9ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:01.666704 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc18eda-375a-4bf7-916d-485fa64c9ded None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:01.666990 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc18eda-375a-4bf7-916d-485fa64c9ded None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:01.667272 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc18eda-375a-4bf7-916d-485fa64c9ded None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:01.668015 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc18eda-375a-4bf7-916d-485fa64c9ded None admin] RBAC: Adding query filter params (role.id=9c76f398c9e04caeab83842e70eb824b, scope.domain.id=default, user.id=fe0feabca86e4c0ea888e85fba6302d2) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:01.668329 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc18eda-375a-4bf7-916d-485fa64c9ded None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:01.669833 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc18eda-375a-4bf7-916d-485fa64c9ded None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:01.685991 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 27/57] 10.222.0.69 () {56 vars in 1322 bytes} [Thu Sep 8 13:34:01 2022] GET /identity/v3/role_assignments?user.id=fe0feabca86e4c0ea888e85fba6302d2&scope.domain.id=default&role.id=9c76f398c9e04caeab83842e70eb824b => generated 530 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:03.606897 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f5407-ee10-4bda-a34f-cb3456f23323 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:03.607387 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f5407-ee10-4bda-a34f-cb3456f23323 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:03.607387 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f5407-ee10-4bda-a34f-cb3456f23323 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:03.608698 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 31/58] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:34:03.615014 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdde0f3-222a-4e17-994b-bd5320420892 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:03.615014 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdde0f3-222a-4e17-994b-bd5320420892 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:03.615014 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdde0f3-222a-4e17-994b-bd5320420892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:03.637880 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-3fdde0f3-222a-4e17-994b-bd5320420892 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:03.639108 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-3fdde0f3-222a-4e17-994b-bd5320420892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:03.713194 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 28/59] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:34:04.040281 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f5407-ee10-4bda-a34f-cb3456f23323 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:04.065340 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:04.150979 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f5407-ee10-4bda-a34f-cb3456f23323 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:04.186656 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6a0d2-2a90-45d2-bd4f-61dc5d2640ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:04.187278 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6a0d2-2a90-45d2-bd4f-61dc5d2640ff None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:04.187557 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6a0d2-2a90-45d2-bd4f-61dc5d2640ff None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:04.187829 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6a0d2-2a90-45d2-bd4f-61dc5d2640ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:04.188932 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6a0d2-2a90-45d2-bd4f-61dc5d2640ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:04.190424 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6a0d2-2a90-45d2-bd4f-61dc5d2640ff None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:04.192019 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 32/60] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:34:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:04.197988 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdde0f3-222a-4e17-994b-bd5320420892 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:04.229306 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:04.299880 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdde0f3-222a-4e17-994b-bd5320420892 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:04.333459 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889af8e-d007-4777-a583-af234fd20496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:04.334072 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889af8e-d007-4777-a583-af234fd20496 None admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:04.334353 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889af8e-d007-4777-a583-af234fd20496 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:04.334626 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889af8e-d007-4777-a583-af234fd20496 None admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:04.335290 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7889af8e-d007-4777-a583-af234fd20496 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:04.336978 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7889af8e-d007-4777-a583-af234fd20496 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:04.364301 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 29/61] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Sep 8 13:34:04 2022] POST /identity/v3/users => generated 275 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:34:07.684252 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892f15f-bb7e-4466-adac-1fda8a4ab8a6 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:07.685353 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892f15f-bb7e-4466-adac-1fda8a4ab8a6 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:07.685871 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892f15f-bb7e-4466-adac-1fda8a4ab8a6 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:07.687553 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 33/62] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:34:07.693572 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f63b3-b57a-45ae-a914-2d600247c74d None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:07.694590 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f63b3-b57a-45ae-a914-2d600247c74d None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:07.695078 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f63b3-b57a-45ae-a914-2d600247c74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:07.722286 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-a80f63b3-b57a-45ae-a914-2d600247c74d None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:07.724121 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-a80f63b3-b57a-45ae-a914-2d600247c74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:07.823685 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07f5b3-6b35-4bc2-ba78-e93c4d6a4fd5 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:07.824068 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07f5b3-6b35-4bc2-ba78-e93c4d6a4fd5 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:07.824252 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07f5b3-6b35-4bc2-ba78-e93c4d6a4fd5 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:07.825753 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 34/63] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:34:07.839040 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa43e01-ca2d-495d-a11e-b1818f4b1a95 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:07.839323 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa43e01-ca2d-495d-a11e-b1818f4b1a95 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:07.839925 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa43e01-ca2d-495d-a11e-b1818f4b1a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:07.858794 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 30/64] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:34:07.894476 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-daa43e01-ca2d-495d-a11e-b1818f4b1a95 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:07.895705 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-daa43e01-ca2d-495d-a11e-b1818f4b1a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:08.035369 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 35/65] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:34:08.304391 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2db7e-370a-4144-8c2b-b8065f3b975f None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:08.305028 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2db7e-370a-4144-8c2b-b8065f3b975f None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:08.305853 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2db7e-370a-4144-8c2b-b8065f3b975f None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:08.307802 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 31/66] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:34:08.309356 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa43e01-ca2d-495d-a11e-b1818f4b1a95 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:08.314187 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2909a-57f8-4944-b8c2-f7e8f1d3e1ac None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:08.314473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2909a-57f8-4944-b8c2-f7e8f1d3e1ac None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:08.314761 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2909a-57f8-4944-b8c2-f7e8f1d3e1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:08.356075 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-4eb2909a-57f8-4944-b8c2-f7e8f1d3e1ac None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:08.358840 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-4eb2909a-57f8-4944-b8c2-f7e8f1d3e1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:08.363731 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:08.381725 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:08.452129 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 32/67] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:34:08.458367 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2909a-57f8-4944-b8c2-f7e8f1d3e1ac None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:08.551981 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa43e01-ca2d-495d-a11e-b1818f4b1a95 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:08.619356 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46547383-8208-43c3-955b-bb6410c74cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:08.619924 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46547383-8208-43c3-955b-bb6410c74cbc None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:08.620239 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46547383-8208-43c3-955b-bb6410c74cbc None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:08.620518 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46547383-8208-43c3-955b-bb6410c74cbc None admin] PATH_INFO: `/v3/roles/member` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:08.631762 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46547383-8208-43c3-955b-bb6410c74cbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:34:08.638505 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-46547383-8208-43c3-955b-bb6410c74cbc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:34:08.638505 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:34:08.638505 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:34:08.638505 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:34:08.638505 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:34:08.638505 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:34:08.638505 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:34:08.638505 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:34:08.638505 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:34:08.638505 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:34:08.638505 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:34:08.638505 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:34:08.638505 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:34:08.638505 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:34:08.638505 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:34:08.638505 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:34:08.639400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:34:08.639400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:34:08.639400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:34:08.639400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:34:08.639400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:34:08.639400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:34:08.639400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:34:08.639400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:34:08.639400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:34:08.639400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:34:08.639400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:34:08.639400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:34:08.639400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:34:08.639400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:34:08.639400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:34:08.639400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:34:08.640355 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:34:08.640355 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:34:08.640355 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:34:08.640355 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:34:08.640355 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:34:08.640355 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:34:08.640355 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:34:08.640355 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:34:08.640355 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:34:08.640355 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:34:08.640355 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:34:08.640355 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:34:08.642536 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2909a-57f8-4944-b8c2-f7e8f1d3e1ac None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:08.642886 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 36/68] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:34:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:34:08.644917 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c5f13-cf44-49eb-9a12-16c51c5d285b None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:08.645470 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c5f13-cf44-49eb-9a12-16c51c5d285b None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:08.645950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372c5f13-cf44-49eb-9a12-16c51c5d285b None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:08.647735 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 37/69] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:34:08.657120 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523a0f9-8610-4021-a5d4-8c119b0143eb None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:08.657120 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523a0f9-8610-4021-a5d4-8c119b0143eb None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:08.657120 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523a0f9-8610-4021-a5d4-8c119b0143eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:08.674693 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-7523a0f9-8610-4021-a5d4-8c119b0143eb None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:08.676103 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-7523a0f9-8610-4021-a5d4-8c119b0143eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:08.687910 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e762a40-d5b6-46ac-a6b0-da7b377d3e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:08.688574 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e762a40-d5b6-46ac-a6b0-da7b377d3e1d None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:08.688948 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e762a40-d5b6-46ac-a6b0-da7b377d3e1d None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:08.689135 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e762a40-d5b6-46ac-a6b0-da7b377d3e1d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:08.700129 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e762a40-d5b6-46ac-a6b0-da7b377d3e1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:34:08.704933 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-0e762a40-d5b6-46ac-a6b0-da7b377d3e1d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:34:08.704933 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:34:08.704933 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:34:08.704933 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:34:08.704933 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:34:08.704933 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:34:08.704933 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:34:08.704933 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:34:08.704933 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:34:08.704933 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:34:08.704933 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:34:08.704933 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:34:08.704933 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:34:08.704933 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:34:08.704933 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:34:08.704933 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:34:08.705810 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:34:08.705810 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:34:08.705810 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:34:08.705810 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:34:08.705810 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:34:08.705810 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:34:08.705810 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:34:08.705810 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:34:08.705810 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:34:08.705810 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:34:08.705810 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:34:08.705810 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:34:08.705810 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:34:08.705810 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:34:08.705810 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:34:08.705810 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:34:08.706592 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:34:08.706592 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:34:08.706592 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:34:08.706592 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:34:08.706592 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:34:08.706592 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:34:08.706592 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:34:08.706592 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:34:08.706592 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:34:08.706592 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:34:08.706592 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:34:08.706592 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:34:08.711240 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 33/70] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 8 13:34:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:34:08.713077 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e762a40-d5b6-46ac-a6b0-da7b377d3e1d None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:08.724713 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:08.752565 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 38/71] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:34:08.753875 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d88a4-73e3-4c0d-b06d-9c9685885243 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:08.754161 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d88a4-73e3-4c0d-b06d-9c9685885243 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:08.754434 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d88a4-73e3-4c0d-b06d-9c9685885243 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:08.755795 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 39/72] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:34:08.756629 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d88a4-73e3-4c0d-b06d-9c9685885243 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:08.778465 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:08.832110 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e762a40-d5b6-46ac-a6b0-da7b377d3e1d None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:08.874087 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d84b083-f652-4357-a38b-0e9b194436ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:08.874809 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84b083-f652-4357-a38b-0e9b194436ed None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:08.874914 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84b083-f652-4357-a38b-0e9b194436ed None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:08.875181 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84b083-f652-4357-a38b-0e9b194436ed None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:08.875851 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d84b083-f652-4357-a38b-0e9b194436ed None admin] RBAC: Adding query filter params (name=member) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:08.876185 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d84b083-f652-4357-a38b-0e9b194436ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:08.877609 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d84b083-f652-4357-a38b-0e9b194436ed None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:08.878980 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d88a4-73e3-4c0d-b06d-9c9685885243 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:08.896037 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 34/73] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 8 13:34:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:08.896037 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9dceb-4707-4c7f-912a-b28d8e7efb3a None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:08.896037 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9dceb-4707-4c7f-912a-b28d8e7efb3a None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:08.896037 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9dceb-4707-4c7f-912a-b28d8e7efb3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:08.912997 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-7ce9dceb-4707-4c7f-912a-b28d8e7efb3a None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:08.914852 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-7ce9dceb-4707-4c7f-912a-b28d8e7efb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:08.922371 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49758f21-ee1a-4c5b-8b5b-da47ba7703b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:08.923033 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49758f21-ee1a-4c5b-8b5b-da47ba7703b7 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:08.923254 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49758f21-ee1a-4c5b-8b5b-da47ba7703b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:08.923529 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49758f21-ee1a-4c5b-8b5b-da47ba7703b7 None admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:08.924407 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49758f21-ee1a-4c5b-8b5b-da47ba7703b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:08.924709 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49758f21-ee1a-4c5b-8b5b-da47ba7703b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:08.926161 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49758f21-ee1a-4c5b-8b5b-da47ba7703b7 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:08.935537 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 40/74] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:34:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:08.936147 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49758f21-ee1a-4c5b-8b5b-da47ba7703b7 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:08.984841 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:08.994478 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 35/75] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:34:08.995376 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce9dceb-4707-4c7f-912a-b28d8e7efb3a None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:09.017291 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:09.053001 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49758f21-ee1a-4c5b-8b5b-da47ba7703b7 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:09.089751 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8599f16-dfc3-492b-97c1-54ebdb0b0cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:09.090385 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8599f16-dfc3-492b-97c1-54ebdb0b0cb1 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:09.090665 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8599f16-dfc3-492b-97c1-54ebdb0b0cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:09.090938 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8599f16-dfc3-492b-97c1-54ebdb0b0cb1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:09.103075 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8599f16-dfc3-492b-97c1-54ebdb0b0cb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:34:09.109483 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-a8599f16-dfc3-492b-97c1-54ebdb0b0cb1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:34:09.109483 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:34:09.109483 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:34:09.109483 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:34:09.109483 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:34:09.109483 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:34:09.109483 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:34:09.109483 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:34:09.109483 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:34:09.109483 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:34:09.109483 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:34:09.109483 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:34:09.109483 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:34:09.109483 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:34:09.109483 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:34:09.109483 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:34:09.110358 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:34:09.110358 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:34:09.110358 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:34:09.110358 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:34:09.110358 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:34:09.110358 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:34:09.110358 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:34:09.110358 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:34:09.110358 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:34:09.110358 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:34:09.110358 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:34:09.110358 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:34:09.110358 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:34:09.110358 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:34:09.110358 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:34:09.110358 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:34:09.111142 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:34:09.111142 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:34:09.111142 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:34:09.111142 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:34:09.111142 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:34:09.111142 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:34:09.111142 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:34:09.111142 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:34:09.111142 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:34:09.111142 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:34:09.111142 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:34:09.111142 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:34:09.111142 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 41/76] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Sep 8 13:34:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:34:09.111820 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8599f16-dfc3-492b-97c1-54ebdb0b0cb1 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:09.119790 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce9dceb-4707-4c7f-912a-b28d8e7efb3a None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:09.161418 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f33b7c-aa74-47db-a1ad-0691cee3baac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:09.162088 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f33b7c-aa74-47db-a1ad-0691cee3baac None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:09.162368 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f33b7c-aa74-47db-a1ad-0691cee3baac None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:09.162639 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f33b7c-aa74-47db-a1ad-0691cee3baac None admin] PATH_INFO: `/v3/users/56f5aa59cf424559a6b65ae250308c09` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:09.179662 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f33b7c-aa74-47db-a1ad-0691cee3baac None admin] RBAC: Authorizing `identity:get_user(user_id=56f5aa59cf424559a6b65ae250308c09)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:09.181201 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f33b7c-aa74-47db-a1ad-0691cee3baac None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:09.183076 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 36/77] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:34:08 2022] GET /identity/v3/users/56f5aa59cf424559a6b65ae250308c09 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:09.186263 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f33b7c-aa74-47db-a1ad-0691cee3baac None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:09.224734 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8599f16-dfc3-492b-97c1-54ebdb0b0cb1 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:09.254541 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:09.261318 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:09.267364 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd8678-c803-41f7-adb5-2065a1996e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:09.268707 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd8678-c803-41f7-adb5-2065a1996e45 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:09.268707 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd8678-c803-41f7-adb5-2065a1996e45 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:09.268707 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecd8678-c803-41f7-adb5-2065a1996e45 None admin] PATH_INFO: `/v3/users/fe0feabca86e4c0ea888e85fba6302d2` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:09.269706 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd8678-c803-41f7-adb5-2065a1996e45 None admin] RBAC: Authorizing `identity:get_user(user_id=fe0feabca86e4c0ea888e85fba6302d2)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:09.274439 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecd8678-c803-41f7-adb5-2065a1996e45 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:09.276027 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 42/78] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:34:09 2022] GET /identity/v3/users/fe0feabca86e4c0ea888e85fba6302d2 => generated 247 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:09.281567 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd8678-c803-41f7-adb5-2065a1996e45 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:09.305105 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f33b7c-aa74-47db-a1ad-0691cee3baac None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:09.340160 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02483a6-1267-46b2-9559-d0d28d7e8f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:09.340798 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02483a6-1267-46b2-9559-d0d28d7e8f65 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:09.341081 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02483a6-1267-46b2-9559-d0d28d7e8f65 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:09.341356 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02483a6-1267-46b2-9559-d0d28d7e8f65 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:09.352680 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02483a6-1267-46b2-9559-d0d28d7e8f65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:34:09.357584 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-b02483a6-1267-46b2-9559-d0d28d7e8f65 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:34:09.357584 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:34:09.357584 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:34:09.357584 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:34:09.357584 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:34:09.357584 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:34:09.357584 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:34:09.357584 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:34:09.357584 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:34:09.357584 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:34:09.357584 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:34:09.357584 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:34:09.357584 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:34:09.357584 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:34:09.357584 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:34:09.357584 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:34:09.358463 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:34:09.358463 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:34:09.358463 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:34:09.358463 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:34:09.358463 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:34:09.358463 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:34:09.358463 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:34:09.358463 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:34:09.358463 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:34:09.358463 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:34:09.358463 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:34:09.358463 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:34:09.358463 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:34:09.358463 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:34:09.358463 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:34:09.358463 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:34:09.360393 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:34:09.360393 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:34:09.360393 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:34:09.360393 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:34:09.360393 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:34:09.360393 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:34:09.360393 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:34:09.360393 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:34:09.360393 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:34:09.360393 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:34:09.360393 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:34:09.360393 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:34:09.360393 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 37/79] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:34:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:34:09.360393 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02483a6-1267-46b2-9559-d0d28d7e8f65 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:09.385081 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecd8678-c803-41f7-adb5-2065a1996e45 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:09.420192 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd19e7f1-3cd4-4f4e-8e04-c97e4d4f506a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:09.420710 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19e7f1-3cd4-4f4e-8e04-c97e4d4f506a None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:09.420990 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19e7f1-3cd4-4f4e-8e04-c97e4d4f506a None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:09.421345 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19e7f1-3cd4-4f4e-8e04-c97e4d4f506a None admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:09.422035 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd19e7f1-3cd4-4f4e-8e04-c97e4d4f506a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:09.422341 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd19e7f1-3cd4-4f4e-8e04-c97e4d4f506a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:09.423730 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd19e7f1-3cd4-4f4e-8e04-c97e4d4f506a None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:09.431876 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 43/80] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:34:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:09.434246 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd19e7f1-3cd4-4f4e-8e04-c97e4d4f506a None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:09.464758 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02483a6-1267-46b2-9559-d0d28d7e8f65 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:09.484905 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:09.502404 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:09.506822 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b3e34-1539-4f50-9ae3-3cf504d9fb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:09.507432 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b3e34-1539-4f50-9ae3-3cf504d9fb3d None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:09.507709 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b3e34-1539-4f50-9ae3-3cf504d9fb3d None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:09.508756 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b3e34-1539-4f50-9ae3-3cf504d9fb3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:09.543058 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd19e7f1-3cd4-4f4e-8e04-c97e4d4f506a None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:09.577113 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b8d51-82d2-47c3-b977-9333113933d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:09.578006 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b8d51-82d2-47c3-b977-9333113933d8 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:09.578213 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b3e34-1539-4f50-9ae3-3cf504d9fb3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:09.578314 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b8d51-82d2-47c3-b977-9333113933d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:09.578548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b8d51-82d2-47c3-b977-9333113933d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:09.579737 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b8d51-82d2-47c3-b977-9333113933d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:09.579840 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b3e34-1539-4f50-9ae3-3cf504d9fb3d None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:09.581115 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b8d51-82d2-47c3-b977-9333113933d8 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:09.582731 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 44/81] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:34:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:09.583503 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b8d51-82d2-47c3-b977-9333113933d8 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:09.690444 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b8d51-82d2-47c3-b977-9333113933d8 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:09.690636 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 38/82] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:34:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:34:09.691363 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b3e34-1539-4f50-9ae3-3cf504d9fb3d None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:09.710826 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:09.725396 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:09.732674 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758dbdc8-b5b2-4526-a867-4a04c9dc0a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:09.733289 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758dbdc8-b5b2-4526-a867-4a04c9dc0a2f None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:09.733600 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758dbdc8-b5b2-4526-a867-4a04c9dc0a2f None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:09.733878 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758dbdc8-b5b2-4526-a867-4a04c9dc0a2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:09.802967 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b3e34-1539-4f50-9ae3-3cf504d9fb3d None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:09.807312 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758dbdc8-b5b2-4526-a867-4a04c9dc0a2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:09.808798 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758dbdc8-b5b2-4526-a867-4a04c9dc0a2f None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:09.839707 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96bc85b-f1dc-4f05-af59-1d0e2bbe9188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:09.840364 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bc85b-f1dc-4f05-af59-1d0e2bbe9188 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:09.840588 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bc85b-f1dc-4f05-af59-1d0e2bbe9188 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:09.840932 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bc85b-f1dc-4f05-af59-1d0e2bbe9188 None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:09.841546 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96bc85b-f1dc-4f05-af59-1d0e2bbe9188 None admin] RBAC: Adding query filter params (name=member) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:09.841849 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96bc85b-f1dc-4f05-af59-1d0e2bbe9188 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:09.843365 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96bc85b-f1dc-4f05-af59-1d0e2bbe9188 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:09.852746 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 39/83] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 8 13:34:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:09.853680 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96bc85b-f1dc-4f05-af59-1d0e2bbe9188 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:09.917553 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 45/84] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:34:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:34:09.918412 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758dbdc8-b5b2-4526-a867-4a04c9dc0a2f None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:09.938050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:09.954348 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:09.960595 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96bc85b-f1dc-4f05-af59-1d0e2bbe9188 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:10.001469 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9cb4e-86ba-432f-a732-978881e48f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:10.002103 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9cb4e-86ba-432f-a732-978881e48f33 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:10.002381 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9cb4e-86ba-432f-a732-978881e48f33 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:10.002681 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9cb4e-86ba-432f-a732-978881e48f33 None admin] PATH_INFO: `/v3/users/56f5aa59cf424559a6b65ae250308c09` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:10.003881 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9cb4e-86ba-432f-a732-978881e48f33 None admin] RBAC: Authorizing `identity:get_user(user_id=56f5aa59cf424559a6b65ae250308c09)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:10.005331 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9cb4e-86ba-432f-a732-978881e48f33 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:10.006961 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 40/85] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:34:09 2022] GET /identity/v3/users/56f5aa59cf424559a6b65ae250308c09 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:10.007728 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9cb4e-86ba-432f-a732-978881e48f33 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:10.035175 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758dbdc8-b5b2-4526-a867-4a04c9dc0a2f None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:10.070728 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6edc7e-8f45-4d76-9df9-f212a7775aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:10.071798 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6edc7e-8f45-4d76-9df9-f212a7775aec None admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:10.072322 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6edc7e-8f45-4d76-9df9-f212a7775aec None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:10.072882 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6edc7e-8f45-4d76-9df9-f212a7775aec None admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:10.073945 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6edc7e-8f45-4d76-9df9-f212a7775aec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:10.075426 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6edc7e-8f45-4d76-9df9-f212a7775aec None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:10.105283 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 46/86] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Sep 8 13:34:09 2022] POST /identity/v3/users => generated 289 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:34:10.106167 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6edc7e-8f45-4d76-9df9-f212a7775aec None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:10.129676 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9cb4e-86ba-432f-a732-978881e48f33 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:10.175445 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc041785-0c2f-46ab-b3bf-dbe0b26b16ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:10.176200 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc041785-0c2f-46ab-b3bf-dbe0b26b16ca None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:10.176487 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc041785-0c2f-46ab-b3bf-dbe0b26b16ca None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:10.176773 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc041785-0c2f-46ab-b3bf-dbe0b26b16ca None admin] PATH_INFO: `/v3/projects/8afaf32861dc4e62a9b32129a27c4900` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:10.178100 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc041785-0c2f-46ab-b3bf-dbe0b26b16ca None admin] RBAC: Authorizing `identity:get_project(project_id=8afaf32861dc4e62a9b32129a27c4900)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:10.179792 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc041785-0c2f-46ab-b3bf-dbe0b26b16ca None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:10.182367 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 41/87] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:34:10 2022] GET /identity/v3/projects/8afaf32861dc4e62a9b32129a27c4900 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:10.183111 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc041785-0c2f-46ab-b3bf-dbe0b26b16ca None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:10.208737 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:10.225417 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:10.255530 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6edc7e-8f45-4d76-9df9-f212a7775aec None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:10.312361 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c867c8-4351-45e6-a2da-d7061233daac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:10.313049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c867c8-4351-45e6-a2da-d7061233daac None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:10.313326 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c867c8-4351-45e6-a2da-d7061233daac None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:10.313665 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c867c8-4351-45e6-a2da-d7061233daac None admin] PATH_INFO: `/v3/users/56f5aa59cf424559a6b65ae250308c09` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:10.315240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c867c8-4351-45e6-a2da-d7061233daac None admin] RBAC: Authorizing `identity:get_user(user_id=56f5aa59cf424559a6b65ae250308c09)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:10.316725 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c867c8-4351-45e6-a2da-d7061233daac None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:10.318392 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 47/88] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:34:10 2022] GET /identity/v3/users/56f5aa59cf424559a6b65ae250308c09 => generated 275 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:10.319268 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c867c8-4351-45e6-a2da-d7061233daac None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:10.327867 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc041785-0c2f-46ab-b3bf-dbe0b26b16ca None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:10.379957 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ead1f1-9824-4e6b-9276-a642ebad7d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:10.380646 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ead1f1-9824-4e6b-9276-a642ebad7d96 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:10.380931 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ead1f1-9824-4e6b-9276-a642ebad7d96 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:10.381207 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ead1f1-9824-4e6b-9276-a642ebad7d96 None admin] PATH_INFO: `/v3/projects/8afaf32861dc4e62a9b32129a27c4900` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:10.382629 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ead1f1-9824-4e6b-9276-a642ebad7d96 None admin] RBAC: Authorizing `identity:get_project(project_id=8afaf32861dc4e62a9b32129a27c4900)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:10.385176 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ead1f1-9824-4e6b-9276-a642ebad7d96 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:10.387260 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 42/89] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:34:10 2022] GET /identity/v3/projects/8afaf32861dc4e62a9b32129a27c4900 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:10.388174 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ead1f1-9824-4e6b-9276-a642ebad7d96 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:10.469284 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c867c8-4351-45e6-a2da-d7061233daac None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:10.499297 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:10.519548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf40a4-4ebc-4387-8382-166a32840efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:10.520527 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf40a4-4ebc-4387-8382-166a32840efd None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:10.520908 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf40a4-4ebc-4387-8382-166a32840efd None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:10.521335 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf40a4-4ebc-4387-8382-166a32840efd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:10.523132 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ead1f1-9824-4e6b-9276-a642ebad7d96 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:10.563678 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:10.573221 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f5e9e-1be4-456e-9f4f-1d0eedc0d5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:10.573911 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f5e9e-1be4-456e-9f4f-1d0eedc0d5a1 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:10.574197 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f5e9e-1be4-456e-9f4f-1d0eedc0d5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:10.574474 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f5e9e-1be4-456e-9f4f-1d0eedc0d5a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:10.575227 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f5e9e-1be4-456e-9f4f-1d0eedc0d5a1 None admin] RBAC: Adding query filter params (role.id=0735c260e70441cc87ad611b789d5c56, scope.project.id=8afaf32861dc4e62a9b32129a27c4900, user.id=56f5aa59cf424559a6b65ae250308c09) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:10.575542 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f5e9e-1be4-456e-9f4f-1d0eedc0d5a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:10.577029 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f5e9e-1be4-456e-9f4f-1d0eedc0d5a1 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:10.587812 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 43/90] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 8 13:34:10 2022] GET /identity/v3/role_assignments?user.id=56f5aa59cf424559a6b65ae250308c09&scope.project.id=8afaf32861dc4e62a9b32129a27c4900&role.id=0735c260e70441cc87ad611b789d5c56 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:10.588355 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f5e9e-1be4-456e-9f4f-1d0eedc0d5a1 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:10.630495 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf40a4-4ebc-4387-8382-166a32840efd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:10.631945 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf40a4-4ebc-4387-8382-166a32840efd None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:10.735715 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f5e9e-1be4-456e-9f4f-1d0eedc0d5a1 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:10.784855 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3ed62-6d7d-478c-b78c-840d6773c78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:10.785816 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3ed62-6d7d-478c-b78c-840d6773c78e None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:10.787355 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3ed62-6d7d-478c-b78c-840d6773c78e None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:10.787813 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3ed62-6d7d-478c-b78c-840d6773c78e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:10.840875 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 48/91] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:34:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:34:10.842677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:10.845034 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf40a4-4ebc-4387-8382-166a32840efd None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:10.917552 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d3ed62-6d7d-478c-b78c-840d6773c78e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:10.920100 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d3ed62-6d7d-478c-b78c-840d6773c78e None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:10.961736 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:11.074573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf40a4-4ebc-4387-8382-166a32840efd None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:11.108183 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 44/92] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:34:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:34:11.109088 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3ed62-6d7d-478c-b78c-840d6773c78e None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:11.172271 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:11.174121 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434a4c8-ea4b-4cc2-b4b4-78b80ef8f52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:11.175173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434a4c8-ea4b-4cc2-b4b4-78b80ef8f52d None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:11.175173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434a4c8-ea4b-4cc2-b4b4-78b80ef8f52d None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:11.175329 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434a4c8-ea4b-4cc2-b4b4-78b80ef8f52d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:11.176096 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8434a4c8-ea4b-4cc2-b4b4-78b80ef8f52d None admin] RBAC: Adding query filter params (role.id=9c76f398c9e04caeab83842e70eb824b, scope.project.id=8afaf32861dc4e62a9b32129a27c4900, user.id=fe0feabca86e4c0ea888e85fba6302d2) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:11.176410 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8434a4c8-ea4b-4cc2-b4b4-78b80ef8f52d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:11.178071 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8434a4c8-ea4b-4cc2-b4b4-78b80ef8f52d None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:11.196492 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 49/93] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 8 13:34:10 2022] GET /identity/v3/role_assignments?user.id=fe0feabca86e4c0ea888e85fba6302d2&scope.project.id=8afaf32861dc4e62a9b32129a27c4900&role.id=9c76f398c9e04caeab83842e70eb824b => generated 259 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:11.197400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434a4c8-ea4b-4cc2-b4b4-78b80ef8f52d None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:11.281396 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3ed62-6d7d-478c-b78c-840d6773c78e None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:11.380778 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c88b3-7ed7-40bd-a3b1-3d1a3dd780fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:11.381340 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c88b3-7ed7-40bd-a3b1-3d1a3dd780fd None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:11.381640 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c88b3-7ed7-40bd-a3b1-3d1a3dd780fd None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:11.381913 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c88b3-7ed7-40bd-a3b1-3d1a3dd780fd None admin] PATH_INFO: `/v3/projects/8afaf32861dc4e62a9b32129a27c4900` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:11.384422 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81c88b3-7ed7-40bd-a3b1-3d1a3dd780fd None admin] RBAC: Authorizing `identity:get_project(project_id=8afaf32861dc4e62a9b32129a27c4900)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:11.385932 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81c88b3-7ed7-40bd-a3b1-3d1a3dd780fd None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:11.388200 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 45/94] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:34:11 2022] GET /identity/v3/projects/8afaf32861dc4e62a9b32129a27c4900 => generated 298 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:11.394963 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c88b3-7ed7-40bd-a3b1-3d1a3dd780fd None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:11.503721 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434a4c8-ea4b-4cc2-b4b4-78b80ef8f52d None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:11.559923 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:11.600850 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38282159-6bbb-467f-8e1d-a199eb63f978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:11.602358 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38282159-6bbb-467f-8e1d-a199eb63f978 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:11.602884 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38282159-6bbb-467f-8e1d-a199eb63f978 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:11.603232 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38282159-6bbb-467f-8e1d-a199eb63f978 None admin] PATH_INFO: `/v3/projects/82f4d2711ad2497f95f1217ff347aec6` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:11.604990 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38282159-6bbb-467f-8e1d-a199eb63f978 None admin] RBAC: Authorizing `identity:get_project(project_id=82f4d2711ad2497f95f1217ff347aec6)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:11.606527 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38282159-6bbb-467f-8e1d-a199eb63f978 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:11.608483 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 50/95] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:34:11 2022] GET /identity/v3/projects/82f4d2711ad2497f95f1217ff347aec6 => generated 312 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:11.614276 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38282159-6bbb-467f-8e1d-a199eb63f978 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:11.679461 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c88b3-7ed7-40bd-a3b1-3d1a3dd780fd None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:11.712836 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:11.762146 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab3698-c193-4752-80db-3f56a97739c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:11.762792 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab3698-c193-4752-80db-3f56a97739c8 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:11.763013 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab3698-c193-4752-80db-3f56a97739c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:11.763289 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab3698-c193-4752-80db-3f56a97739c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:11.764020 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adab3698-c193-4752-80db-3f56a97739c8 None admin] RBAC: Adding query filter params (role.id=a0b9865e737f48f2975da1bb8cb386b7, scope.project.id=8afaf32861dc4e62a9b32129a27c4900, user.id=56f5aa59cf424559a6b65ae250308c09) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:11.764327 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adab3698-c193-4752-80db-3f56a97739c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:11.765812 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adab3698-c193-4752-80db-3f56a97739c8 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:11.783621 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 46/96] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 8 13:34:11 2022] GET /identity/v3/role_assignments?user.id=56f5aa59cf424559a6b65ae250308c09&scope.project.id=8afaf32861dc4e62a9b32129a27c4900&role.id=a0b9865e737f48f2975da1bb8cb386b7 => generated 259 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:11.806593 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38282159-6bbb-467f-8e1d-a199eb63f978 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:11.878801 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c487186-b1a4-4922-9fbf-b8f658663cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:11.879467 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c487186-b1a4-4922-9fbf-b8f658663cb9 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:11.879698 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c487186-b1a4-4922-9fbf-b8f658663cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:11.879975 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c487186-b1a4-4922-9fbf-b8f658663cb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:11.880726 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c487186-b1a4-4922-9fbf-b8f658663cb9 None admin] RBAC: Adding query filter params (role.id=0735c260e70441cc87ad611b789d5c56, scope.project.id=82f4d2711ad2497f95f1217ff347aec6, user.id=56f5aa59cf424559a6b65ae250308c09) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:11.881041 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c487186-b1a4-4922-9fbf-b8f658663cb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:11.882586 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c487186-b1a4-4922-9fbf-b8f658663cb9 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:11.894564 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 51/97] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 8 13:34:11 2022] GET /identity/v3/role_assignments?user.id=56f5aa59cf424559a6b65ae250308c09&scope.project.id=82f4d2711ad2497f95f1217ff347aec6&role.id=0735c260e70441cc87ad611b789d5c56 => generated 259 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:34:13.421707 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d634ae-8a0e-4970-a65a-01a35a08774f None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:13.422797 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d634ae-8a0e-4970-a65a-01a35a08774f None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:13.423309 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d634ae-8a0e-4970-a65a-01a35a08774f None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:13.424882 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 47/98] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:34:13.431226 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeec372-8929-4032-98fa-ceb2afc620ef None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:13.432124 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeec372-8929-4032-98fa-ceb2afc620ef None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:13.432629 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeec372-8929-4032-98fa-ceb2afc620ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:13.458299 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-baeec372-8929-4032-98fa-ceb2afc620ef None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:13.460028 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-baeec372-8929-4032-98fa-ceb2afc620ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:13.538754 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:13.570757 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 52/99] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:34:13.762555 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f98ee-32f8-45a4-8f06-e2ad34c66b43 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:13.763256 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f98ee-32f8-45a4-8f06-e2ad34c66b43 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:13.763778 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f98ee-32f8-45a4-8f06-e2ad34c66b43 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:13.765356 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 48/100] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:34:13.773132 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c7d9a-dcfc-46c2-b758-c137ccbaf56a None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:13.774447 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c7d9a-dcfc-46c2-b758-c137ccbaf56a None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:13.775065 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c7d9a-dcfc-46c2-b758-c137ccbaf56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:13.802608 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-a63c7d9a-dcfc-46c2-b758-c137ccbaf56a None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:13.804237 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-a63c7d9a-dcfc-46c2-b758-c137ccbaf56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:13.905040 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 53/101] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:34:13.978827 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b71dec-a8f7-4740-821f-3c4c48a3e184 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:13.979468 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b71dec-a8f7-4740-821f-3c4c48a3e184 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:13.979980 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b71dec-a8f7-4740-821f-3c4c48a3e184 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:13.981547 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 49/102] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:34:13.987230 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2a73a-01b5-4d4f-b73c-b71755a39969 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:13.987907 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2a73a-01b5-4d4f-b73c-b71755a39969 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:13.988397 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c2a73a-01b5-4d4f-b73c-b71755a39969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:14.018391 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-f8c2a73a-01b5-4d4f-b73c-b71755a39969 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:14.019947 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-f8c2a73a-01b5-4d4f-b73c-b71755a39969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:14.114486 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 54/103] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:34:14.372409 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b71dec-a8f7-4740-821f-3c4c48a3e184 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:14.527131 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b71dec-a8f7-4740-821f-3c4c48a3e184 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:14.574494 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61138636-cf81-4016-a08e-7353ac26471a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:14.575531 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61138636-cf81-4016-a08e-7353ac26471a None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:14.576025 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61138636-cf81-4016-a08e-7353ac26471a None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:14.576524 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61138636-cf81-4016-a08e-7353ac26471a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:14.578983 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61138636-cf81-4016-a08e-7353ac26471a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:14.580677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61138636-cf81-4016-a08e-7353ac26471a None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:14.582534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 50/104] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:34:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:34:14.592004 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2a73a-01b5-4d4f-b73c-b71755a39969 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:14.657261 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:14.740979 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c2a73a-01b5-4d4f-b73c-b71755a39969 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:14.798513 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61138636-cf81-4016-a08e-7353ac26471a None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:14.836735 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f37514-0b09-45e3-aa91-784e707d89a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:14.837850 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f37514-0b09-45e3-aa91-784e707d89a0 None admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:14.838336 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f37514-0b09-45e3-aa91-784e707d89a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:14.838824 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f37514-0b09-45e3-aa91-784e707d89a0 None admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:14.839727 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f37514-0b09-45e3-aa91-784e707d89a0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:14.841467 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f37514-0b09-45e3-aa91-784e707d89a0 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:14.902217 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 55/105] 10.222.0.69 () {60 vars in 1141 bytes} [Thu Sep 8 13:34:14 2022] POST /identity/v3/projects => generated 302 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:34:14.925815 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:15.018807 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f37514-0b09-45e3-aa91-784e707d89a0 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:15.049881 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61138636-cf81-4016-a08e-7353ac26471a None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:15.125117 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9f027-eb43-4b38-854b-64d3c8a69f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:15.126471 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9f027-eb43-4b38-854b-64d3c8a69f7f None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:15.127209 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9f027-eb43-4b38-854b-64d3c8a69f7f None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:15.127954 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9f027-eb43-4b38-854b-64d3c8a69f7f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:15.144444 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9f027-eb43-4b38-854b-64d3c8a69f7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:34:15.153134 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-adf9f027-eb43-4b38-854b-64d3c8a69f7f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:34:15.153134 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:34:15.153134 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:34:15.153134 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:34:15.153134 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:34:15.153134 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:34:15.153134 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:34:15.153134 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:34:15.153134 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:34:15.153134 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:34:15.153134 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:34:15.153134 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:34:15.153134 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:34:15.153134 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:34:15.153134 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:34:15.153134 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:34:15.154159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:34:15.154159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:34:15.154159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:34:15.154159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:34:15.154159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:34:15.154159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:34:15.154159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:34:15.154159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:34:15.154159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:34:15.154159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:34:15.154159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:34:15.154159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:34:15.154159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:34:15.154159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:34:15.154159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:34:15.154159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:34:15.155407 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:34:15.155407 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:34:15.155407 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:34:15.155407 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:34:15.155407 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:34:15.155407 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:34:15.155407 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:34:15.155407 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:34:15.155407 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:34:15.155407 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:34:15.155407 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:34:15.155407 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:34:15.158197 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 51/106] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:34:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:34:15.160272 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0cd0bc-aa32-4506-8fac-f65df842407f None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:15.161408 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0cd0bc-aa32-4506-8fac-f65df842407f None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:15.161931 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0cd0bc-aa32-4506-8fac-f65df842407f None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:15.163622 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 52/107] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:34:15.175332 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1772cd1-45c0-41f4-b22a-a1f07fe944e0 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:15.175697 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1772cd1-45c0-41f4-b22a-a1f07fe944e0 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:15.176078 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1772cd1-45c0-41f4-b22a-a1f07fe944e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:15.207912 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-c1772cd1-45c0-41f4-b22a-a1f07fe944e0 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:15.209587 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-c1772cd1-45c0-41f4-b22a-a1f07fe944e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:15.219274 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:15.236830 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f37514-0b09-45e3-aa91-784e707d89a0 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:15.290448 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e4ccc-3e97-4624-b762-32a9693b6978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:15.291507 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e4ccc-3e97-4624-b762-32a9693b6978 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:15.291507 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e4ccc-3e97-4624-b762-32a9693b6978 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:15.291687 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e4ccc-3e97-4624-b762-32a9693b6978 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:15.308774 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523e4ccc-3e97-4624-b762-32a9693b6978 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:34:15.319250 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-523e4ccc-3e97-4624-b762-32a9693b6978 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:34:15.319250 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:34:15.319250 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:34:15.319250 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:34:15.319250 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:34:15.319250 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:34:15.319250 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:34:15.319250 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:34:15.319250 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:34:15.319250 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:34:15.319250 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:34:15.319250 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:34:15.319250 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:34:15.319250 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:34:15.319250 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:34:15.319250 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:34:15.320216 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:34:15.320216 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:34:15.320216 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:34:15.320216 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:34:15.320216 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:34:15.320216 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:34:15.320216 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:34:15.320216 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:34:15.320216 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:34:15.320216 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:34:15.320216 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:34:15.320216 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:34:15.320216 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:34:15.320216 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:34:15.320216 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:34:15.320216 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:34:15.321005 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:34:15.321005 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:34:15.321005 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:34:15.321005 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:34:15.321005 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:34:15.321005 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:34:15.321005 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:34:15.321005 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:34:15.321005 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:34:15.321005 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:34:15.321005 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:34:15.321005 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:34:15.321725 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 56/108] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:34:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:34:15.322674 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e4ccc-3e97-4624-b762-32a9693b6978 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:15.328217 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 53/109] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:34:15.329912 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924746bb-c5a6-4187-91cd-77252589a0a2 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:15.330362 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924746bb-c5a6-4187-91cd-77252589a0a2 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:15.330790 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924746bb-c5a6-4187-91cd-77252589a0a2 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:15.338230 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 54/110] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:15 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:34:15.339346 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924746bb-c5a6-4187-91cd-77252589a0a2 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:15.405872 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:15.490531 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e4ccc-3e97-4624-b762-32a9693b6978 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:15.563634 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded9018c-a406-4964-b203-bcdcf445bd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:15.564270 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9018c-a406-4964-b203-bcdcf445bd1f None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:15.564550 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9018c-a406-4964-b203-bcdcf445bd1f None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:15.564822 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded9018c-a406-4964-b203-bcdcf445bd1f None admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:15.565546 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9018c-a406-4964-b203-bcdcf445bd1f None admin] RBAC: Adding query filter params (name=reader) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:15.565854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9018c-a406-4964-b203-bcdcf445bd1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:15.567363 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded9018c-a406-4964-b203-bcdcf445bd1f None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:15.584718 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 57/111] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 8 13:34:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:15.588539 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cea24e-be5f-47d4-9c66-1bc7c2d0c128 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:15.589313 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cea24e-be5f-47d4-9c66-1bc7c2d0c128 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:15.590274 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cea24e-be5f-47d4-9c66-1bc7c2d0c128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:15.614869 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924746bb-c5a6-4187-91cd-77252589a0a2 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:15.631040 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-d0cea24e-be5f-47d4-9c66-1bc7c2d0c128 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:15.633857 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-d0cea24e-be5f-47d4-9c66-1bc7c2d0c128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:15.657693 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:15.687293 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb61fc5-8567-4020-b00e-3b2462f16c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:15.688284 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb61fc5-8567-4020-b00e-3b2462f16c47 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:15.688769 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb61fc5-8567-4020-b00e-3b2462f16c47 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:15.689236 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb61fc5-8567-4020-b00e-3b2462f16c47 None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:15.690164 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb61fc5-8567-4020-b00e-3b2462f16c47 None admin] RBAC: Adding query filter params (name=member) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:15.690675 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb61fc5-8567-4020-b00e-3b2462f16c47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:15.692255 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb61fc5-8567-4020-b00e-3b2462f16c47 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:15.702815 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 55/112] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 8 13:34:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:15.704172 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb61fc5-8567-4020-b00e-3b2462f16c47 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:15.768262 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 58/113] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:34:15.769427 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cea24e-be5f-47d4-9c66-1bc7c2d0c128 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:15.831779 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:15.836485 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb61fc5-8567-4020-b00e-3b2462f16c47 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:15.886728 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c5411-8865-4fdc-9baf-c0740829ceee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:15.888388 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c5411-8865-4fdc-9baf-c0740829ceee None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:15.889142 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c5411-8865-4fdc-9baf-c0740829ceee None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:15.889647 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c5411-8865-4fdc-9baf-c0740829ceee None admin] PATH_INFO: `/v3/users/559ac14a491d47048d4190b7d89fc4f7` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:15.911662 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c5411-8865-4fdc-9baf-c0740829ceee None admin] RBAC: Authorizing `identity:get_user(user_id=559ac14a491d47048d4190b7d89fc4f7)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:15.914266 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c5411-8865-4fdc-9baf-c0740829ceee None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:15.916763 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 56/114] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:34:15 2022] GET /identity/v3/users/559ac14a491d47048d4190b7d89fc4f7 => generated 289 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:15.917861 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c5411-8865-4fdc-9baf-c0740829ceee None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:15.939588 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cea24e-be5f-47d4-9c66-1bc7c2d0c128 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:15.981524 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ebb303-24b8-4582-a48e-92261c5ec045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:15.982502 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebb303-24b8-4582-a48e-92261c5ec045 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:15.982942 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebb303-24b8-4582-a48e-92261c5ec045 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:15.983397 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebb303-24b8-4582-a48e-92261c5ec045 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:16.000855 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ebb303-24b8-4582-a48e-92261c5ec045 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:34:16.007146 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-98ebb303-24b8-4582-a48e-92261c5ec045 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:34:16.007146 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:34:16.007146 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:34:16.007146 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:34:16.007146 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:34:16.007146 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:34:16.007146 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:34:16.007146 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:34:16.007146 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:34:16.007146 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:34:16.007146 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:34:16.007146 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:34:16.007146 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:34:16.007146 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:34:16.007146 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:34:16.007146 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:34:16.008759 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:34:16.008759 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:34:16.008759 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:34:16.008759 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:34:16.008759 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:34:16.008759 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:34:16.008759 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:34:16.008759 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:34:16.008759 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:34:16.008759 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:34:16.008759 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:34:16.008759 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:34:16.008759 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:34:16.008759 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:34:16.008759 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:34:16.008759 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:34:16.010593 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:34:16.010593 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:34:16.010593 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:34:16.010593 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:34:16.010593 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:34:16.010593 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:34:16.010593 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:34:16.010593 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:34:16.010593 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:34:16.010593 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:34:16.010593 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:34:16.010593 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:34:16.010593 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 59/115] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 8 13:34:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:34:16.011322 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bbe35-c95f-4a32-b967-05db05f0b0e5 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:16.011322 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bbe35-c95f-4a32-b967-05db05f0b0e5 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:16.011527 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bbe35-c95f-4a32-b967-05db05f0b0e5 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:16.013831 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 60/116] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:34:16.018122 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bbe35-c95f-4a32-b967-05db05f0b0e5 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:16.018624 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:16.066560 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c5411-8865-4fdc-9baf-c0740829ceee None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:16.109865 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324fcb3-3fb4-4d76-8ba0-4c7d8187c230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:16.110517 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324fcb3-3fb4-4d76-8ba0-4c7d8187c230 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:16.110786 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324fcb3-3fb4-4d76-8ba0-4c7d8187c230 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:16.111061 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324fcb3-3fb4-4d76-8ba0-4c7d8187c230 None admin] PATH_INFO: `/v3/users/56f5aa59cf424559a6b65ae250308c09` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:16.112267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3324fcb3-3fb4-4d76-8ba0-4c7d8187c230 None admin] RBAC: Authorizing `identity:get_user(user_id=56f5aa59cf424559a6b65ae250308c09)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:16.114004 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3324fcb3-3fb4-4d76-8ba0-4c7d8187c230 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:16.120858 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 57/117] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:34:15 2022] GET /identity/v3/users/56f5aa59cf424559a6b65ae250308c09 => generated 275 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:16.120858 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324fcb3-3fb4-4d76-8ba0-4c7d8187c230 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:16.142298 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bbe35-c95f-4a32-b967-05db05f0b0e5 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:16.158299 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:16.191497 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d89df0-f9a9-4f41-ae0e-1ee690607f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:16.192239 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d89df0-f9a9-4f41-ae0e-1ee690607f7b None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:16.192859 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d89df0-f9a9-4f41-ae0e-1ee690607f7b None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:16.193461 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d89df0-f9a9-4f41-ae0e-1ee690607f7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:16.263577 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324fcb3-3fb4-4d76-8ba0-4c7d8187c230 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:16.292942 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d89df0-f9a9-4f41-ae0e-1ee690607f7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:16.294803 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d89df0-f9a9-4f41-ae0e-1ee690607f7b None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:16.297964 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:16.317230 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b9b74-83b3-4697-bde9-aeed174aea8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:16.317894 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b9b74-83b3-4697-bde9-aeed174aea8d None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:16.318173 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b9b74-83b3-4697-bde9-aeed174aea8d None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:16.318527 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b9b74-83b3-4697-bde9-aeed174aea8d None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:16.319204 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b9b74-83b3-4697-bde9-aeed174aea8d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:16.319508 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b9b74-83b3-4697-bde9-aeed174aea8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:16.321537 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b9b74-83b3-4697-bde9-aeed174aea8d None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:16.331804 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 58/118] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:34:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:16.333119 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d032c-f73d-44f5-946a-b14420abe9fa None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:16.333491 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d032c-f73d-44f5-946a-b14420abe9fa None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:16.333770 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d032c-f73d-44f5-946a-b14420abe9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:16.359243 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-f61d032c-f73d-44f5-946a-b14420abe9fa None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:16.360576 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-f61d032c-f73d-44f5-946a-b14420abe9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:16.414989 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 61/119] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:34:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:34:16.416346 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d89df0-f9a9-4f41-ae0e-1ee690607f7b None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:16.454706 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 59/120] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:34:16.456258 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d032c-f73d-44f5-946a-b14420abe9fa None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:16.479998 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:16.542908 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d89df0-f9a9-4f41-ae0e-1ee690607f7b None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:16.545294 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:16.580974 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad8db1-b809-48ae-bfe7-a6221da2aa45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:16.581715 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad8db1-b809-48ae-bfe7-a6221da2aa45 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:16.581918 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad8db1-b809-48ae-bfe7-a6221da2aa45 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:16.582190 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad8db1-b809-48ae-bfe7-a6221da2aa45 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:16.594406 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edad8db1-b809-48ae-bfe7-a6221da2aa45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:34:16.595375 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d032c-f73d-44f5-946a-b14420abe9fa None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:16.599582 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-edad8db1-b809-48ae-bfe7-a6221da2aa45 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:34:16.599582 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:34:16.599582 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:34:16.599582 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:34:16.599582 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:34:16.599582 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:34:16.599582 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:34:16.599582 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:34:16.599582 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:34:16.599582 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:34:16.599582 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:34:16.599582 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:34:16.599582 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:34:16.599582 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:34:16.599582 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:34:16.599582 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:34:16.600451 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:34:16.600451 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:34:16.600451 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:34:16.600451 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:34:16.600451 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:34:16.600451 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:34:16.600451 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:34:16.600451 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:34:16.600451 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:34:16.600451 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:34:16.600451 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:34:16.600451 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:34:16.600451 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:34:16.600451 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:34:16.600451 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:34:16.600451 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:34:16.602010 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:34:16.602010 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:34:16.602010 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:34:16.602010 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:34:16.602010 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:34:16.602010 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:34:16.602010 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:34:16.602010 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:34:16.602010 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:34:16.602010 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:34:16.602010 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:34:16.602010 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:34:16.602010 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 62/121] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:34:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:34:16.602010 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad8db1-b809-48ae-bfe7-a6221da2aa45 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:16.640442 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346a28c-69ab-409a-8838-58be862c3dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:16.641443 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346a28c-69ab-409a-8838-58be862c3dc9 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:16.641602 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346a28c-69ab-409a-8838-58be862c3dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:16.641935 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346a28c-69ab-409a-8838-58be862c3dc9 None admin] PATH_INFO: `/v3/projects/8afaf32861dc4e62a9b32129a27c4900` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:16.643514 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c346a28c-69ab-409a-8838-58be862c3dc9 None admin] RBAC: Authorizing `identity:get_project(project_id=8afaf32861dc4e62a9b32129a27c4900)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:16.645062 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c346a28c-69ab-409a-8838-58be862c3dc9 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:16.647210 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 60/122] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:34:16 2022] GET /identity/v3/projects/8afaf32861dc4e62a9b32129a27c4900 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:16.652920 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346a28c-69ab-409a-8838-58be862c3dc9 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:16.716155 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad8db1-b809-48ae-bfe7-a6221da2aa45 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:16.754067 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e96429-04aa-470c-90a9-e267552592c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:16.754714 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e96429-04aa-470c-90a9-e267552592c1 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:16.755000 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e96429-04aa-470c-90a9-e267552592c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:16.755282 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e96429-04aa-470c-90a9-e267552592c1 None admin] PATH_INFO: `/v3/users/fe0feabca86e4c0ea888e85fba6302d2` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:16.756190 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:16.756459 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e96429-04aa-470c-90a9-e267552592c1 None admin] RBAC: Authorizing `identity:get_user(user_id=fe0feabca86e4c0ea888e85fba6302d2)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:16.758884 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e96429-04aa-470c-90a9-e267552592c1 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:16.760598 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 63/123] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:34:16 2022] GET /identity/v3/users/fe0feabca86e4c0ea888e85fba6302d2 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:16.766002 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e96429-04aa-470c-90a9-e267552592c1 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:16.781556 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c346a28c-69ab-409a-8838-58be862c3dc9 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:16.806915 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:16.835611 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c26a2b0-a0ec-4dec-8e3b-7df769f0de12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:16.836523 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26a2b0-a0ec-4dec-8e3b-7df769f0de12 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:16.836856 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26a2b0-a0ec-4dec-8e3b-7df769f0de12 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:16.837145 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26a2b0-a0ec-4dec-8e3b-7df769f0de12 None admin] PATH_INFO: `/v3/projects/8afaf32861dc4e62a9b32129a27c4900` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:16.838977 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c26a2b0-a0ec-4dec-8e3b-7df769f0de12 None admin] RBAC: Authorizing `identity:get_project(project_id=8afaf32861dc4e62a9b32129a27c4900)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:16.840457 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c26a2b0-a0ec-4dec-8e3b-7df769f0de12 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:16.842423 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 61/124] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:34:16 2022] GET /identity/v3/projects/8afaf32861dc4e62a9b32129a27c4900 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:16.848165 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c26a2b0-a0ec-4dec-8e3b-7df769f0de12 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:16.892455 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e96429-04aa-470c-90a9-e267552592c1 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:16.934747 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f192ec-787c-4b1c-972d-b30bc1f95229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:16.935154 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f192ec-787c-4b1c-972d-b30bc1f95229 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:16.935602 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f192ec-787c-4b1c-972d-b30bc1f95229 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:16.935602 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f192ec-787c-4b1c-972d-b30bc1f95229 None admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:16.935602 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f192ec-787c-4b1c-972d-b30bc1f95229 None admin] RBAC: Adding query filter params (name=member) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:16.935602 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f192ec-787c-4b1c-972d-b30bc1f95229 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:16.935602 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f192ec-787c-4b1c-972d-b30bc1f95229 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:16.948218 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 64/125] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 8 13:34:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:16.949407 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f192ec-787c-4b1c-972d-b30bc1f95229 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:16.987671 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c26a2b0-a0ec-4dec-8e3b-7df769f0de12 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:17.037945 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d1bf8-4c58-4c53-8be4-7c39dbfd10ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:17.038617 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d1bf8-4c58-4c53-8be4-7c39dbfd10ca None admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:17.040076 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d1bf8-4c58-4c53-8be4-7c39dbfd10ca None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:17.040390 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d1bf8-4c58-4c53-8be4-7c39dbfd10ca None admin] PATH_INFO: `/v3/projects/8afaf32861dc4e62a9b32129a27c4900/users/56f5aa59cf424559a6b65ae250308c09/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:17.042532 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d1bf8-4c58-4c53-8be4-7c39dbfd10ca None admin] RBAC: Authorizing `identity:create_grant(project_id=8afaf32861dc4e62a9b32129a27c4900, user_id=56f5aa59cf424559a6b65ae250308c09, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:17.044872 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d1bf8-4c58-4c53-8be4-7c39dbfd10ca None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:17.062857 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 62/126] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Sep 8 13:34:16 2022] PUT /identity/v3/projects/8afaf32861dc4e62a9b32129a27c4900/users/56f5aa59cf424559a6b65ae250308c09/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:34:17.063913 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d1bf8-4c58-4c53-8be4-7c39dbfd10ca None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:17.074098 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f192ec-787c-4b1c-972d-b30bc1f95229 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:17.076175 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:17.096536 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:17.126051 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92da11-012d-47b4-81f8-b50683cfc473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:17.126806 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92da11-012d-47b4-81f8-b50683cfc473 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:17.127217 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92da11-012d-47b4-81f8-b50683cfc473 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:17.127688 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92da11-012d-47b4-81f8-b50683cfc473 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:17.144457 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c92da11-012d-47b4-81f8-b50683cfc473 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:34:17.152425 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-7c92da11-012d-47b4-81f8-b50683cfc473 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:34:17.152425 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:34:17.152425 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:34:17.152425 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:34:17.152425 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:34:17.152425 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:34:17.152425 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:34:17.152425 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:34:17.152425 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:34:17.152425 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:34:17.152425 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:34:17.152425 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:34:17.152425 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:34:17.152425 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:34:17.152425 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:34:17.152425 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:34:17.154291 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:34:17.154291 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:34:17.154291 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:34:17.154291 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:34:17.154291 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:34:17.154291 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:34:17.154291 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:34:17.154291 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:34:17.154291 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:34:17.154291 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:34:17.154291 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:34:17.154291 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:34:17.154291 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:34:17.154291 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:34:17.154291 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:34:17.154291 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:34:17.156137 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:34:17.156137 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:34:17.156137 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:34:17.156137 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:34:17.156137 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:34:17.156137 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:34:17.156137 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:34:17.156137 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:34:17.156137 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:34:17.156137 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:34:17.156137 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:34:17.156137 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:34:17.156137 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 65/127] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Sep 8 13:34:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:34:17.156137 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92da11-012d-47b4-81f8-b50683cfc473 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:17.242076 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d1bf8-4c58-4c53-8be4-7c39dbfd10ca None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:17.310767 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3218de-3b74-4eab-ab8f-6886d4fe5882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:17.312223 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3218de-3b74-4eab-ab8f-6886d4fe5882 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:17.312963 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3218de-3b74-4eab-ab8f-6886d4fe5882 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:17.313640 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3218de-3b74-4eab-ab8f-6886d4fe5882 None admin] PATH_INFO: `/v3/projects/8afaf32861dc4e62a9b32129a27c4900` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:17.315435 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3218de-3b74-4eab-ab8f-6886d4fe5882 None admin] RBAC: Authorizing `identity:get_project(project_id=8afaf32861dc4e62a9b32129a27c4900)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:17.317835 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3218de-3b74-4eab-ab8f-6886d4fe5882 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:17.320076 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 63/128] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:34:17 2022] GET /identity/v3/projects/8afaf32861dc4e62a9b32129a27c4900 => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:17.321286 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3218de-3b74-4eab-ab8f-6886d4fe5882 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:17.327198 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92da11-012d-47b4-81f8-b50683cfc473 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:17.372369 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe7121-6094-449e-8ed1-4dd354d15651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:17.373406 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe7121-6094-449e-8ed1-4dd354d15651 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:17.373833 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe7121-6094-449e-8ed1-4dd354d15651 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:17.374248 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe7121-6094-449e-8ed1-4dd354d15651 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:17.375157 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe7121-6094-449e-8ed1-4dd354d15651 None admin] RBAC: Adding query filter params (role.id=ab9b8996e13a46418c5b25949af994de, scope.project.id=8afaf32861dc4e62a9b32129a27c4900, user.id=559ac14a491d47048d4190b7d89fc4f7) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:17.375611 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe7121-6094-449e-8ed1-4dd354d15651 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:17.377335 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe7121-6094-449e-8ed1-4dd354d15651 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:17.384370 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 66/129] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 8 13:34:17 2022] GET /identity/v3/role_assignments?user.id=559ac14a491d47048d4190b7d89fc4f7&scope.project.id=8afaf32861dc4e62a9b32129a27c4900&role.id=ab9b8996e13a46418c5b25949af994de => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:17.389763 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe7121-6094-449e-8ed1-4dd354d15651 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:17.443416 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:17.495202 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:17.533665 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3218de-3b74-4eab-ab8f-6886d4fe5882 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:17.583918 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe7121-6094-449e-8ed1-4dd354d15651 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:17.586200 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e470a0b-025b-44f0-b47d-d4ec32fa3fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:17.587877 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e470a0b-025b-44f0-b47d-d4ec32fa3fa1 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:17.588195 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e470a0b-025b-44f0-b47d-d4ec32fa3fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:17.588474 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e470a0b-025b-44f0-b47d-d4ec32fa3fa1 None admin] PATH_INFO: `/v3/users/56f5aa59cf424559a6b65ae250308c09` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:17.589787 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e470a0b-025b-44f0-b47d-d4ec32fa3fa1 None admin] RBAC: Authorizing `identity:get_user(user_id=56f5aa59cf424559a6b65ae250308c09)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:17.591278 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e470a0b-025b-44f0-b47d-d4ec32fa3fa1 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:17.599240 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 64/130] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:34:17 2022] GET /identity/v3/users/56f5aa59cf424559a6b65ae250308c09 => generated 275 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:17.599240 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e470a0b-025b-44f0-b47d-d4ec32fa3fa1 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:17.684204 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af981285-5f13-417c-b497-26387cde3d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:17.685298 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af981285-5f13-417c-b497-26387cde3d81 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:17.685826 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af981285-5f13-417c-b497-26387cde3d81 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:17.686317 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af981285-5f13-417c-b497-26387cde3d81 None admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:17.687198 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af981285-5f13-417c-b497-26387cde3d81 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:17.687704 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af981285-5f13-417c-b497-26387cde3d81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:17.689330 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af981285-5f13-417c-b497-26387cde3d81 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:17.702538 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 67/131] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:34:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:17.703710 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af981285-5f13-417c-b497-26387cde3d81 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:17.785731 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e470a0b-025b-44f0-b47d-d4ec32fa3fa1 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:17.835117 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe50ff6-daf2-4a02-9c98-63a2e79249bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:17.836751 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe50ff6-daf2-4a02-9c98-63a2e79249bc None admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:17.837236 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe50ff6-daf2-4a02-9c98-63a2e79249bc None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:17.837771 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe50ff6-daf2-4a02-9c98-63a2e79249bc None admin] PATH_INFO: `/v3/projects/8afaf32861dc4e62a9b32129a27c4900/users/fe0feabca86e4c0ea888e85fba6302d2/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:17.839923 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe50ff6-daf2-4a02-9c98-63a2e79249bc None admin] RBAC: Authorizing `identity:create_grant(project_id=8afaf32861dc4e62a9b32129a27c4900, user_id=fe0feabca86e4c0ea888e85fba6302d2, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:17.841804 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe50ff6-daf2-4a02-9c98-63a2e79249bc None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:17.849879 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:17.866599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 65/132] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Sep 8 13:34:17 2022] PUT /identity/v3/projects/8afaf32861dc4e62a9b32129a27c4900/users/fe0feabca86e4c0ea888e85fba6302d2/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:34:17.868214 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe50ff6-daf2-4a02-9c98-63a2e79249bc None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:17.878880 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af981285-5f13-417c-b497-26387cde3d81 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:17.884711 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:17.939973 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f7723d-712f-4525-a22b-25f251eb49bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:17.940904 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7723d-712f-4525-a22b-25f251eb49bb None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:17.941331 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7723d-712f-4525-a22b-25f251eb49bb None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:17.941805 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7723d-712f-4525-a22b-25f251eb49bb None admin] PATH_INFO: `/v3/projects/82f4d2711ad2497f95f1217ff347aec6` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:17.943323 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f7723d-712f-4525-a22b-25f251eb49bb None admin] RBAC: Authorizing `identity:get_project(project_id=82f4d2711ad2497f95f1217ff347aec6)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:17.945717 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f7723d-712f-4525-a22b-25f251eb49bb None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:17.953229 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 68/133] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:34:17 2022] GET /identity/v3/projects/82f4d2711ad2497f95f1217ff347aec6 => generated 312 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:17.955277 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281501e9-1e0a-4e7c-9d06-08cbf406adfb None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:17.955782 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281501e9-1e0a-4e7c-9d06-08cbf406adfb None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:17.956210 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281501e9-1e0a-4e7c-9d06-08cbf406adfb None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:17.962773 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 69/134] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:17 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:34:17.963940 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281501e9-1e0a-4e7c-9d06-08cbf406adfb None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:18.023029 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe50ff6-daf2-4a02-9c98-63a2e79249bc None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:18.072391 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbd3ee0-6dad-4c17-8aa8-7830bdc40f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:18.073841 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd3ee0-6dad-4c17-8aa8-7830bdc40f74 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:18.074485 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd3ee0-6dad-4c17-8aa8-7830bdc40f74 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:18.075117 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd3ee0-6dad-4c17-8aa8-7830bdc40f74 None admin] PATH_INFO: `/v3/users/56f5aa59cf424559a6b65ae250308c09` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:18.078135 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbd3ee0-6dad-4c17-8aa8-7830bdc40f74 None admin] RBAC: Authorizing `identity:get_user(user_id=56f5aa59cf424559a6b65ae250308c09)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:18.085237 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbd3ee0-6dad-4c17-8aa8-7830bdc40f74 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:18.085237 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 66/135] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:34:17 2022] GET /identity/v3/users/56f5aa59cf424559a6b65ae250308c09 => generated 275 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:18.089452 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbe7db-e259-4296-b176-97649bd36c1d None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:18.089452 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbe7db-e259-4296-b176-97649bd36c1d None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:18.089452 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbe7db-e259-4296-b176-97649bd36c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:18.123924 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-fdbbe7db-e259-4296-b176-97649bd36c1d None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:18.125713 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-fdbbe7db-e259-4296-b176-97649bd36c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:18.227331 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 67/136] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:34:18.227959 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbbe7db-e259-4296-b176-97649bd36c1d None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:18.254910 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:18.265911 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281501e9-1e0a-4e7c-9d06-08cbf406adfb None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:18.358360 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615242c7-cb44-49b8-bdd9-b68faec431f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:18.358943 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615242c7-cb44-49b8-bdd9-b68faec431f6 None admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:18.359231 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615242c7-cb44-49b8-bdd9-b68faec431f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:18.359526 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615242c7-cb44-49b8-bdd9-b68faec431f6 None admin] PATH_INFO: `/v3/projects/82f4d2711ad2497f95f1217ff347aec6/users/56f5aa59cf424559a6b65ae250308c09/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:18.366716 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615242c7-cb44-49b8-bdd9-b68faec431f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=82f4d2711ad2497f95f1217ff347aec6, user_id=56f5aa59cf424559a6b65ae250308c09, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:18.372710 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615242c7-cb44-49b8-bdd9-b68faec431f6 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:18.408628 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 70/137] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Sep 8 13:34:17 2022] PUT /identity/v3/projects/82f4d2711ad2497f95f1217ff347aec6/users/56f5aa59cf424559a6b65ae250308c09/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:34:18.462485 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbbe7db-e259-4296-b176-97649bd36c1d None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:18.517871 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7493a4-d7e7-407e-9555-ffa6a3934c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:18.518902 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7493a4-d7e7-407e-9555-ffa6a3934c8c None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:18.519417 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7493a4-d7e7-407e-9555-ffa6a3934c8c None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:18.519843 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7493a4-d7e7-407e-9555-ffa6a3934c8c None admin] PATH_INFO: `/v3/projects/8afaf32861dc4e62a9b32129a27c4900` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:18.521762 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7493a4-d7e7-407e-9555-ffa6a3934c8c None admin] RBAC: Authorizing `identity:get_project(project_id=8afaf32861dc4e62a9b32129a27c4900)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:18.523977 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7493a4-d7e7-407e-9555-ffa6a3934c8c None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:18.526449 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 68/138] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:34:18 2022] GET /identity/v3/projects/8afaf32861dc4e62a9b32129a27c4900 => generated 298 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:18.532079 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615242c7-cb44-49b8-bdd9-b68faec431f6 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:18.547197 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:18.678323 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615242c7-cb44-49b8-bdd9-b68faec431f6 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:18.727902 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53e63c-041c-4967-b123-c34ca4a7bec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:18.728937 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53e63c-041c-4967-b123-c34ca4a7bec9 None admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:18.729464 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53e63c-041c-4967-b123-c34ca4a7bec9 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:18.729966 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53e63c-041c-4967-b123-c34ca4a7bec9 None admin] PATH_INFO: `/v3/projects/8afaf32861dc4e62a9b32129a27c4900/users/56f5aa59cf424559a6b65ae250308c09/roles/a0b9865e737f48f2975da1bb8cb386b7` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:18.733573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53e63c-041c-4967-b123-c34ca4a7bec9 None admin] RBAC: Authorizing `identity:create_grant(project_id=8afaf32861dc4e62a9b32129a27c4900, user_id=56f5aa59cf424559a6b65ae250308c09, role_id=a0b9865e737f48f2975da1bb8cb386b7)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:18.735473 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53e63c-041c-4967-b123-c34ca4a7bec9 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:18.764206 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 71/139] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Sep 8 13:34:18 2022] PUT /identity/v3/projects/8afaf32861dc4e62a9b32129a27c4900/users/56f5aa59cf424559a6b65ae250308c09/roles/a0b9865e737f48f2975da1bb8cb386b7 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:34:18.767418 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7493a4-d7e7-407e-9555-ffa6a3934c8c None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:18.863547 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:18.895735 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7493a4-d7e7-407e-9555-ffa6a3934c8c None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:18.935546 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097047c7-e2b9-4f54-9a40-c8669c859e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:18.936511 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097047c7-e2b9-4f54-9a40-c8669c859e44 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:18.937046 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097047c7-e2b9-4f54-9a40-c8669c859e44 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:18.937534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097047c7-e2b9-4f54-9a40-c8669c859e44 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:18.938886 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097047c7-e2b9-4f54-9a40-c8669c859e44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:18.940666 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097047c7-e2b9-4f54-9a40-c8669c859e44 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:18.942796 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 69/140] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:34:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:18.949738 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53e63c-041c-4967-b123-c34ca4a7bec9 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:19.075074 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:19.120403 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53e63c-041c-4967-b123-c34ca4a7bec9 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:19.170643 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77369f-7473-464d-bc6c-c9e0c18a4ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:19.171259 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77369f-7473-464d-bc6c-c9e0c18a4ba1 None admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:19.171570 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77369f-7473-464d-bc6c-c9e0c18a4ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:19.171846 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77369f-7473-464d-bc6c-c9e0c18a4ba1 None admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:19.172508 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c77369f-7473-464d-bc6c-c9e0c18a4ba1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:19.174026 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c77369f-7473-464d-bc6c-c9e0c18a4ba1 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:19.206504 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 72/141] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Sep 8 13:34:18 2022] POST /identity/v3/users => generated 283 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:34:20.172020 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd3dd4-44a6-4c87-84f3-4ccacd717b5b None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:20.173027 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd3dd4-44a6-4c87-84f3-4ccacd717b5b None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:20.173531 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd3dd4-44a6-4c87-84f3-4ccacd717b5b None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:20.175589 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 70/142] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:34:20.185186 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154039d5-be0e-4207-a6eb-ed1c3b0478f3 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:20.185769 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154039d5-be0e-4207-a6eb-ed1c3b0478f3 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:20.185890 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154039d5-be0e-4207-a6eb-ed1c3b0478f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:20.214505 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-154039d5-be0e-4207-a6eb-ed1c3b0478f3 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:20.215864 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-154039d5-be0e-4207-a6eb-ed1c3b0478f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:20.323022 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 73/143] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:34:20.967674 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd3dd4-44a6-4c87-84f3-4ccacd717b5b None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:21.091744 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c0e0b-495c-4a9a-85b8-58704b1da993 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:21.092105 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c0e0b-495c-4a9a-85b8-58704b1da993 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:21.092319 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c0e0b-495c-4a9a-85b8-58704b1da993 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:21.093733 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 74/144] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:34:21.102005 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed13a7-9790-41e5-b163-97cea2060752 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:21.102286 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed13a7-9790-41e5-b163-97cea2060752 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:21.102547 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed13a7-9790-41e5-b163-97cea2060752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:21.130732 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd3dd4-44a6-4c87-84f3-4ccacd717b5b None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:21.130913 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-41ed13a7-9790-41e5-b163-97cea2060752 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:21.134434 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-41ed13a7-9790-41e5-b163-97cea2060752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:21.218492 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f778e252-2ecd-4b65-b81c-40366d2175e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:21.219914 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778e252-2ecd-4b65-b81c-40366d2175e7 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:21.220397 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778e252-2ecd-4b65-b81c-40366d2175e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:21.220879 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778e252-2ecd-4b65-b81c-40366d2175e7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:21.244033 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f778e252-2ecd-4b65-b81c-40366d2175e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:34:21.249344 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-f778e252-2ecd-4b65-b81c-40366d2175e7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:34:21.249344 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:34:21.249344 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:34:21.249344 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:34:21.249344 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:34:21.249344 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:34:21.249344 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:34:21.249344 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:34:21.249344 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:34:21.249344 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:34:21.249344 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:34:21.249344 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:34:21.249344 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:34:21.249344 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:34:21.249344 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:34:21.249344 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:34:21.250285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:34:21.250285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:34:21.250285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:34:21.250285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:34:21.250285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:34:21.250285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:34:21.250285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:34:21.250285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:34:21.250285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:34:21.250285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:34:21.250285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:34:21.250285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:34:21.250285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:34:21.250285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:34:21.250285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:34:21.250285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:34:21.251046 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:34:21.251046 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:34:21.251046 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:34:21.251046 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:34:21.251046 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:34:21.251046 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:34:21.251046 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:34:21.251046 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:34:21.251046 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:34:21.251046 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:34:21.251046 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:34:21.251046 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:34:21.258228 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 71/145] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:34:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:34:21.259515 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f778e252-2ecd-4b65-b81c-40366d2175e7 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:21.265730 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:21.267995 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:21.311779 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 75/146] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:34:21.431732 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f778e252-2ecd-4b65-b81c-40366d2175e7 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:21.478511 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c0d39-592b-47ae-90c1-09c8695f6b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:21.479056 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c0d39-592b-47ae-90c1-09c8695f6b81 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:21.479339 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c0d39-592b-47ae-90c1-09c8695f6b81 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:21.479618 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c0d39-592b-47ae-90c1-09c8695f6b81 None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:21.480308 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c0d39-592b-47ae-90c1-09c8695f6b81 None admin] RBAC: Adding query filter params (name=member) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:21.480625 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c0d39-592b-47ae-90c1-09c8695f6b81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:21.482047 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c0d39-592b-47ae-90c1-09c8695f6b81 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:21.496535 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 72/147] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 8 13:34:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:21.503517 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed13a7-9790-41e5-b163-97cea2060752 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:21.689201 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed13a7-9790-41e5-b163-97cea2060752 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:21.736979 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc46dc4-41d9-4ebf-83f7-4c7dfc2b40d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:21.737569 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc46dc4-41d9-4ebf-83f7-4c7dfc2b40d0 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:21.737847 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc46dc4-41d9-4ebf-83f7-4c7dfc2b40d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:21.738115 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc46dc4-41d9-4ebf-83f7-4c7dfc2b40d0 None admin] PATH_INFO: `/v3/users/56f5aa59cf424559a6b65ae250308c09` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:21.739280 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc46dc4-41d9-4ebf-83f7-4c7dfc2b40d0 None admin] RBAC: Authorizing `identity:get_user(user_id=56f5aa59cf424559a6b65ae250308c09)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:21.740731 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc46dc4-41d9-4ebf-83f7-4c7dfc2b40d0 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:21.743312 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 76/148] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:34:21 2022] GET /identity/v3/users/56f5aa59cf424559a6b65ae250308c09 => generated 275 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:21.749207 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c0d39-592b-47ae-90c1-09c8695f6b81 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:21.799921 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc46dc4-41d9-4ebf-83f7-4c7dfc2b40d0 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:21.894881 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:21.898432 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:22.002001 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc46dc4-41d9-4ebf-83f7-4c7dfc2b40d0 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:22.005810 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c0d39-592b-47ae-90c1-09c8695f6b81 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:22.079356 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0507edb6-0481-4191-9add-8d2495570ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:22.080009 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507edb6-0481-4191-9add-8d2495570ef9 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:22.080287 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507edb6-0481-4191-9add-8d2495570ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:22.080556 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507edb6-0481-4191-9add-8d2495570ef9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:22.110537 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0507edb6-0481-4191-9add-8d2495570ef9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:34:22.116007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-0507edb6-0481-4191-9add-8d2495570ef9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:34:22.116007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:34:22.116007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:34:22.116007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:34:22.116007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:34:22.116007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:34:22.116007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:34:22.116007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:34:22.116007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:34:22.116007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:34:22.116007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:34:22.116007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:34:22.116007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:34:22.116007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:34:22.116007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:34:22.116007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:34:22.116978 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:34:22.116978 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:34:22.116978 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:34:22.116978 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:34:22.116978 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:34:22.116978 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:34:22.116978 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:34:22.116978 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:34:22.116978 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:34:22.116978 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:34:22.116978 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:34:22.116978 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:34:22.116978 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:34:22.116978 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:34:22.116978 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:34:22.116978 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:34:22.117831 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:34:22.117831 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:34:22.117831 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:34:22.117831 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:34:22.117831 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:34:22.117831 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:34:22.117831 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:34:22.117831 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:34:22.117831 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:34:22.117831 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:34:22.117831 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:34:22.117831 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:34:22.117831 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 77/149] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:34:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:34:22.118502 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9345a3-ea3e-49a6-8eab-881af8e6bd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:22.119111 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9345a3-ea3e-49a6-8eab-881af8e6bd04 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:22.120520 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9345a3-ea3e-49a6-8eab-881af8e6bd04 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:22.120520 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9345a3-ea3e-49a6-8eab-881af8e6bd04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:22.126085 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0507edb6-0481-4191-9add-8d2495570ef9 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:22.358524 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9345a3-ea3e-49a6-8eab-881af8e6bd04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:22.359436 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0507edb6-0481-4191-9add-8d2495570ef9 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:22.360027 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9345a3-ea3e-49a6-8eab-881af8e6bd04 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:22.393884 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:22.478157 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d15b5c0-4701-4607-aeec-b52e803bc8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:22.478796 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15b5c0-4701-4607-aeec-b52e803bc8bb None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:22.479086 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15b5c0-4701-4607-aeec-b52e803bc8bb None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:22.479352 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15b5c0-4701-4607-aeec-b52e803bc8bb None admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:22.480035 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d15b5c0-4701-4607-aeec-b52e803bc8bb None admin] RBAC: Adding query filter params (name=reader) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:22.480339 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d15b5c0-4701-4607-aeec-b52e803bc8bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:22.481795 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d15b5c0-4701-4607-aeec-b52e803bc8bb None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:22.503697 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 78/150] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 8 13:34:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:34:22.504992 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33687f-4c11-4f3e-8e43-6e5f81c92ae8 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:22.505276 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33687f-4c11-4f3e-8e43-6e5f81c92ae8 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:22.505573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33687f-4c11-4f3e-8e43-6e5f81c92ae8 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:22.506804 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 79/151] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:34:22.513289 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa33687f-4c11-4f3e-8e43-6e5f81c92ae8 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:22.565717 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:22.678825 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 73/152] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:34:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 930 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:34:22.685617 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4456a0b-dd47-4076-86c3-6fb1d06868a9 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:22.685961 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4456a0b-dd47-4076-86c3-6fb1d06868a9 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:22.686200 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4456a0b-dd47-4076-86c3-6fb1d06868a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:22.722508 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-c4456a0b-dd47-4076-86c3-6fb1d06868a9 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:22.723982 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-c4456a0b-dd47-4076-86c3-6fb1d06868a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:22.759041 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa33687f-4c11-4f3e-8e43-6e5f81c92ae8 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:22.843540 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c797f3-467e-4ebc-88e6-286a6361c635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:22.844109 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c797f3-467e-4ebc-88e6-286a6361c635 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:22.844390 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c797f3-467e-4ebc-88e6-286a6361c635 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:22.844664 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c797f3-467e-4ebc-88e6-286a6361c635 None admin] PATH_INFO: `/v3/users/559ac14a491d47048d4190b7d89fc4f7` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:22.850257 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c797f3-467e-4ebc-88e6-286a6361c635 None admin] RBAC: Authorizing `identity:get_user(user_id=559ac14a491d47048d4190b7d89fc4f7)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:22.852314 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c797f3-467e-4ebc-88e6-286a6361c635 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:22.854038 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 80/153] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:34:22 2022] GET /identity/v3/users/559ac14a491d47048d4190b7d89fc4f7 => generated 289 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:34:22.854842 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c797f3-467e-4ebc-88e6-286a6361c635 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:22.912093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 74/154] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:34:22.913008 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4456a0b-dd47-4076-86c3-6fb1d06868a9 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:22.945987 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:23.049147 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c797f3-467e-4ebc-88e6-286a6361c635 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:23.135311 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b693d0ed-7ab3-494f-9d85-78428e53ec5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:23.135870 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693d0ed-7ab3-494f-9d85-78428e53ec5c None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:23.136149 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693d0ed-7ab3-494f-9d85-78428e53ec5c None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:23.136415 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693d0ed-7ab3-494f-9d85-78428e53ec5c None admin] PATH_INFO: `/v3/projects/8afaf32861dc4e62a9b32129a27c4900` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:23.142324 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b693d0ed-7ab3-494f-9d85-78428e53ec5c None admin] RBAC: Authorizing `identity:get_project(project_id=8afaf32861dc4e62a9b32129a27c4900)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:23.144215 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b693d0ed-7ab3-494f-9d85-78428e53ec5c None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:23.146197 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 81/155] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:34:22 2022] GET /identity/v3/projects/8afaf32861dc4e62a9b32129a27c4900 => generated 298 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:23.147503 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e911a92-1de1-451b-a6cb-e6142c59ac37 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:23.147812 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e911a92-1de1-451b-a6cb-e6142c59ac37 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:23.148692 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e911a92-1de1-451b-a6cb-e6142c59ac37 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:23.150360 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 82/156] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:34:23.155646 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779305f-f0e1-4499-bcf1-891005f02b6f None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:23.156044 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779305f-f0e1-4499-bcf1-891005f02b6f None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:23.156365 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779305f-f0e1-4499-bcf1-891005f02b6f None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:23.158161 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 83/157] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:34:23.159213 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37484615-8d64-4480-9e46-fac9182faf5f None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:23.160039 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37484615-8d64-4480-9e46-fac9182faf5f None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:23.160146 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:23.160237 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37484615-8d64-4480-9e46-fac9182faf5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:23.184819 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4456a0b-dd47-4076-86c3-6fb1d06868a9 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:23.206757 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-37484615-8d64-4480-9e46-fac9182faf5f None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:23.207966 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-37484615-8d64-4480-9e46-fac9182faf5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:23.332999 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db017022-4687-4d59-9d87-5cfa6fc13096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:23.334119 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db017022-4687-4d59-9d87-5cfa6fc13096 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:23.334616 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db017022-4687-4d59-9d87-5cfa6fc13096 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:23.335128 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db017022-4687-4d59-9d87-5cfa6fc13096 None admin] PATH_INFO: `/v3/projects/8afaf32861dc4e62a9b32129a27c4900` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:23.339564 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db017022-4687-4d59-9d87-5cfa6fc13096 None admin] RBAC: Authorizing `identity:get_project(project_id=8afaf32861dc4e62a9b32129a27c4900)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:23.342369 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db017022-4687-4d59-9d87-5cfa6fc13096 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:23.345644 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 75/158] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:34:22 2022] GET /identity/v3/projects/8afaf32861dc4e62a9b32129a27c4900 => generated 298 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:23.347098 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db017022-4687-4d59-9d87-5cfa6fc13096 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:23.389414 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 84/159] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:34:23.391615 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca3dad-cebd-4396-9265-a874220772b7 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:23.392129 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca3dad-cebd-4396-9265-a874220772b7 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:23.392622 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca3dad-cebd-4396-9265-a874220772b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:23.468634 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-e7ca3dad-cebd-4396-9265-a874220772b7 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:23.470758 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-e7ca3dad-cebd-4396-9265-a874220772b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:23.632353 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:23.716874 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db017022-4687-4d59-9d87-5cfa6fc13096 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:23.763942 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 85/160] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:34:23.765489 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ca3dad-cebd-4396-9265-a874220772b7 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:23.780471 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22d67b-9c6e-4dfc-bef7-df45a52375ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:23.781434 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22d67b-9c6e-4dfc-bef7-df45a52375ca None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:23.781914 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22d67b-9c6e-4dfc-bef7-df45a52375ca None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:23.782380 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22d67b-9c6e-4dfc-bef7-df45a52375ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:23.783304 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b22d67b-9c6e-4dfc-bef7-df45a52375ca None admin] RBAC: Adding query filter params (role.id=0735c260e70441cc87ad611b789d5c56, scope.project.id=8afaf32861dc4e62a9b32129a27c4900, user.id=56f5aa59cf424559a6b65ae250308c09) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:23.783810 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b22d67b-9c6e-4dfc-bef7-df45a52375ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:23.785750 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b22d67b-9c6e-4dfc-bef7-df45a52375ca None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:23.793118 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 76/161] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 8 13:34:23 2022] GET /identity/v3/role_assignments?user.id=56f5aa59cf424559a6b65ae250308c09&scope.project.id=8afaf32861dc4e62a9b32129a27c4900&role.id=0735c260e70441cc87ad611b789d5c56 => generated 608 bytes in 447 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:23.798523 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22d67b-9c6e-4dfc-bef7-df45a52375ca None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:23.879477 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:24.042359 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22d67b-9c6e-4dfc-bef7-df45a52375ca None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:24.100691 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ca3dad-cebd-4396-9265-a874220772b7 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:24.123325 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a484a45-637f-486e-96ba-0ea8521e3125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:24.125256 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a484a45-637f-486e-96ba-0ea8521e3125 None admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:24.125791 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a484a45-637f-486e-96ba-0ea8521e3125 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:24.126287 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a484a45-637f-486e-96ba-0ea8521e3125 None admin] PATH_INFO: `/v3/projects/8afaf32861dc4e62a9b32129a27c4900/users/559ac14a491d47048d4190b7d89fc4f7/roles/ab9b8996e13a46418c5b25949af994de` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:24.135941 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a484a45-637f-486e-96ba-0ea8521e3125 None admin] RBAC: Authorizing `identity:create_grant(project_id=8afaf32861dc4e62a9b32129a27c4900, user_id=559ac14a491d47048d4190b7d89fc4f7, role_id=ab9b8996e13a46418c5b25949af994de)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:24.138929 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a484a45-637f-486e-96ba-0ea8521e3125 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:24.175668 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 77/162] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Sep 8 13:34:23 2022] PUT /identity/v3/projects/8afaf32861dc4e62a9b32129a27c4900/users/559ac14a491d47048d4190b7d89fc4f7/roles/ab9b8996e13a46418c5b25949af994de => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:34:24.176603 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a484a45-637f-486e-96ba-0ea8521e3125 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:24.205620 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a8361-8df3-4c2e-b470-ab9eadc9b666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:24.206731 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a8361-8df3-4c2e-b470-ab9eadc9b666 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:24.207185 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a8361-8df3-4c2e-b470-ab9eadc9b666 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:24.207621 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a8361-8df3-4c2e-b470-ab9eadc9b666 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:24.255048 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a8361-8df3-4c2e-b470-ab9eadc9b666 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:34:24.261025 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-906a8361-8df3-4c2e-b470-ab9eadc9b666 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:34:24.261025 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:34:24.261025 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:34:24.261025 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:34:24.261025 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:34:24.261025 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:34:24.261025 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:34:24.261025 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:34:24.261025 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:34:24.261025 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:34:24.261025 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:34:24.261025 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:34:24.261025 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:34:24.261025 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:34:24.261025 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:34:24.261025 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:34:24.261981 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:34:24.261981 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:34:24.261981 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:34:24.261981 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:34:24.261981 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:34:24.261981 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:34:24.261981 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:34:24.261981 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:34:24.261981 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:34:24.261981 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:34:24.261981 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:34:24.261981 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:34:24.261981 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:34:24.261981 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:34:24.261981 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:34:24.261981 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:34:24.262847 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:34:24.262847 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:34:24.262847 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:34:24.262847 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:34:24.262847 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:34:24.262847 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:34:24.262847 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:34:24.262847 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:34:24.262847 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:34:24.262847 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:34:24.262847 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:34:24.262847 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:34:24.262847 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 86/163] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 8 13:34:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 498 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:34:24.272504 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a8361-8df3-4c2e-b470-ab9eadc9b666 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:24.340398 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:24.418539 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:24.461097 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a484a45-637f-486e-96ba-0ea8521e3125 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:24.487574 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a8361-8df3-4c2e-b470-ab9eadc9b666 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:24.558659 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ffe86-993a-4240-be94-e5a3767bb6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:24.559899 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ffe86-993a-4240-be94-e5a3767bb6b9 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:24.560791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ffe86-993a-4240-be94-e5a3767bb6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:24.561262 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ffe86-993a-4240-be94-e5a3767bb6b9 None admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:24.562316 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ffe86-993a-4240-be94-e5a3767bb6b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:24.562975 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ffe86-993a-4240-be94-e5a3767bb6b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:24.564611 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ffe86-993a-4240-be94-e5a3767bb6b9 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:24.580024 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 87/164] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:34:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:24.581947 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d338f-c035-4296-b61b-222ea6775f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:24.582754 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d338f-c035-4296-b61b-222ea6775f0b None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:24.583093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d338f-c035-4296-b61b-222ea6775f0b None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:24.583372 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d338f-c035-4296-b61b-222ea6775f0b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:24.586401 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ffe86-993a-4240-be94-e5a3767bb6b9 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:24.611136 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d338f-c035-4296-b61b-222ea6775f0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:34:24.618469 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-5b3d338f-c035-4296-b61b-222ea6775f0b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:34:24.618469 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:34:24.618469 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:34:24.618469 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:34:24.618469 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:34:24.618469 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:34:24.618469 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:34:24.618469 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:34:24.618469 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:34:24.618469 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:34:24.618469 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:34:24.618469 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:34:24.618469 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:34:24.618469 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:34:24.618469 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:34:24.618469 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:34:24.619417 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:34:24.619417 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:34:24.619417 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:34:24.619417 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:34:24.619417 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:34:24.619417 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:34:24.619417 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:34:24.619417 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:34:24.619417 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:34:24.619417 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:34:24.619417 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:34:24.619417 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:34:24.619417 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:34:24.619417 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:34:24.619417 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:34:24.619417 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:34:24.620220 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:34:24.620220 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:34:24.620220 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:34:24.620220 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:34:24.620220 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:34:24.620220 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:34:24.620220 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:34:24.620220 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:34:24.620220 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:34:24.620220 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:34:24.620220 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:34:24.620220 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:34:24.620220 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 78/165] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Sep 8 13:34:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 443 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:34:24.626873 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ad05f-5b52-4709-809a-9ac3b0fa328c None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:24.626873 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ad05f-5b52-4709-809a-9ac3b0fa328c None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:24.626873 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ad05f-5b52-4709-809a-9ac3b0fa328c None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:24.627969 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 79/166] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:34:24.628761 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ad05f-5b52-4709-809a-9ac3b0fa328c None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:24.755879 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:24.767102 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ffe86-993a-4240-be94-e5a3767bb6b9 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:24.812506 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ad05f-5b52-4709-809a-9ac3b0fa328c None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:24.813019 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c214aa9-c288-44d8-ae00-69da74c1d101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:24.813732 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c214aa9-c288-44d8-ae00-69da74c1d101 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:24.814083 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c214aa9-c288-44d8-ae00-69da74c1d101 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:24.814431 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c214aa9-c288-44d8-ae00-69da74c1d101 None admin] PATH_INFO: `/v3/users/fe0feabca86e4c0ea888e85fba6302d2` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:24.815897 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c214aa9-c288-44d8-ae00-69da74c1d101 None admin] RBAC: Authorizing `identity:get_user(user_id=fe0feabca86e4c0ea888e85fba6302d2)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:24.823326 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c214aa9-c288-44d8-ae00-69da74c1d101 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:24.825448 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 88/167] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:34:24 2022] GET /identity/v3/users/fe0feabca86e4c0ea888e85fba6302d2 => generated 247 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:34:24.827541 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88ff21-b0e5-465b-b3bb-b78ce8145b06 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:24.827930 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88ff21-b0e5-465b-b3bb-b78ce8145b06 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:24.828665 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88ff21-b0e5-465b-b3bb-b78ce8145b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:24.855273 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-ac88ff21-b0e5-465b-b3bb-b78ce8145b06 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:24.857303 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-ac88ff21-b0e5-465b-b3bb-b78ce8145b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:24.864507 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e56598-e288-4e56-b69b-23281e595c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:24.865477 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e56598-e288-4e56-b69b-23281e595c07 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:24.865942 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e56598-e288-4e56-b69b-23281e595c07 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:24.866396 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e56598-e288-4e56-b69b-23281e595c07 None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:24.867847 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e56598-e288-4e56-b69b-23281e595c07 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:24.868391 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e56598-e288-4e56-b69b-23281e595c07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:24.870697 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e56598-e288-4e56-b69b-23281e595c07 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:24.884397 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 80/168] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:34:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:24.886235 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e56598-e288-4e56-b69b-23281e595c07 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:24.909077 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:24.986448 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 89/169] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:34:24.987670 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88ff21-b0e5-465b-b3bb-b78ce8145b06 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:25.063195 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e56598-e288-4e56-b69b-23281e595c07 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:25.111376 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b91b3-fa9b-400d-9510-11d2b5ab5062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:25.112012 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:25.112681 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b91b3-fa9b-400d-9510-11d2b5ab5062 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:25.113171 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b91b3-fa9b-400d-9510-11d2b5ab5062 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:25.113811 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b91b3-fa9b-400d-9510-11d2b5ab5062 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:25.128087 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b91b3-fa9b-400d-9510-11d2b5ab5062 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:34:25.130331 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88ff21-b0e5-465b-b3bb-b78ce8145b06 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:25.134038 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-719b91b3-fa9b-400d-9510-11d2b5ab5062 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:34:25.134038 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:34:25.134038 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:34:25.134038 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:34:25.134038 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:34:25.134038 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:34:25.134038 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:34:25.134038 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:34:25.134038 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:34:25.134038 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:34:25.134038 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:34:25.134038 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:34:25.134038 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:34:25.134038 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:34:25.134038 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:34:25.134038 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:34:25.134966 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:34:25.134966 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:34:25.134966 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:34:25.134966 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:34:25.134966 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:34:25.134966 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:34:25.134966 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:34:25.134966 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:34:25.134966 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:34:25.134966 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:34:25.134966 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:34:25.134966 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:34:25.134966 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:34:25.134966 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:34:25.134966 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:34:25.134966 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:34:25.135779 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:34:25.135779 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:34:25.135779 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:34:25.135779 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:34:25.135779 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:34:25.135779 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:34:25.135779 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:34:25.135779 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:34:25.135779 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:34:25.135779 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:34:25.135779 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:34:25.135779 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:34:25.138190 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 81/170] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:34:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:34:25.139293 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b91b3-fa9b-400d-9510-11d2b5ab5062 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:25.176014 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603fc2a6-34e5-438b-8b58-35dff356258e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:25.176813 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fc2a6-34e5-438b-8b58-35dff356258e None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:25.177134 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fc2a6-34e5-438b-8b58-35dff356258e None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:25.177425 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fc2a6-34e5-438b-8b58-35dff356258e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:25.222478 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:25.264418 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b91b3-fa9b-400d-9510-11d2b5ab5062 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:25.268512 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603fc2a6-34e5-438b-8b58-35dff356258e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:25.272362 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603fc2a6-34e5-438b-8b58-35dff356258e None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:25.319037 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5353b861-a0dc-47f3-9cca-4c1e123ec9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:25.321260 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353b861-a0dc-47f3-9cca-4c1e123ec9dc None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:25.321815 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353b861-a0dc-47f3-9cca-4c1e123ec9dc None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:25.322158 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353b861-a0dc-47f3-9cca-4c1e123ec9dc None admin] PATH_INFO: `/v3/users/56f5aa59cf424559a6b65ae250308c09` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:25.323530 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5353b861-a0dc-47f3-9cca-4c1e123ec9dc None admin] RBAC: Authorizing `identity:get_user(user_id=56f5aa59cf424559a6b65ae250308c09)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:25.325148 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5353b861-a0dc-47f3-9cca-4c1e123ec9dc None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:25.332837 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 82/171] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:34:25 2022] GET /identity/v3/users/56f5aa59cf424559a6b65ae250308c09 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:25.332837 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a2ea0-ec9b-4a87-ab50-f60ea1a9fa99 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:25.332837 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a2ea0-ec9b-4a87-ab50-f60ea1a9fa99 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:25.332837 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a2ea0-ec9b-4a87-ab50-f60ea1a9fa99 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:25.337445 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 83/172] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:34:25.339823 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe5bd3-c78e-4e55-9125-1ba36d0a4b8a None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:25.340103 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe5bd3-c78e-4e55-9125-1ba36d0a4b8a None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:25.340379 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe5bd3-c78e-4e55-9125-1ba36d0a4b8a None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:25.342054 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 84/173] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:34:25.342445 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe5bd3-c78e-4e55-9125-1ba36d0a4b8a None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:25.410650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:25.423987 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 90/174] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:34:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:34:25.430037 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603fc2a6-34e5-438b-8b58-35dff356258e None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:25.477129 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe5bd3-c78e-4e55-9125-1ba36d0a4b8a None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:25.525941 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba432de-d8e4-45c6-8f4a-e2952b530dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:25.526941 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba432de-d8e4-45c6-8f4a-e2952b530dd9 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:25.527378 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba432de-d8e4-45c6-8f4a-e2952b530dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:25.527813 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba432de-d8e4-45c6-8f4a-e2952b530dd9 None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:25.529471 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba432de-d8e4-45c6-8f4a-e2952b530dd9 None admin] RBAC: Adding query filter params (name=member) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:25.529868 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba432de-d8e4-45c6-8f4a-e2952b530dd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:25.532241 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba432de-d8e4-45c6-8f4a-e2952b530dd9 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:25.541270 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:25.547831 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 85/175] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 8 13:34:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:25.550254 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d95db5-3dff-4f84-9ad5-3889b575bfc8 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:25.550845 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d95db5-3dff-4f84-9ad5-3889b575bfc8 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:25.551161 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d95db5-3dff-4f84-9ad5-3889b575bfc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:25.558502 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603fc2a6-34e5-438b-8b58-35dff356258e None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:25.575894 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-b0d95db5-3dff-4f84-9ad5-3889b575bfc8 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:25.577067 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-b0d95db5-3dff-4f84-9ad5-3889b575bfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:25.601262 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9699d8cc-c623-4f85-a2c4-5515a0c39ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:25.602079 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699d8cc-c623-4f85-a2c4-5515a0c39ea2 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:25.602431 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699d8cc-c623-4f85-a2c4-5515a0c39ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:25.602712 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699d8cc-c623-4f85-a2c4-5515a0c39ea2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:25.679992 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 86/176] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:34:25.679992 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e463846e-8f84-4940-a414-89583d877095 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:25.679992 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e463846e-8f84-4940-a414-89583d877095 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:25.679992 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e463846e-8f84-4940-a414-89583d877095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:25.697466 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:25.712491 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-e463846e-8f84-4940-a414-89583d877095 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:25.714484 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-e463846e-8f84-4940-a414-89583d877095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:25.719655 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9699d8cc-c623-4f85-a2c4-5515a0c39ea2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:25.722718 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9699d8cc-c623-4f85-a2c4-5515a0c39ea2 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:25.833884 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 87/177] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:34:25.836566 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e463846e-8f84-4940-a414-89583d877095 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:25.847794 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 91/178] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:34:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:34:25.848944 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9699d8cc-c623-4f85-a2c4-5515a0c39ea2 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:25.975915 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:26.036351 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:26.059690 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e463846e-8f84-4940-a414-89583d877095 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:26.079378 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9699d8cc-c623-4f85-a2c4-5515a0c39ea2 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:26.118684 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a23761-86d7-474a-aeb8-17e09a215d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:26.119333 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a23761-86d7-474a-aeb8-17e09a215d14 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:26.119612 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a23761-86d7-474a-aeb8-17e09a215d14 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:26.119892 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a23761-86d7-474a-aeb8-17e09a215d14 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:26.141518 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a23761-86d7-474a-aeb8-17e09a215d14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:34:26.147418 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-d5a23761-86d7-474a-aeb8-17e09a215d14 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:34:26.147418 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:34:26.147418 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:34:26.147418 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:34:26.147418 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:34:26.147418 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:34:26.147418 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:34:26.147418 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:34:26.147418 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:34:26.147418 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:34:26.147418 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:34:26.147418 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:34:26.147418 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:34:26.147418 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:34:26.147418 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:34:26.147418 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:34:26.149670 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:34:26.149670 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:34:26.149670 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:34:26.149670 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:34:26.149670 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:34:26.149670 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:34:26.149670 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:34:26.149670 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:34:26.149670 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:34:26.149670 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:34:26.149670 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:34:26.149670 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:34:26.149670 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:34:26.149670 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:34:26.149670 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:34:26.149670 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:34:26.151170 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:34:26.151170 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:34:26.151170 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:34:26.151170 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:34:26.151170 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:34:26.151170 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:34:26.151170 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:34:26.151170 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:34:26.151170 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:34:26.151170 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:34:26.151170 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:34:26.151170 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:34:26.151170 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 88/179] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 8 13:34:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:34:26.151170 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a23761-86d7-474a-aeb8-17e09a215d14 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:26.183272 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de6713-6072-43ab-ba0e-363865907d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:26.184861 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de6713-6072-43ab-ba0e-363865907d65 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:26.185152 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de6713-6072-43ab-ba0e-363865907d65 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:26.185437 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de6713-6072-43ab-ba0e-363865907d65 None admin] PATH_INFO: `/v3/projects/8afaf32861dc4e62a9b32129a27c4900` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:26.186748 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35de6713-6072-43ab-ba0e-363865907d65 None admin] RBAC: Authorizing `identity:get_project(project_id=8afaf32861dc4e62a9b32129a27c4900)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:26.188234 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35de6713-6072-43ab-ba0e-363865907d65 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:26.189992 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 92/180] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:34:25 2022] GET /identity/v3/projects/8afaf32861dc4e62a9b32129a27c4900 => generated 298 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:26.190765 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de6713-6072-43ab-ba0e-363865907d65 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:26.290071 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a23761-86d7-474a-aeb8-17e09a215d14 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:26.317230 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:26.317902 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de6713-6072-43ab-ba0e-363865907d65 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:26.334674 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec43e20-a40b-4b47-8083-6492110daee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:26.335834 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec43e20-a40b-4b47-8083-6492110daee7 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:26.336693 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec43e20-a40b-4b47-8083-6492110daee7 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:26.337200 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec43e20-a40b-4b47-8083-6492110daee7 None admin] PATH_INFO: `/v3/users/56f5aa59cf424559a6b65ae250308c09` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:26.338555 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec43e20-a40b-4b47-8083-6492110daee7 None admin] RBAC: Authorizing `identity:get_user(user_id=56f5aa59cf424559a6b65ae250308c09)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:26.340153 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec43e20-a40b-4b47-8083-6492110daee7 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:26.341914 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 89/181] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:34:26 2022] GET /identity/v3/users/56f5aa59cf424559a6b65ae250308c09 => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:26.342884 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec43e20-a40b-4b47-8083-6492110daee7 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:26.361912 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8744b3-ed4e-4baf-bd70-e38598fd70dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:26.362907 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8744b3-ed4e-4baf-bd70-e38598fd70dc None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:26.363391 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8744b3-ed4e-4baf-bd70-e38598fd70dc None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:26.363919 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8744b3-ed4e-4baf-bd70-e38598fd70dc None admin] PATH_INFO: `/v3/projects/8afaf32861dc4e62a9b32129a27c4900` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:26.365523 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8744b3-ed4e-4baf-bd70-e38598fd70dc None admin] RBAC: Authorizing `identity:get_project(project_id=8afaf32861dc4e62a9b32129a27c4900)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:26.368262 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8744b3-ed4e-4baf-bd70-e38598fd70dc None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:26.369985 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 93/182] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:34:26 2022] GET /identity/v3/projects/8afaf32861dc4e62a9b32129a27c4900 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:26.370786 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8744b3-ed4e-4baf-bd70-e38598fd70dc None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:26.404234 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:26.465675 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec43e20-a40b-4b47-8083-6492110daee7 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:26.494818 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8744b3-ed4e-4baf-bd70-e38598fd70dc None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:26.506718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f068a-4ef3-4e6a-bf74-c747bd29648c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:26.507471 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f068a-4ef3-4e6a-bf74-c747bd29648c None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:26.507904 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f068a-4ef3-4e6a-bf74-c747bd29648c None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:26.508463 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f068a-4ef3-4e6a-bf74-c747bd29648c None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:26.508858 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f068a-4ef3-4e6a-bf74-c747bd29648c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:26.509140 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f068a-4ef3-4e6a-bf74-c747bd29648c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:26.510568 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f068a-4ef3-4e6a-bf74-c747bd29648c None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:26.520488 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 90/183] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:34:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:26.526655 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f068a-4ef3-4e6a-bf74-c747bd29648c None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:26.537121 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b1408-b121-47da-8445-f379bc0f29da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:26.537989 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b1408-b121-47da-8445-f379bc0f29da None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:26.538438 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b1408-b121-47da-8445-f379bc0f29da None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:26.539707 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b1408-b121-47da-8445-f379bc0f29da None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:26.551919 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b1408-b121-47da-8445-f379bc0f29da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:34:26.558997 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-b25b1408-b121-47da-8445-f379bc0f29da None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:34:26.558997 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:34:26.558997 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:34:26.558997 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:34:26.558997 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:34:26.558997 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:34:26.558997 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:34:26.558997 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:34:26.558997 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:34:26.558997 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:34:26.558997 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:34:26.558997 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:34:26.558997 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:34:26.558997 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:34:26.558997 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:34:26.558997 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:34:26.560368 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:34:26.560368 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:34:26.560368 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:34:26.560368 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:34:26.560368 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:34:26.560368 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:34:26.560368 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:34:26.560368 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:34:26.560368 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:34:26.560368 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:34:26.560368 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:34:26.560368 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:34:26.560368 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:34:26.560368 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:34:26.560368 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:34:26.560368 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:34:26.561160 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:34:26.561160 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:34:26.561160 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:34:26.561160 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:34:26.561160 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:34:26.561160 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:34:26.561160 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:34:26.561160 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:34:26.561160 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:34:26.561160 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:34:26.561160 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:34:26.561160 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:34:26.567688 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 94/184] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Sep 8 13:34:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:34:26.567688 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b1408-b121-47da-8445-f379bc0f29da None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:26.585074 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:26.658057 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f068a-4ef3-4e6a-bf74-c747bd29648c None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:26.670149 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:26.686532 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b1408-b121-47da-8445-f379bc0f29da None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:26.698172 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d3721-f76b-4dd4-bf3a-6f8d88495e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:26.698784 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d3721-f76b-4dd4-bf3a-6f8d88495e88 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:26.699064 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d3721-f76b-4dd4-bf3a-6f8d88495e88 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:26.699339 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d3721-f76b-4dd4-bf3a-6f8d88495e88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:26.700071 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37d3721-f76b-4dd4-bf3a-6f8d88495e88 None admin] RBAC: Adding query filter params (role.id=9c76f398c9e04caeab83842e70eb824b, scope.project.id=8afaf32861dc4e62a9b32129a27c4900, user.id=fe0feabca86e4c0ea888e85fba6302d2) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:26.700379 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37d3721-f76b-4dd4-bf3a-6f8d88495e88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:26.701894 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37d3721-f76b-4dd4-bf3a-6f8d88495e88 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:26.709591 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 91/185] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 8 13:34:26 2022] GET /identity/v3/role_assignments?user.id=fe0feabca86e4c0ea888e85fba6302d2&scope.project.id=8afaf32861dc4e62a9b32129a27c4900&role.id=9c76f398c9e04caeab83842e70eb824b => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:26.719183 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d3721-f76b-4dd4-bf3a-6f8d88495e88 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:26.728014 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad3e1a-5648-4526-aa09-24da9a3b5776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:26.729010 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad3e1a-5648-4526-aa09-24da9a3b5776 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:26.729494 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad3e1a-5648-4526-aa09-24da9a3b5776 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:26.729930 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad3e1a-5648-4526-aa09-24da9a3b5776 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:26.817549 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad3e1a-5648-4526-aa09-24da9a3b5776 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:26.819131 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad3e1a-5648-4526-aa09-24da9a3b5776 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:26.865237 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d3721-f76b-4dd4-bf3a-6f8d88495e88 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:26.884760 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:26.910846 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5dd5c-f6d4-489f-8f25-63331acb3e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:26.912571 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5dd5c-f6d4-489f-8f25-63331acb3e4e None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:26.912951 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5dd5c-f6d4-489f-8f25-63331acb3e4e None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:26.913343 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5dd5c-f6d4-489f-8f25-63331acb3e4e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:26.915026 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5dd5c-f6d4-489f-8f25-63331acb3e4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:26.916593 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5dd5c-f6d4-489f-8f25-63331acb3e4e None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:26.918913 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 92/186] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:34:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:26.919886 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5dd5c-f6d4-489f-8f25-63331acb3e4e None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:26.931980 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:26.955780 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 95/187] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:34:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:34:26.961275 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad3e1a-5648-4526-aa09-24da9a3b5776 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:27.091107 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5dd5c-f6d4-489f-8f25-63331acb3e4e None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:27.098243 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad3e1a-5648-4526-aa09-24da9a3b5776 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:27.141006 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7b642-f1e0-4053-808c-d81b9c2cc725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:27.141228 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd2eb8-c1f2-4874-975b-e56157cd21c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:27.141674 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd2eb8-c1f2-4874-975b-e56157cd21c2 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:27.141853 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7b642-f1e0-4053-808c-d81b9c2cc725 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:27.141961 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd2eb8-c1f2-4874-975b-e56157cd21c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:27.142211 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd2eb8-c1f2-4874-975b-e56157cd21c2 None admin] PATH_INFO: `/v3/users/0b020dd3d55648628517de11c664bea5` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:27.142344 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7b642-f1e0-4053-808c-d81b9c2cc725 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:27.142624 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7b642-f1e0-4053-808c-d81b9c2cc725 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:27.143368 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f7b642-f1e0-4053-808c-d81b9c2cc725 None admin] RBAC: Adding query filter params (role.id=a0b9865e737f48f2975da1bb8cb386b7, scope.project.id=8afaf32861dc4e62a9b32129a27c4900, user.id=56f5aa59cf424559a6b65ae250308c09) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:27.144221 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f7b642-f1e0-4053-808c-d81b9c2cc725 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:27.146066 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f7b642-f1e0-4053-808c-d81b9c2cc725 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:27.154567 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 93/188] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 8 13:34:26 2022] GET /identity/v3/role_assignments?user.id=56f5aa59cf424559a6b65ae250308c09&scope.project.id=8afaf32861dc4e62a9b32129a27c4900&role.id=a0b9865e737f48f2975da1bb8cb386b7 => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:27.155781 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7b642-f1e0-4053-808c-d81b9c2cc725 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:27.168909 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bd2eb8-c1f2-4874-975b-e56157cd21c2 None admin] RBAC: Authorizing `identity:get_user(user_id=0b020dd3d55648628517de11c664bea5)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:27.171043 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bd2eb8-c1f2-4874-975b-e56157cd21c2 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:27.173105 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 96/189] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:34:26 2022] GET /identity/v3/users/0b020dd3d55648628517de11c664bea5 => generated 283 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:27.174213 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd2eb8-c1f2-4874-975b-e56157cd21c2 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:27.255154 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:27.262127 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:27.332532 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7b642-f1e0-4053-808c-d81b9c2cc725 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:27.334165 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd2eb8-c1f2-4874-975b-e56157cd21c2 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:27.382873 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc31a19-bf5e-4deb-8e14-b6e404a6cfe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:27.383756 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc31a19-bf5e-4deb-8e14-b6e404a6cfe6 None admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:27.384085 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc31a19-bf5e-4deb-8e14-b6e404a6cfe6 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:27.385018 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc31a19-bf5e-4deb-8e14-b6e404a6cfe6 None admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:27.385018 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc31a19-bf5e-4deb-8e14-b6e404a6cfe6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:27.386427 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc31a19-bf5e-4deb-8e14-b6e404a6cfe6 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:27.387748 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b2df7-c41d-470a-bbf7-af2bafb3ba7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:27.388134 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b2df7-c41d-470a-bbf7-af2bafb3ba7a None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:27.388412 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b2df7-c41d-470a-bbf7-af2bafb3ba7a None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:27.388679 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b2df7-c41d-470a-bbf7-af2bafb3ba7a None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:27.389351 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097b2df7-c41d-470a-bbf7-af2bafb3ba7a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:27.389710 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097b2df7-c41d-470a-bbf7-af2bafb3ba7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:27.391059 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097b2df7-c41d-470a-bbf7-af2bafb3ba7a None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:27.402370 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 94/190] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:34:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:27.403046 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b2df7-c41d-470a-bbf7-af2bafb3ba7a None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:27.417889 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 97/191] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Sep 8 13:34:27 2022] POST /identity/v3/users => generated 297 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:34:27.419034 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e33cd-4480-4416-9f5f-7772644609ed None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:27.419396 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e33cd-4480-4416-9f5f-7772644609ed None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:27.419856 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e33cd-4480-4416-9f5f-7772644609ed None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:27.422359 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 98/192] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:34:27.423011 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e33cd-4480-4416-9f5f-7772644609ed None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:27.547290 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b2df7-c41d-470a-bbf7-af2bafb3ba7a None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:27.558252 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:27.578818 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:27.583603 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e33cd-4480-4416-9f5f-7772644609ed None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:27.592879 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2006cd6f-d8c0-4079-818b-f9214915b6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:27.593533 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006cd6f-d8c0-4079-818b-f9214915b6ff None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:27.593819 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006cd6f-d8c0-4079-818b-f9214915b6ff None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:27.594096 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006cd6f-d8c0-4079-818b-f9214915b6ff None admin] PATH_INFO: `/v3/projects/82f4d2711ad2497f95f1217ff347aec6` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:27.595491 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2006cd6f-d8c0-4079-818b-f9214915b6ff None admin] RBAC: Authorizing `identity:get_project(project_id=82f4d2711ad2497f95f1217ff347aec6)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:27.596830 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2006cd6f-d8c0-4079-818b-f9214915b6ff None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:27.599685 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 95/193] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:34:27 2022] GET /identity/v3/projects/82f4d2711ad2497f95f1217ff347aec6 => generated 312 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:27.605986 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2006cd6f-d8c0-4079-818b-f9214915b6ff None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:27.648375 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1629b-c9d0-4f53-a8d3-6a11985b50f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:27.648998 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1629b-c9d0-4f53-a8d3-6a11985b50f3 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:27.649277 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1629b-c9d0-4f53-a8d3-6a11985b50f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:27.649990 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1629b-c9d0-4f53-a8d3-6a11985b50f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:27.737917 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b1629b-c9d0-4f53-a8d3-6a11985b50f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:27.739420 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b1629b-c9d0-4f53-a8d3-6a11985b50f3 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:27.740753 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2006cd6f-d8c0-4079-818b-f9214915b6ff None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:27.786393 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e133cc4-5ddd-4cc6-ba8f-8d56a6d71f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:27.787303 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e133cc4-5ddd-4cc6-ba8f-8d56a6d71f8e None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:27.787725 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e133cc4-5ddd-4cc6-ba8f-8d56a6d71f8e None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:27.788137 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e133cc4-5ddd-4cc6-ba8f-8d56a6d71f8e None admin] PATH_INFO: `/v3/users/0b020dd3d55648628517de11c664bea5` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:27.790170 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e133cc4-5ddd-4cc6-ba8f-8d56a6d71f8e None admin] RBAC: Authorizing `identity:get_user(user_id=0b020dd3d55648628517de11c664bea5)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:27.791620 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e133cc4-5ddd-4cc6-ba8f-8d56a6d71f8e None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:27.794246 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 96/194] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:34:27 2022] GET /identity/v3/users/0b020dd3d55648628517de11c664bea5 => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:27.795684 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7680878-bfb3-4570-a65f-24d7bf944c6f None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:27.795965 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7680878-bfb3-4570-a65f-24d7bf944c6f None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:27.796235 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7680878-bfb3-4570-a65f-24d7bf944c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:27.817193 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-c7680878-bfb3-4570-a65f-24d7bf944c6f None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:27.818777 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-c7680878-bfb3-4570-a65f-24d7bf944c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:27.879875 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:27.883136 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:27.889833 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 99/195] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:34:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:34:27.891373 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1629b-c9d0-4f53-a8d3-6a11985b50f3 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:27.934781 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 97/196] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:34:27.936529 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7680878-bfb3-4570-a65f-24d7bf944c6f None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:28.105394 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1629b-c9d0-4f53-a8d3-6a11985b50f3 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:28.118544 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7680878-bfb3-4570-a65f-24d7bf944c6f None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:28.182970 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fcb7e5-f888-4681-ac94-9531a2059db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:28.183581 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fcb7e5-f888-4681-ac94-9531a2059db9 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:28.183854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fcb7e5-f888-4681-ac94-9531a2059db9 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:28.184124 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fcb7e5-f888-4681-ac94-9531a2059db9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:28.184909 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fcb7e5-f888-4681-ac94-9531a2059db9 None admin] RBAC: Adding query filter params (role.id=0735c260e70441cc87ad611b789d5c56, scope.project.id=82f4d2711ad2497f95f1217ff347aec6, user.id=56f5aa59cf424559a6b65ae250308c09) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:28.185153 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fcb7e5-f888-4681-ac94-9531a2059db9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:28.186635 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fcb7e5-f888-4681-ac94-9531a2059db9 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:28.200995 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33aac91-7fff-4baf-92e4-78646485960c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:28.201640 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33aac91-7fff-4baf-92e4-78646485960c None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:28.201919 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33aac91-7fff-4baf-92e4-78646485960c None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:28.202186 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33aac91-7fff-4baf-92e4-78646485960c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:28.205180 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 100/197] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 8 13:34:27 2022] GET /identity/v3/role_assignments?user.id=56f5aa59cf424559a6b65ae250308c09&scope.project.id=82f4d2711ad2497f95f1217ff347aec6&role.id=0735c260e70441cc87ad611b789d5c56 => generated 608 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:28.206236 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fcb7e5-f888-4681-ac94-9531a2059db9 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:28.273765 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:28.330871 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33aac91-7fff-4baf-92e4-78646485960c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:28.332401 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33aac91-7fff-4baf-92e4-78646485960c None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:28.358171 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:28.458077 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fcb7e5-f888-4681-ac94-9531a2059db9 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:28.535148 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89eaaba-f042-4520-b1aa-2bb717a5f758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:28.535791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89eaaba-f042-4520-b1aa-2bb717a5f758 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:28.536068 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89eaaba-f042-4520-b1aa-2bb717a5f758 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:28.536337 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89eaaba-f042-4520-b1aa-2bb717a5f758 None admin] PATH_INFO: `/v3/projects/06fa14b343d84890b6385d02bd48c9b7` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:28.537937 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89eaaba-f042-4520-b1aa-2bb717a5f758 None admin] RBAC: Authorizing `identity:get_project(project_id=06fa14b343d84890b6385d02bd48c9b7)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:28.542251 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89eaaba-f042-4520-b1aa-2bb717a5f758 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:28.544981 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 101/198] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:34:28 2022] GET /identity/v3/projects/06fa14b343d84890b6385d02bd48c9b7 => generated 302 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:28.547420 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89eaaba-f042-4520-b1aa-2bb717a5f758 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:28.556478 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 98/199] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:34:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 621 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:34:28.558507 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33aac91-7fff-4baf-92e4-78646485960c None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:28.675953 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:28.726830 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89eaaba-f042-4520-b1aa-2bb717a5f758 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:28.727362 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33aac91-7fff-4baf-92e4-78646485960c None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:28.775460 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4c3a2-0937-4912-bd80-67fa8a23f16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:28.776207 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4c3a2-0937-4912-bd80-67fa8a23f16b None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:28.776489 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4c3a2-0937-4912-bd80-67fa8a23f16b None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:28.776761 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4c3a2-0937-4912-bd80-67fa8a23f16b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:28.777087 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f83f3-1c2c-44fe-844c-fae328d023d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:28.778137 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f83f3-1c2c-44fe-844c-fae328d023d2 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:28.778630 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f83f3-1c2c-44fe-844c-fae328d023d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:28.779105 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f83f3-1c2c-44fe-844c-fae328d023d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:28.779416 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:28.780272 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f83f3-1c2c-44fe-844c-fae328d023d2 None admin] RBAC: Adding query filter params (role.id=9c76f398c9e04caeab83842e70eb824b, scope.project.id=06fa14b343d84890b6385d02bd48c9b7, user.id=0b020dd3d55648628517de11c664bea5) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:28.780590 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f83f3-1c2c-44fe-844c-fae328d023d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:28.782182 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f83f3-1c2c-44fe-844c-fae328d023d2 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:28.790046 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 99/200] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 8 13:34:28 2022] GET /identity/v3/role_assignments?user.id=0b020dd3d55648628517de11c664bea5&scope.project.id=06fa14b343d84890b6385d02bd48c9b7&role.id=9c76f398c9e04caeab83842e70eb824b => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:28.790760 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f83f3-1c2c-44fe-844c-fae328d023d2 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:28.796010 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb4c3a2-0937-4912-bd80-67fa8a23f16b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:34:28.806018 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-beb4c3a2-0937-4912-bd80-67fa8a23f16b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:34:28.806018 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:34:28.806018 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:34:28.806018 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:34:28.806018 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:34:28.806018 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:34:28.806018 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:34:28.806018 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:34:28.806018 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:34:28.806018 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:34:28.806018 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:34:28.806018 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:34:28.806018 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:34:28.806018 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:34:28.806018 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:34:28.806018 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:34:28.807029 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:34:28.807029 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:34:28.807029 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:34:28.807029 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:34:28.807029 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:34:28.807029 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:34:28.807029 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:34:28.807029 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:34:28.807029 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:34:28.807029 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:34:28.807029 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:34:28.807029 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:34:28.807029 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:34:28.807029 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:34:28.807029 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:34:28.807029 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:34:28.807932 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:34:28.807932 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:34:28.807932 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:34:28.807932 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:34:28.807932 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:34:28.807932 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:34:28.807932 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:34:28.807932 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:34:28.807932 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:34:28.807932 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:34:28.807932 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:34:28.807932 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:34:28.818834 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 102/201] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:34:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:34:28.825347 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4c3a2-0937-4912-bd80-67fa8a23f16b None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:29.033521 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4c3a2-0937-4912-bd80-67fa8a23f16b None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:29.034220 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f83f3-1c2c-44fe-844c-fae328d023d2 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:29.079774 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b008fa-dd19-43f1-a3b8-6172e248e68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:29.080272 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b008fa-dd19-43f1-a3b8-6172e248e68e None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:29.080559 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b008fa-dd19-43f1-a3b8-6172e248e68e None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:29.080904 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b008fa-dd19-43f1-a3b8-6172e248e68e None admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:29.081621 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b008fa-dd19-43f1-a3b8-6172e248e68e None admin] RBAC: Adding query filter params (name=reader) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:29.081953 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b008fa-dd19-43f1-a3b8-6172e248e68e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:29.084319 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b008fa-dd19-43f1-a3b8-6172e248e68e None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:29.088769 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d49eb1-5df0-42a8-83e3-ad3f1e42b89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:29.089463 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d49eb1-5df0-42a8-83e3-ad3f1e42b89c None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:29.089747 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d49eb1-5df0-42a8-83e3-ad3f1e42b89c None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:29.090024 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d49eb1-5df0-42a8-83e3-ad3f1e42b89c None admin] PATH_INFO: `/v3/projects/06fa14b343d84890b6385d02bd48c9b7` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:29.092099 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d49eb1-5df0-42a8-83e3-ad3f1e42b89c None admin] RBAC: Authorizing `identity:get_project(project_id=06fa14b343d84890b6385d02bd48c9b7)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:29.093653 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d49eb1-5df0-42a8-83e3-ad3f1e42b89c None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:29.099068 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 100/202] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:34:28 2022] GET /identity/v3/projects/06fa14b343d84890b6385d02bd48c9b7 => generated 302 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:29.104452 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d49eb1-5df0-42a8-83e3-ad3f1e42b89c None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:29.110038 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 103/203] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 8 13:34:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:34:29.113751 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b008fa-dd19-43f1-a3b8-6172e248e68e None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:29.123777 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:29.253750 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:29.258891 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d49eb1-5df0-42a8-83e3-ad3f1e42b89c None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:29.339150 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa3147-15b7-4654-9749-b66977ecc693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:29.340102 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa3147-15b7-4654-9749-b66977ecc693 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:29.340523 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa3147-15b7-4654-9749-b66977ecc693 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:29.340935 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa3147-15b7-4654-9749-b66977ecc693 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:29.342158 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fa3147-15b7-4654-9749-b66977ecc693 None admin] RBAC: Adding query filter params (role.id=a0b9865e737f48f2975da1bb8cb386b7, scope.project.id=06fa14b343d84890b6385d02bd48c9b7, user.id=0b020dd3d55648628517de11c664bea5) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:29.342550 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fa3147-15b7-4654-9749-b66977ecc693 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:29.344203 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fa3147-15b7-4654-9749-b66977ecc693 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:29.366264 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 101/204] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 8 13:34:29 2022] GET /identity/v3/role_assignments?user.id=0b020dd3d55648628517de11c664bea5&scope.project.id=06fa14b343d84890b6385d02bd48c9b7&role.id=a0b9865e737f48f2975da1bb8cb386b7 => generated 259 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:34:29.377308 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b008fa-dd19-43f1-a3b8-6172e248e68e None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:29.430315 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622fa459-e86a-4407-ac83-6e8362a18509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:29.430990 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622fa459-e86a-4407-ac83-6e8362a18509 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:29.431320 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622fa459-e86a-4407-ac83-6e8362a18509 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:29.431529 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622fa459-e86a-4407-ac83-6e8362a18509 None admin] PATH_INFO: `/v3/users/559ac14a491d47048d4190b7d89fc4f7` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:29.432981 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622fa459-e86a-4407-ac83-6e8362a18509 None admin] RBAC: Authorizing `identity:get_user(user_id=559ac14a491d47048d4190b7d89fc4f7)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:29.434633 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622fa459-e86a-4407-ac83-6e8362a18509 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:29.441559 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 104/205] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:34:29 2022] GET /identity/v3/users/559ac14a491d47048d4190b7d89fc4f7 => generated 289 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:34:29.443020 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa3147-15b7-4654-9749-b66977ecc693 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:29.542899 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:29.592861 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa3147-15b7-4654-9749-b66977ecc693 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:29.635052 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e81269-87a2-46b0-9919-fb00f6dfb2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:29.635666 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e81269-87a2-46b0-9919-fb00f6dfb2ee None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:29.635995 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e81269-87a2-46b0-9919-fb00f6dfb2ee None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:29.636323 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e81269-87a2-46b0-9919-fb00f6dfb2ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:29.727231 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e81269-87a2-46b0-9919-fb00f6dfb2ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:29.728715 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e81269-87a2-46b0-9919-fb00f6dfb2ee None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:29.811672 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:29.853269 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 102/206] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:34:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:34:29.858941 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622fa459-e86a-4407-ac83-6e8362a18509 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:30.040971 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622fa459-e86a-4407-ac83-6e8362a18509 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:30.077856 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:30.096600 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b79a08-8e32-4802-a05f-4d9cddc24b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:30.097632 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b79a08-8e32-4802-a05f-4d9cddc24b71 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:30.098116 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b79a08-8e32-4802-a05f-4d9cddc24b71 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:30.098841 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b79a08-8e32-4802-a05f-4d9cddc24b71 None admin] PATH_INFO: `/v3/projects/8afaf32861dc4e62a9b32129a27c4900` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:30.100263 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b79a08-8e32-4802-a05f-4d9cddc24b71 None admin] RBAC: Authorizing `identity:get_project(project_id=8afaf32861dc4e62a9b32129a27c4900)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:30.102969 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b79a08-8e32-4802-a05f-4d9cddc24b71 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:30.104983 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 105/207] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:34:29 2022] GET /identity/v3/projects/8afaf32861dc4e62a9b32129a27c4900 => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:30.114768 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e81269-87a2-46b0-9919-fb00f6dfb2ee None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:30.340927 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e81269-87a2-46b0-9919-fb00f6dfb2ee None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:30.409431 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aece113-50c9-4f71-94e2-c20487609ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:30.410310 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aece113-50c9-4f71-94e2-c20487609ba4 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:30.410788 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aece113-50c9-4f71-94e2-c20487609ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:30.411264 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aece113-50c9-4f71-94e2-c20487609ba4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:30.412581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aece113-50c9-4f71-94e2-c20487609ba4 None admin] RBAC: Adding query filter params (role.id=ab9b8996e13a46418c5b25949af994de, scope.project.id=8afaf32861dc4e62a9b32129a27c4900, user.id=559ac14a491d47048d4190b7d89fc4f7) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:30.413095 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aece113-50c9-4f71-94e2-c20487609ba4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:30.415823 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aece113-50c9-4f71-94e2-c20487609ba4 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:30.428595 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 103/208] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 8 13:34:30 2022] GET /identity/v3/role_assignments?user.id=559ac14a491d47048d4190b7d89fc4f7&scope.project.id=8afaf32861dc4e62a9b32129a27c4900&role.id=ab9b8996e13a46418c5b25949af994de => generated 608 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:30.771999 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f35537-27f5-440f-985c-39fa047cda33 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:30.772472 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f35537-27f5-440f-985c-39fa047cda33 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:30.772841 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f35537-27f5-440f-985c-39fa047cda33 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:30.775717 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 106/209] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:34:30.782626 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9e55d-90f9-4802-bd71-9038bf4da855 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:30.783091 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9e55d-90f9-4802-bd71-9038bf4da855 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:30.783570 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9e55d-90f9-4802-bd71-9038bf4da855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:30.821510 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-e7c9e55d-90f9-4802-bd71-9038bf4da855 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:30.823556 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-e7c9e55d-90f9-4802-bd71-9038bf4da855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:30.847507 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944d7d4-81c7-4c66-9d54-195b692126f9 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:30.848219 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944d7d4-81c7-4c66-9d54-195b692126f9 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:30.848219 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944d7d4-81c7-4c66-9d54-195b692126f9 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:30.850188 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 107/210] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:34:30.862347 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1573d-8571-4165-b0f5-2e2d352871b5 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:30.863094 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1573d-8571-4165-b0f5-2e2d352871b5 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:30.863094 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1573d-8571-4165-b0f5-2e2d352871b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:30.877938 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:30.897070 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-8dd1573d-8571-4165-b0f5-2e2d352871b5 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:30.899443 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-8dd1573d-8571-4165-b0f5-2e2d352871b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:30.934108 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 104/211] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:34:31.003440 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 108/212] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:34:31.302648 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c9e55d-90f9-4802-bd71-9038bf4da855 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:31.399598 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd1573d-8571-4165-b0f5-2e2d352871b5 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:31.436176 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c9e55d-90f9-4802-bd71-9038bf4da855 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:31.481871 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10a0cb-1db5-4bbc-bbef-9c3733fca01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:31.482526 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10a0cb-1db5-4bbc-bbef-9c3733fca01e None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:31.482805 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10a0cb-1db5-4bbc-bbef-9c3733fca01e None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:31.483074 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10a0cb-1db5-4bbc-bbef-9c3733fca01e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:31.484387 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f10a0cb-1db5-4bbc-bbef-9c3733fca01e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:31.485880 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f10a0cb-1db5-4bbc-bbef-9c3733fca01e None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:31.487744 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 105/213] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:34:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:31.494498 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10a0cb-1db5-4bbc-bbef-9c3733fca01e None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:31.544003 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:31.555983 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd1573d-8571-4165-b0f5-2e2d352871b5 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:31.582735 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:31.603573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c8c71-a7c2-4de4-8853-1134f70e90d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:31.604653 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c8c71-a7c2-4de4-8853-1134f70e90d7 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:31.605028 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c8c71-a7c2-4de4-8853-1134f70e90d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:31.605567 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c8c71-a7c2-4de4-8853-1134f70e90d7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:31.623151 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88c8c71-a7c2-4de4-8853-1134f70e90d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:34:31.628317 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-a88c8c71-a7c2-4de4-8853-1134f70e90d7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:34:31.628317 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:34:31.628317 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:34:31.628317 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:34:31.628317 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:34:31.628317 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:34:31.628317 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:34:31.628317 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:34:31.628317 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:34:31.628317 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:34:31.628317 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:34:31.628317 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:34:31.628317 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:34:31.628317 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:34:31.628317 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:34:31.628317 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:34:31.630189 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:34:31.630189 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:34:31.630189 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:34:31.630189 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:34:31.630189 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:34:31.630189 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:34:31.630189 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:34:31.630189 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:34:31.630189 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:34:31.630189 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:34:31.630189 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:34:31.630189 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:34:31.630189 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:34:31.630189 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:34:31.630189 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:34:31.630189 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:34:31.631880 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:34:31.631880 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:34:31.631880 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:34:31.631880 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:34:31.631880 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:34:31.631880 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:34:31.631880 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:34:31.631880 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:34:31.631880 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:34:31.631880 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:34:31.631880 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:34:31.631880 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:34:31.631880 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 109/214] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:34:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:34:31.631880 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6043b72-6547-4054-aad4-55398978aaf6 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:31.642856 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6043b72-6547-4054-aad4-55398978aaf6 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:31.642856 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6043b72-6547-4054-aad4-55398978aaf6 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:31.642856 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 110/215] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:34:31.642856 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6043b72-6547-4054-aad4-55398978aaf6 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:31.647560 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10a0cb-1db5-4bbc-bbef-9c3733fca01e None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:31.700278 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b12d8-f1fb-4a10-bbf8-241abad6dd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:31.701269 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b12d8-f1fb-4a10-bbf8-241abad6dd6d None admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:31.701841 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b12d8-f1fb-4a10-bbf8-241abad6dd6d None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:31.702290 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b12d8-f1fb-4a10-bbf8-241abad6dd6d None admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:31.703206 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b12d8-f1fb-4a10-bbf8-241abad6dd6d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:31.704944 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b12d8-f1fb-4a10-bbf8-241abad6dd6d None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:31.737704 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 106/216] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Sep 8 13:34:31 2022] POST /identity/v3/users => generated 297 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:34:31.740037 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a49bd-3251-415e-9f20-c9fed40ccc2d None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:31.740339 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a49bd-3251-415e-9f20-c9fed40ccc2d None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:31.740889 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a49bd-3251-415e-9f20-c9fed40ccc2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:31.772118 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-368a49bd-3251-415e-9f20-c9fed40ccc2d None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:31.775168 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-368a49bd-3251-415e-9f20-c9fed40ccc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:31.811150 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6043b72-6547-4054-aad4-55398978aaf6 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:31.871519 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67688dd-953e-4bd2-bd65-869a60ddf8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:31.872282 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67688dd-953e-4bd2-bd65-869a60ddf8f9 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:31.872436 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67688dd-953e-4bd2-bd65-869a60ddf8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:31.875378 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67688dd-953e-4bd2-bd65-869a60ddf8f9 None admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:31.875378 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67688dd-953e-4bd2-bd65-869a60ddf8f9 None admin] RBAC: Adding query filter params (name=member) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:31.875378 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67688dd-953e-4bd2-bd65-869a60ddf8f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:31.875903 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 107/217] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:34:31.876046 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67688dd-953e-4bd2-bd65-869a60ddf8f9 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:31.892440 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 111/218] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 8 13:34:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:31.899495 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a49bd-3251-415e-9f20-c9fed40ccc2d None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:31.933054 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:32.032209 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a49bd-3251-415e-9f20-c9fed40ccc2d None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:32.095678 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a58b05-75f0-46ab-bd21-474934bdc66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:32.096580 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a58b05-75f0-46ab-bd21-474934bdc66a None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:32.097029 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a58b05-75f0-46ab-bd21-474934bdc66a None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:32.097527 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a58b05-75f0-46ab-bd21-474934bdc66a None admin] PATH_INFO: `/v3/users/1a61c7a326a148c08d57b5468e6108a8` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:32.117214 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a58b05-75f0-46ab-bd21-474934bdc66a None admin] RBAC: Authorizing `identity:get_user(user_id=1a61c7a326a148c08d57b5468e6108a8)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:32.119968 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a58b05-75f0-46ab-bd21-474934bdc66a None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:32.123443 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 108/219] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:34:31 2022] GET /identity/v3/users/1a61c7a326a148c08d57b5468e6108a8 => generated 297 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:32.130161 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67688dd-953e-4bd2-bd65-869a60ddf8f9 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:32.196839 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:32.202191 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a58b05-75f0-46ab-bd21-474934bdc66a None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:32.291235 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67688dd-953e-4bd2-bd65-869a60ddf8f9 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:32.336420 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:32.339517 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3347f4-168e-497b-b708-6b9f5820e7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:32.340561 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3347f4-168e-497b-b708-6b9f5820e7b0 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:32.341045 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3347f4-168e-497b-b708-6b9f5820e7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:32.341512 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3347f4-168e-497b-b708-6b9f5820e7b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:32.365598 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a58b05-75f0-46ab-bd21-474934bdc66a None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:32.411150 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbac9b-3548-4a61-814e-3142952cc1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:32.411899 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbac9b-3548-4a61-814e-3142952cc1c5 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:32.412179 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbac9b-3548-4a61-814e-3142952cc1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:32.412445 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbac9b-3548-4a61-814e-3142952cc1c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:32.425948 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dbac9b-3548-4a61-814e-3142952cc1c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:34:32.432534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-45dbac9b-3548-4a61-814e-3142952cc1c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:34:32.432534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:34:32.432534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:34:32.432534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:34:32.432534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:34:32.432534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:34:32.432534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:34:32.432534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:34:32.432534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:34:32.432534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:34:32.432534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:34:32.432534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:34:32.432534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:34:32.432534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:34:32.432534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:34:32.432534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:34:32.433618 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:34:32.433618 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:34:32.433618 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:34:32.433618 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:34:32.433618 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:34:32.433618 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:34:32.433618 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:34:32.433618 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:34:32.433618 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:34:32.433618 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:34:32.433618 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:34:32.433618 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:34:32.433618 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:34:32.433618 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:34:32.433618 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:34:32.433618 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:34:32.434631 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:34:32.434631 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:34:32.434631 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:34:32.434631 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:34:32.434631 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:34:32.434631 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:34:32.434631 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:34:32.434631 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:34:32.434631 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:34:32.434631 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:34:32.434631 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:34:32.434631 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:34:32.434631 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 109/220] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 8 13:34:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:34:32.437408 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b991dc8-a17c-4c73-8047-e24ae355168e None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:32.437408 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b991dc8-a17c-4c73-8047-e24ae355168e None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:32.437408 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b991dc8-a17c-4c73-8047-e24ae355168e None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:32.441711 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 110/221] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:34:32.445217 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b991dc8-a17c-4c73-8047-e24ae355168e None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:32.461676 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3347f4-168e-497b-b708-6b9f5820e7b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:32.463689 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3347f4-168e-497b-b708-6b9f5820e7b0 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:32.539025 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:32.610940 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b991dc8-a17c-4c73-8047-e24ae355168e None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:32.614011 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 112/222] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:34:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 08 13:34:32.620980 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4344752-cb62-4f72-b7e2-f8121f07a4b9 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:32.621265 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4344752-cb62-4f72-b7e2-f8121f07a4b9 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:32.621534 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4344752-cb62-4f72-b7e2-f8121f07a4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:32.642875 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-f4344752-cb62-4f72-b7e2-f8121f07a4b9 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:32.644677 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-f4344752-cb62-4f72-b7e2-f8121f07a4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:32.661539 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ccf574-54b7-42d6-ac67-ced2eb2c8a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:32.662859 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccf574-54b7-42d6-ac67-ced2eb2c8a8b None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:32.663957 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccf574-54b7-42d6-ac67-ced2eb2c8a8b None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:32.664794 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccf574-54b7-42d6-ac67-ced2eb2c8a8b None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:32.665948 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ccf574-54b7-42d6-ac67-ced2eb2c8a8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:32.666458 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ccf574-54b7-42d6-ac67-ced2eb2c8a8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:32.668150 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ccf574-54b7-42d6-ac67-ced2eb2c8a8b None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:32.671225 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:32.680620 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 111/223] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:34:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:32.682525 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ccf574-54b7-42d6-ac67-ced2eb2c8a8b None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:32.727242 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 113/224] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:34:32.728448 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4344752-cb62-4f72-b7e2-f8121f07a4b9 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:32.813135 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ccf574-54b7-42d6-ac67-ced2eb2c8a8b None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:32.852747 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:32.858849 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a9236-1212-4bc0-b891-a644498fea42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:32.859756 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a9236-1212-4bc0-b891-a644498fea42 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:32.860137 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a9236-1212-4bc0-b891-a644498fea42 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:32.860625 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a9236-1212-4bc0-b891-a644498fea42 None admin] PATH_INFO: `/v3/projects/06fa14b343d84890b6385d02bd48c9b7` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:32.862076 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557a9236-1212-4bc0-b891-a644498fea42 None admin] RBAC: Authorizing `identity:get_project(project_id=06fa14b343d84890b6385d02bd48c9b7)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:32.864187 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557a9236-1212-4bc0-b891-a644498fea42 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:32.867483 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 112/225] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:34:32 2022] GET /identity/v3/projects/06fa14b343d84890b6385d02bd48c9b7 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:32.874404 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a9236-1212-4bc0-b891-a644498fea42 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:32.929710 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4344752-cb62-4f72-b7e2-f8121f07a4b9 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:33.014616 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:33.028760 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577f7f0-7a2e-4fd2-b02e-beb57c25b6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:33.035341 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577f7f0-7a2e-4fd2-b02e-beb57c25b6af None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:33.035980 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577f7f0-7a2e-4fd2-b02e-beb57c25b6af None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:33.036500 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577f7f0-7a2e-4fd2-b02e-beb57c25b6af None admin] PATH_INFO: `/v3/users/0b020dd3d55648628517de11c664bea5` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:33.038132 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577f7f0-7a2e-4fd2-b02e-beb57c25b6af None admin] RBAC: Authorizing `identity:get_user(user_id=0b020dd3d55648628517de11c664bea5)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:33.040473 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577f7f0-7a2e-4fd2-b02e-beb57c25b6af None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:33.042793 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 114/226] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:34:32 2022] GET /identity/v3/users/0b020dd3d55648628517de11c664bea5 => generated 283 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:33.049396 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577f7f0-7a2e-4fd2-b02e-beb57c25b6af None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:33.124352 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a9236-1212-4bc0-b891-a644498fea42 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:33.172573 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17998b4-e701-4d85-b6a7-4092a9fc7b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:33.173157 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17998b4-e701-4d85-b6a7-4092a9fc7b37 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:33.173489 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17998b4-e701-4d85-b6a7-4092a9fc7b37 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:33.173766 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17998b4-e701-4d85-b6a7-4092a9fc7b37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:33.174503 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17998b4-e701-4d85-b6a7-4092a9fc7b37 None admin] RBAC: Adding query filter params (role.id=0735c260e70441cc87ad611b789d5c56, scope.project.id=06fa14b343d84890b6385d02bd48c9b7, user.id=1a61c7a326a148c08d57b5468e6108a8) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:33.174811 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17998b4-e701-4d85-b6a7-4092a9fc7b37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:33.176287 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17998b4-e701-4d85-b6a7-4092a9fc7b37 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:33.184664 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 113/227] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 8 13:34:32 2022] GET /identity/v3/role_assignments?user.id=1a61c7a326a148c08d57b5468e6108a8&scope.project.id=06fa14b343d84890b6385d02bd48c9b7&role.id=0735c260e70441cc87ad611b789d5c56 => generated 259 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:34:33.186059 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17998b4-e701-4d85-b6a7-4092a9fc7b37 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:33.207198 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577f7f0-7a2e-4fd2-b02e-beb57c25b6af None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:33.300257 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577eef4-1bf8-455c-8062-377c69a518ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:33.300916 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577eef4-1bf8-455c-8062-377c69a518ed None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:33.301214 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577eef4-1bf8-455c-8062-377c69a518ed None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:33.301488 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577eef4-1bf8-455c-8062-377c69a518ed None admin] PATH_INFO: `/v3/projects/06fa14b343d84890b6385d02bd48c9b7` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:33.306256 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577eef4-1bf8-455c-8062-377c69a518ed None admin] RBAC: Authorizing `identity:get_project(project_id=06fa14b343d84890b6385d02bd48c9b7)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:33.308325 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577eef4-1bf8-455c-8062-377c69a518ed None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:33.310262 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 115/228] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:34:33 2022] GET /identity/v3/projects/06fa14b343d84890b6385d02bd48c9b7 => generated 302 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:34:33.318063 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577eef4-1bf8-455c-8062-377c69a518ed None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:33.352299 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:33.418023 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17998b4-e701-4d85-b6a7-4092a9fc7b37 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:33.458551 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:33.466210 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec036b-fb8a-4845-9275-99bfc9e80531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:33.466902 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec036b-fb8a-4845-9275-99bfc9e80531 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:33.467370 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec036b-fb8a-4845-9275-99bfc9e80531 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:33.467786 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec036b-fb8a-4845-9275-99bfc9e80531 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:33.482000 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ec036b-fb8a-4845-9275-99bfc9e80531 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:34:33.489187 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-d3ec036b-fb8a-4845-9275-99bfc9e80531 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:34:33.489187 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:34:33.489187 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:34:33.489187 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:34:33.489187 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:34:33.489187 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:34:33.489187 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:34:33.489187 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:34:33.489187 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:34:33.489187 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:34:33.489187 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:34:33.489187 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:34:33.489187 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:34:33.489187 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:34:33.489187 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:34:33.489187 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:34:33.490371 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:34:33.490371 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:34:33.490371 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:34:33.490371 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:34:33.490371 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:34:33.490371 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:34:33.490371 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:34:33.490371 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:34:33.490371 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:34:33.490371 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:34:33.490371 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:34:33.490371 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:34:33.490371 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:34:33.490371 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:34:33.490371 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:34:33.490371 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:34:33.491441 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:34:33.491441 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:34:33.491441 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:34:33.491441 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:34:33.491441 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:34:33.491441 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:34:33.491441 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:34:33.491441 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:34:33.491441 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:34:33.491441 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:34:33.491441 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:34:33.491441 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:34:33.497415 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 114/229] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Sep 8 13:34:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:34:33.503841 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec036b-fb8a-4845-9275-99bfc9e80531 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:33.623569 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577eef4-1bf8-455c-8062-377c69a518ed None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:33.684973 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec036b-fb8a-4845-9275-99bfc9e80531 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:33.725023 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780da2c-0fa4-4939-8b3b-e32487218087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:33.725614 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780da2c-0fa4-4939-8b3b-e32487218087 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:33.726535 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780da2c-0fa4-4939-8b3b-e32487218087 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:33.726857 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f780da2c-0fa4-4939-8b3b-e32487218087 None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:33.727566 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780da2c-0fa4-4939-8b3b-e32487218087 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:33.728197 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780da2c-0fa4-4939-8b3b-e32487218087 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:33.730160 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f780da2c-0fa4-4939-8b3b-e32487218087 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:33.740947 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 115/230] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:34:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:33.748154 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780da2c-0fa4-4939-8b3b-e32487218087 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:33.772003 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf0f99-579f-4fed-afb6-9acc4e609a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:33.773222 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf0f99-579f-4fed-afb6-9acc4e609a1b None admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:33.773523 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf0f99-579f-4fed-afb6-9acc4e609a1b None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:33.773799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf0f99-579f-4fed-afb6-9acc4e609a1b None admin] PATH_INFO: `/v3/projects/06fa14b343d84890b6385d02bd48c9b7/users/0b020dd3d55648628517de11c664bea5/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:33.775806 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf0f99-579f-4fed-afb6-9acc4e609a1b None admin] RBAC: Authorizing `identity:create_grant(project_id=06fa14b343d84890b6385d02bd48c9b7, user_id=0b020dd3d55648628517de11c664bea5, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:33.777274 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bf0f99-579f-4fed-afb6-9acc4e609a1b None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:33.821005 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 116/231] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Sep 8 13:34:33 2022] PUT /identity/v3/projects/06fa14b343d84890b6385d02bd48c9b7/users/0b020dd3d55648628517de11c664bea5/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:34:33.822013 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:33.883256 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f780da2c-0fa4-4939-8b3b-e32487218087 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:33.924939 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5cff64-7153-4983-83ee-414d00d4ac1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:33.925736 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cff64-7153-4983-83ee-414d00d4ac1a None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:33.926011 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cff64-7153-4983-83ee-414d00d4ac1a None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:33.926282 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5cff64-7153-4983-83ee-414d00d4ac1a None admin] PATH_INFO: `/v3/users/0b020dd3d55648628517de11c664bea5` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:33.927718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5cff64-7153-4983-83ee-414d00d4ac1a None admin] RBAC: Authorizing `identity:get_user(user_id=0b020dd3d55648628517de11c664bea5)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:33.929419 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5cff64-7153-4983-83ee-414d00d4ac1a None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:33.931516 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 116/232] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:34:33 2022] GET /identity/v3/users/0b020dd3d55648628517de11c664bea5 => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:34:33.937528 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf0f99-579f-4fed-afb6-9acc4e609a1b None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:34.023702 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:34.068140 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf0f99-579f-4fed-afb6-9acc4e609a1b None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:34.114228 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397fcf3-228c-4873-853f-eaa6e67b3eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:34.115286 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397fcf3-228c-4873-853f-eaa6e67b3eb5 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:34.115724 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397fcf3-228c-4873-853f-eaa6e67b3eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:34.116011 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397fcf3-228c-4873-853f-eaa6e67b3eb5 None admin] PATH_INFO: `/v3/projects/06fa14b343d84890b6385d02bd48c9b7` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:34.118867 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6397fcf3-228c-4873-853f-eaa6e67b3eb5 None admin] RBAC: Authorizing `identity:get_project(project_id=06fa14b343d84890b6385d02bd48c9b7)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:34.121801 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6397fcf3-228c-4873-853f-eaa6e67b3eb5 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:34.124975 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 117/233] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:34:33 2022] GET /identity/v3/projects/06fa14b343d84890b6385d02bd48c9b7 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:34:34.136146 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5cff64-7153-4983-83ee-414d00d4ac1a None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:34.260303 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5cff64-7153-4983-83ee-414d00d4ac1a None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:34.293947 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:34.300298 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c94c9-0620-4ab8-8f39-0ca0b0efd2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:34.300980 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c94c9-0620-4ab8-8f39-0ca0b0efd2b5 None admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:34.301635 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c94c9-0620-4ab8-8f39-0ca0b0efd2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:34.301925 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c94c9-0620-4ab8-8f39-0ca0b0efd2b5 None admin] PATH_INFO: `/v3/projects/06fa14b343d84890b6385d02bd48c9b7/users/0b020dd3d55648628517de11c664bea5/roles/a0b9865e737f48f2975da1bb8cb386b7` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:34.305226 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5c94c9-0620-4ab8-8f39-0ca0b0efd2b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=06fa14b343d84890b6385d02bd48c9b7, user_id=0b020dd3d55648628517de11c664bea5, role_id=a0b9865e737f48f2975da1bb8cb386b7)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:34.310358 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5c94c9-0620-4ab8-8f39-0ca0b0efd2b5 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:34.335009 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 117/234] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Sep 8 13:34:34 2022] PUT /identity/v3/projects/06fa14b343d84890b6385d02bd48c9b7/users/0b020dd3d55648628517de11c664bea5/roles/a0b9865e737f48f2975da1bb8cb386b7 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:34:34.804490 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983c01b-aa8b-438d-bd0d-62e9a503a577 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:34.804762 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983c01b-aa8b-438d-bd0d-62e9a503a577 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:34.805171 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d983c01b-aa8b-438d-bd0d-62e9a503a577 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:34.806644 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 118/235] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:34:34.812895 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a85514-042b-474c-920f-1b25bdabc589 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:34.814045 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a85514-042b-474c-920f-1b25bdabc589 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:34.814627 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a85514-042b-474c-920f-1b25bdabc589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:34.840421 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-a6a85514-042b-474c-920f-1b25bdabc589 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:34.842134 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-a6a85514-042b-474c-920f-1b25bdabc589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:34.943089 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 118/236] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:34:35.314762 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d983c01b-aa8b-438d-bd0d-62e9a503a577 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:35.366990 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25d553-2857-46db-bcc1-4b0eac0f7591 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:35.367608 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25d553-2857-46db-bcc1-4b0eac0f7591 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:35.368081 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25d553-2857-46db-bcc1-4b0eac0f7591 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:35.369726 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 119/237] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:34:35.381490 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba8472-ca58-4341-95d3-c9db1cca2675 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:35.382866 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba8472-ca58-4341-95d3-c9db1cca2675 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:35.383378 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba8472-ca58-4341-95d3-c9db1cca2675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:35.413235 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-e2ba8472-ca58-4341-95d3-c9db1cca2675 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:35.416566 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-e2ba8472-ca58-4341-95d3-c9db1cca2675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:35.527333 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d983c01b-aa8b-438d-bd0d-62e9a503a577 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:35.558849 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 120/238] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:34:35.608578 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7993d0f-2a52-47c8-801f-0ec35992ebc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:35.609611 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7993d0f-2a52-47c8-801f-0ec35992ebc1 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:35.610472 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7993d0f-2a52-47c8-801f-0ec35992ebc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:35.610472 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7993d0f-2a52-47c8-801f-0ec35992ebc1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:35.620434 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:35.634482 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7993d0f-2a52-47c8-801f-0ec35992ebc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:34:35.639418 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-d7993d0f-2a52-47c8-801f-0ec35992ebc1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:34:35.639418 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:34:35.639418 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:34:35.639418 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:34:35.639418 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:34:35.639418 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:34:35.639418 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:34:35.639418 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:34:35.639418 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:34:35.639418 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:34:35.639418 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:34:35.639418 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:34:35.639418 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:34:35.639418 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:34:35.639418 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:34:35.639418 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:34:35.642289 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:34:35.642289 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:34:35.642289 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:34:35.642289 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:34:35.642289 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:34:35.642289 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:34:35.642289 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:34:35.642289 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:34:35.642289 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:34:35.642289 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:34:35.642289 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:34:35.642289 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:34:35.642289 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:34:35.642289 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:34:35.642289 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:34:35.642289 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:34:35.644327 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:34:35.644327 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:34:35.644327 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:34:35.644327 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:34:35.644327 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:34:35.644327 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:34:35.644327 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:34:35.644327 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:34:35.644327 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:34:35.644327 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:34:35.644327 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:34:35.644327 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:34:35.644327 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 119/239] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:34:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:34:35.647218 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba8472-ca58-4341-95d3-c9db1cca2675 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:35.730718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:35.827346 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba8472-ca58-4341-95d3-c9db1cca2675 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:35.905333 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48998353-112d-4ac9-a117-1a8d5487d023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:35.906315 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48998353-112d-4ac9-a117-1a8d5487d023 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:35.906731 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48998353-112d-4ac9-a117-1a8d5487d023 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:35.907135 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48998353-112d-4ac9-a117-1a8d5487d023 None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:35.908176 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48998353-112d-4ac9-a117-1a8d5487d023 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:35.908630 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48998353-112d-4ac9-a117-1a8d5487d023 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:35.910865 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48998353-112d-4ac9-a117-1a8d5487d023 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:35.932191 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 121/240] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 8 13:34:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:35.942973 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7993d0f-2a52-47c8-801f-0ec35992ebc1 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:36.021937 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48998353-112d-4ac9-a117-1a8d5487d023 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:36.182320 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7993d0f-2a52-47c8-801f-0ec35992ebc1 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:36.205023 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48998353-112d-4ac9-a117-1a8d5487d023 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:36.208615 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:36.270192 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0f568-3a6b-4187-9885-484fd36eaa63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:36.270855 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0f568-3a6b-4187-9885-484fd36eaa63 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:36.271139 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0f568-3a6b-4187-9885-484fd36eaa63 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:36.271437 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0f568-3a6b-4187-9885-484fd36eaa63 None admin] PATH_INFO: `/v3/users/bcfbbfb35e5140bcae95a7859d0fa5e5` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:36.273002 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce60dd5-8a70-4634-a471-42ee829fa65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:36.276369 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce60dd5-8a70-4634-a471-42ee829fa65b None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:36.276924 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce60dd5-8a70-4634-a471-42ee829fa65b None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:36.277453 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce60dd5-8a70-4634-a471-42ee829fa65b None admin] PATH_INFO: `/v3/domains/default` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:36.279236 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce60dd5-8a70-4634-a471-42ee829fa65b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:36.281091 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce60dd5-8a70-4634-a471-42ee829fa65b None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:36.284132 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 122/241] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:34:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:36.293116 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce60dd5-8a70-4634-a471-42ee829fa65b None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:36.326521 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0f568-3a6b-4187-9885-484fd36eaa63 None admin] RBAC: Authorizing `identity:get_user(user_id=bcfbbfb35e5140bcae95a7859d0fa5e5)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:36.328796 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0f568-3a6b-4187-9885-484fd36eaa63 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:36.331457 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 120/242] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:34:35 2022] GET /identity/v3/users/bcfbbfb35e5140bcae95a7859d0fa5e5 => generated 297 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:36.340201 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0f568-3a6b-4187-9885-484fd36eaa63 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:36.465166 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:36.482504 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce60dd5-8a70-4634-a471-42ee829fa65b None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:36.532055 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd4231-c04d-4218-a2c9-4e83b892344a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:36.532675 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd4231-c04d-4218-a2c9-4e83b892344a None admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:36.533066 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd4231-c04d-4218-a2c9-4e83b892344a None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:36.533342 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd4231-c04d-4218-a2c9-4e83b892344a None admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:36.534048 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd4231-c04d-4218-a2c9-4e83b892344a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:36.535589 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd4231-c04d-4218-a2c9-4e83b892344a None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:36.546722 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0f568-3a6b-4187-9885-484fd36eaa63 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:36.568583 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 123/243] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Sep 8 13:34:36 2022] POST /identity/v3/users => generated 293 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:34:36.571050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6d749-6c22-4f30-9ab3-73f8f60373b9 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:36.571359 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6d749-6c22-4f30-9ab3-73f8f60373b9 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:36.571642 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6d749-6c22-4f30-9ab3-73f8f60373b9 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:36.573573 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 124/244] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:34:36.579165 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbe78c-485d-4bac-88d3-f7a6374c0e72 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:36.579563 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbe78c-485d-4bac-88d3-f7a6374c0e72 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:36.579789 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbe78c-485d-4bac-88d3-f7a6374c0e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:36.627667 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-a7fbe78c-485d-4bac-88d3-f7a6374c0e72 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:36.631213 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-a7fbe78c-485d-4bac-88d3-f7a6374c0e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:36.647193 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ed945-5c6a-4e8a-9e71-b369034a5eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:36.648078 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ed945-5c6a-4e8a-9e71-b369034a5eda None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:36.648721 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ed945-5c6a-4e8a-9e71-b369034a5eda None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:36.649112 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ed945-5c6a-4e8a-9e71-b369034a5eda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:36.693759 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:36.800185 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ed945-5c6a-4e8a-9e71-b369034a5eda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:36.802397 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ed945-5c6a-4e8a-9e71-b369034a5eda None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:36.829781 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 125/245] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:34:36.886804 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:36.946512 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 121/246] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:34:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 607 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:34:36.952771 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbe78c-485d-4bac-88d3-f7a6374c0e72 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:37.063615 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56499e6-8216-4139-84a8-dafef28a3b6e None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:37.064220 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56499e6-8216-4139-84a8-dafef28a3b6e None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:37.064558 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56499e6-8216-4139-84a8-dafef28a3b6e None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:37.066379 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 122/247] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:34:37.077968 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2dabd-58e5-4538-b224-9c40dea23cac None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:37.077968 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2dabd-58e5-4538-b224-9c40dea23cac None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:37.077968 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2dabd-58e5-4538-b224-9c40dea23cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:37.115494 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-09e2dabd-58e5-4538-b224-9c40dea23cac None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:37.117263 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-09e2dabd-58e5-4538-b224-9c40dea23cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:37.177717 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbe78c-485d-4bac-88d3-f7a6374c0e72 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:37.229825 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e9b6bd-5ad3-4750-83a6-a700f8b60555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:37.230605 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9b6bd-5ad3-4750-83a6-a700f8b60555 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:37.230972 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9b6bd-5ad3-4750-83a6-a700f8b60555 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:37.231249 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9b6bd-5ad3-4750-83a6-a700f8b60555 None admin] PATH_INFO: `/v3/projects/06fa14b343d84890b6385d02bd48c9b7` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:37.232561 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e9b6bd-5ad3-4750-83a6-a700f8b60555 None admin] RBAC: Authorizing `identity:get_project(project_id=06fa14b343d84890b6385d02bd48c9b7)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:37.234117 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 123/248] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:34:37.235022 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2dabd-58e5-4538-b224-9c40dea23cac None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:37.237660 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e9b6bd-5ad3-4750-83a6-a700f8b60555 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:37.240682 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 126/249] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:34:36 2022] GET /identity/v3/projects/06fa14b343d84890b6385d02bd48c9b7 => generated 302 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:37.249937 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e9b6bd-5ad3-4750-83a6-a700f8b60555 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:37.290848 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:37.392389 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:37.399068 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e9b6bd-5ad3-4750-83a6-a700f8b60555 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:37.430953 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2dabd-58e5-4538-b224-9c40dea23cac None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:37.453879 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f94653-2ebc-4ea8-ba4e-b9d07e5384c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:37.454085 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f94653-2ebc-4ea8-ba4e-b9d07e5384c6 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:37.454542 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f94653-2ebc-4ea8-ba4e-b9d07e5384c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:37.454971 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f94653-2ebc-4ea8-ba4e-b9d07e5384c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:37.456208 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f94653-2ebc-4ea8-ba4e-b9d07e5384c6 None admin] RBAC: Adding query filter params (role.id=ab9b8996e13a46418c5b25949af994de, scope.project.id=06fa14b343d84890b6385d02bd48c9b7, user.id=bcfbbfb35e5140bcae95a7859d0fa5e5) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:37.457102 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f94653-2ebc-4ea8-ba4e-b9d07e5384c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:37.464903 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f94653-2ebc-4ea8-ba4e-b9d07e5384c6 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:37.466794 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 127/250] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 8 13:34:37 2022] GET /identity/v3/role_assignments?user.id=bcfbbfb35e5140bcae95a7859d0fa5e5&scope.project.id=06fa14b343d84890b6385d02bd48c9b7&role.id=ab9b8996e13a46418c5b25949af994de => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:34:37.468158 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c80f5-25da-4112-8fcb-f34782a5597d None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:37.468443 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c80f5-25da-4112-8fcb-f34782a5597d None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:37.468720 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c80f5-25da-4112-8fcb-f34782a5597d None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:37.470415 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 128/251] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:34:37.477501 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aded2d2-27b6-42b7-8d56-b733d1bd5e39 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:37.477999 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aded2d2-27b6-42b7-8d56-b733d1bd5e39 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:37.478284 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aded2d2-27b6-42b7-8d56-b733d1bd5e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:37.506093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-3aded2d2-27b6-42b7-8d56-b733d1bd5e39 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:37.508781 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-3aded2d2-27b6-42b7-8d56-b733d1bd5e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:37.514238 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0df882-fed4-44f2-8ebe-3a04231ed881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:37.514901 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0df882-fed4-44f2-8ebe-3a04231ed881 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:37.515177 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0df882-fed4-44f2-8ebe-3a04231ed881 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:37.515620 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0df882-fed4-44f2-8ebe-3a04231ed881 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:37.546469 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0df882-fed4-44f2-8ebe-3a04231ed881 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:34:37.551548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-1a0df882-fed4-44f2-8ebe-3a04231ed881 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:34:37.551548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:34:37.551548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:34:37.551548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:34:37.551548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:34:37.551548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:34:37.551548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:34:37.551548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:34:37.551548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:34:37.551548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:34:37.551548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:34:37.551548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:34:37.551548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:34:37.551548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:34:37.551548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:34:37.551548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:34:37.552595 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:34:37.552595 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:34:37.552595 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:34:37.552595 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:34:37.552595 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:34:37.552595 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:34:37.552595 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:34:37.552595 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:34:37.552595 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:34:37.552595 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:34:37.552595 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:34:37.552595 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:34:37.552595 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:34:37.552595 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:34:37.552595 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:34:37.552595 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:34:37.553445 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:34:37.553445 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:34:37.553445 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:34:37.553445 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:34:37.553445 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:34:37.553445 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:34:37.553445 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:34:37.553445 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:34:37.553445 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:34:37.553445 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:34:37.553445 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:34:37.553445 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:34:37.553445 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 124/252] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:34:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:34:37.560306 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0df882-fed4-44f2-8ebe-3a04231ed881 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:37.638110 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 129/253] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:34:37.779490 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0df882-fed4-44f2-8ebe-3a04231ed881 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:37.791294 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aded2d2-27b6-42b7-8d56-b733d1bd5e39 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:37.830107 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:37.850163 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac529d57-5cd6-4827-a5d0-dde2f542c278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:37.850841 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac529d57-5cd6-4827-a5d0-dde2f542c278 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:37.851153 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac529d57-5cd6-4827-a5d0-dde2f542c278 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:37.851465 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac529d57-5cd6-4827-a5d0-dde2f542c278 None admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:37.852153 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac529d57-5cd6-4827-a5d0-dde2f542c278 None admin] RBAC: Adding query filter params (name=member) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:37.852454 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac529d57-5cd6-4827-a5d0-dde2f542c278 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:37.853908 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac529d57-5cd6-4827-a5d0-dde2f542c278 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:37.874999 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 125/254] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 8 13:34:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:37.880809 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac529d57-5cd6-4827-a5d0-dde2f542c278 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:37.908312 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:38.063426 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aded2d2-27b6-42b7-8d56-b733d1bd5e39 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:38.171428 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac529d57-5cd6-4827-a5d0-dde2f542c278 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:38.176187 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b1cd52-e20b-4c30-9c14-48480452eb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:38.176833 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1cd52-e20b-4c30-9c14-48480452eb9d None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:38.177109 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1cd52-e20b-4c30-9c14-48480452eb9d None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:38.177588 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1cd52-e20b-4c30-9c14-48480452eb9d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:38.208191 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b1cd52-e20b-4c30-9c14-48480452eb9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:34:38.219239 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-60b1cd52-e20b-4c30-9c14-48480452eb9d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:34:38.219239 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:34:38.219239 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:34:38.219239 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:34:38.219239 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:34:38.219239 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:34:38.219239 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:34:38.219239 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:34:38.219239 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:34:38.219239 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:34:38.219239 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:34:38.219239 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:34:38.219239 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:34:38.219239 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:34:38.219239 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:34:38.219239 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:34:38.221083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:34:38.221083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:34:38.221083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:34:38.221083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:34:38.221083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:34:38.221083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:34:38.221083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:34:38.221083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:34:38.221083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:34:38.221083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:34:38.221083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:34:38.221083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:34:38.221083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:34:38.221083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:34:38.221083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:34:38.221083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:34:38.224615 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:34:38.224615 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:34:38.224615 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:34:38.224615 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:34:38.224615 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:34:38.224615 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:34:38.224615 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:34:38.224615 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:34:38.224615 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:34:38.224615 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:34:38.224615 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:34:38.224615 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:34:38.224615 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 130/255] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 8 13:34:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 430 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:34:38.224615 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b1cd52-e20b-4c30-9c14-48480452eb9d None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:38.266985 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6542c6c-2f1a-4ab0-9f4a-ec29d0aa5352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:38.267631 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6542c6c-2f1a-4ab0-9f4a-ec29d0aa5352 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:38.267907 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6542c6c-2f1a-4ab0-9f4a-ec29d0aa5352 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:38.268176 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6542c6c-2f1a-4ab0-9f4a-ec29d0aa5352 None admin] PATH_INFO: `/v3/users/1a61c7a326a148c08d57b5468e6108a8` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:38.269595 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6542c6c-2f1a-4ab0-9f4a-ec29d0aa5352 None admin] RBAC: Authorizing `identity:get_user(user_id=1a61c7a326a148c08d57b5468e6108a8)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:38.271099 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6542c6c-2f1a-4ab0-9f4a-ec29d0aa5352 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:38.278523 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 126/256] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:34:37 2022] GET /identity/v3/users/1a61c7a326a148c08d57b5468e6108a8 => generated 297 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:38.279709 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6542c6c-2f1a-4ab0-9f4a-ec29d0aa5352 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:38.369812 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:38.420041 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b1cd52-e20b-4c30-9c14-48480452eb9d None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:38.454664 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:38.499049 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943b7c9-2fae-4b17-9b3a-8055b3fabba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:38.499774 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943b7c9-2fae-4b17-9b3a-8055b3fabba8 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:38.500051 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943b7c9-2fae-4b17-9b3a-8055b3fabba8 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:38.500356 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943b7c9-2fae-4b17-9b3a-8055b3fabba8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:38.512637 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6542c6c-2f1a-4ab0-9f4a-ec29d0aa5352 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:38.530656 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943b7c9-2fae-4b17-9b3a-8055b3fabba8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:34:38.537772 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-4943b7c9-2fae-4b17-9b3a-8055b3fabba8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:34:38.537772 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:34:38.537772 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:34:38.537772 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:34:38.537772 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:34:38.537772 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:34:38.537772 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:34:38.537772 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:34:38.537772 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:34:38.537772 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:34:38.537772 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:34:38.537772 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:34:38.537772 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:34:38.537772 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:34:38.537772 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:34:38.537772 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:34:38.538747 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:34:38.538747 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:34:38.538747 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:34:38.538747 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:34:38.538747 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:34:38.538747 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:34:38.538747 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:34:38.538747 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:34:38.538747 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:34:38.538747 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:34:38.538747 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:34:38.538747 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:34:38.538747 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:34:38.538747 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:34:38.538747 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:34:38.538747 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:34:38.539741 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:34:38.539741 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:34:38.539741 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:34:38.539741 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:34:38.539741 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:34:38.539741 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:34:38.539741 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:34:38.539741 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:34:38.539741 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:34:38.539741 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:34:38.539741 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:34:38.539741 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:34:38.540351 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 131/257] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Sep 8 13:34:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:34:38.547774 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943b7c9-2fae-4b17-9b3a-8055b3fabba8 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:38.598225 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4cad1-2400-4eb3-94b5-3e0a1628e4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:38.599106 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4cad1-2400-4eb3-94b5-3e0a1628e4de None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:38.599384 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4cad1-2400-4eb3-94b5-3e0a1628e4de None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:38.599655 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4cad1-2400-4eb3-94b5-3e0a1628e4de None admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:38.600338 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a4cad1-2400-4eb3-94b5-3e0a1628e4de None admin] RBAC: Adding query filter params (name=admin) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:38.600708 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a4cad1-2400-4eb3-94b5-3e0a1628e4de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:38.602159 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a4cad1-2400-4eb3-94b5-3e0a1628e4de None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:38.626655 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 127/258] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:34:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:38.627940 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4cad1-2400-4eb3-94b5-3e0a1628e4de None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:38.792256 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943b7c9-2fae-4b17-9b3a-8055b3fabba8 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:38.869349 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4cad1-2400-4eb3-94b5-3e0a1628e4de None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:38.901590 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f557fbf8-c9dc-4d46-9773-bb88feea9d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:38.902599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557fbf8-c9dc-4d46-9773-bb88feea9d18 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:38.903085 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557fbf8-c9dc-4d46-9773-bb88feea9d18 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:38.903575 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557fbf8-c9dc-4d46-9773-bb88feea9d18 None admin] PATH_INFO: `/v3/projects/06fa14b343d84890b6385d02bd48c9b7` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:38.907842 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f557fbf8-c9dc-4d46-9773-bb88feea9d18 None admin] RBAC: Authorizing `identity:get_project(project_id=06fa14b343d84890b6385d02bd48c9b7)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:38.910605 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f557fbf8-c9dc-4d46-9773-bb88feea9d18 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:38.914411 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 132/259] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:34:38 2022] GET /identity/v3/projects/06fa14b343d84890b6385d02bd48c9b7 => generated 302 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:38.915915 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f557fbf8-c9dc-4d46-9773-bb88feea9d18 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:38.957754 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:38.981799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56941cf-4b4b-4882-8ef0-e091df05ee02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:38.982770 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56941cf-4b4b-4882-8ef0-e091df05ee02 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:38.983260 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56941cf-4b4b-4882-8ef0-e091df05ee02 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:38.983742 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56941cf-4b4b-4882-8ef0-e091df05ee02 None admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:38.985052 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56941cf-4b4b-4882-8ef0-e091df05ee02 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:38.985666 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56941cf-4b4b-4882-8ef0-e091df05ee02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:38.988465 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56941cf-4b4b-4882-8ef0-e091df05ee02 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:38.996902 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:39.019827 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 128/260] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:34:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:39.028820 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56941cf-4b4b-4882-8ef0-e091df05ee02 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:39.186724 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56941cf-4b4b-4882-8ef0-e091df05ee02 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:39.204408 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f557fbf8-c9dc-4d46-9773-bb88feea9d18 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:39.231237 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e1c4c-1f34-4e71-b0af-20b627861d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:39.232015 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e1c4c-1f34-4e71-b0af-20b627861d83 None admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:39.232283 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e1c4c-1f34-4e71-b0af-20b627861d83 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:39.232557 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e1c4c-1f34-4e71-b0af-20b627861d83 None admin] PATH_INFO: `/v3/projects/06fa14b343d84890b6385d02bd48c9b7/users/1a61c7a326a148c08d57b5468e6108a8/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:39.237001 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e1c4c-1f34-4e71-b0af-20b627861d83 None admin] RBAC: Authorizing `identity:create_grant(project_id=06fa14b343d84890b6385d02bd48c9b7, user_id=1a61c7a326a148c08d57b5468e6108a8, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:39.239824 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e1c4c-1f34-4e71-b0af-20b627861d83 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:39.263907 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 129/261] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Sep 8 13:34:39 2022] PUT /identity/v3/projects/06fa14b343d84890b6385d02bd48c9b7/users/1a61c7a326a148c08d57b5468e6108a8/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:34:39.265436 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e1c4c-1f34-4e71-b0af-20b627861d83 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:39.299200 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c1a95-417a-464b-86f5-0a293e71b8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:39.300001 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c1a95-417a-464b-86f5-0a293e71b8f8 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:39.300432 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c1a95-417a-464b-86f5-0a293e71b8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:39.300711 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c1a95-417a-464b-86f5-0a293e71b8f8 None admin] PATH_INFO: `/v3/users/0b020dd3d55648628517de11c664bea5` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:39.302814 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c1a95-417a-464b-86f5-0a293e71b8f8 None admin] RBAC: Authorizing `identity:get_user(user_id=0b020dd3d55648628517de11c664bea5)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:39.306660 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c1a95-417a-464b-86f5-0a293e71b8f8 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:39.313475 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 133/262] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:34:38 2022] GET /identity/v3/users/0b020dd3d55648628517de11c664bea5 => generated 283 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:39.327181 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c1a95-417a-464b-86f5-0a293e71b8f8 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:39.433805 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:39.523582 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:39.531733 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e1c4c-1f34-4e71-b0af-20b627861d83 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:39.590559 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c1a95-417a-464b-86f5-0a293e71b8f8 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:39.605470 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee9d84-7f04-454e-98c8-d9fed61e6806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:39.606115 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee9d84-7f04-454e-98c8-d9fed61e6806 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:39.606379 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee9d84-7f04-454e-98c8-d9fed61e6806 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:39.606661 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee9d84-7f04-454e-98c8-d9fed61e6806 None admin] PATH_INFO: `/v3/users/0b020dd3d55648628517de11c664bea5` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:39.607839 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abee9d84-7f04-454e-98c8-d9fed61e6806 None admin] RBAC: Authorizing `identity:get_user(user_id=0b020dd3d55648628517de11c664bea5)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:39.609562 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abee9d84-7f04-454e-98c8-d9fed61e6806 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:39.611964 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 130/263] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:34:39 2022] GET /identity/v3/users/0b020dd3d55648628517de11c664bea5 => generated 283 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:39.618947 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee9d84-7f04-454e-98c8-d9fed61e6806 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:39.650128 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62075b03-9208-47b9-807f-5cc6b6add2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:39.651680 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62075b03-9208-47b9-807f-5cc6b6add2b5 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:39.652408 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62075b03-9208-47b9-807f-5cc6b6add2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:39.653142 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62075b03-9208-47b9-807f-5cc6b6add2b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:39.749400 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62075b03-9208-47b9-807f-5cc6b6add2b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:39.749400 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62075b03-9208-47b9-807f-5cc6b6add2b5 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:39.770455 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee9d84-7f04-454e-98c8-d9fed61e6806 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:39.824404 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:39.849102 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da81ad7c-7903-4444-98d0-9ee6f1b7516e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:39.849759 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81ad7c-7903-4444-98d0-9ee6f1b7516e None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:39.850039 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81ad7c-7903-4444-98d0-9ee6f1b7516e None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:39.850312 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da81ad7c-7903-4444-98d0-9ee6f1b7516e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:39.987218 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:39.998240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da81ad7c-7903-4444-98d0-9ee6f1b7516e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:39.999713 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da81ad7c-7903-4444-98d0-9ee6f1b7516e None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:40.075084 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 134/264] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:34:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 749 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 08 13:34:40.081305 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62075b03-9208-47b9-807f-5cc6b6add2b5 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:40.203199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 131/265] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:34:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:34:40.227072 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da81ad7c-7903-4444-98d0-9ee6f1b7516e None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:40.281390 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:40.282006 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62075b03-9208-47b9-807f-5cc6b6add2b5 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:40.351403 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9482b36-f185-4141-8928-88c21f95ad0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:40.352379 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9482b36-f185-4141-8928-88c21f95ad0f None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:40.352842 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9482b36-f185-4141-8928-88c21f95ad0f None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:40.353318 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9482b36-f185-4141-8928-88c21f95ad0f None admin] PATH_INFO: `/v3/projects/06fa14b343d84890b6385d02bd48c9b7` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:40.356378 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9482b36-f185-4141-8928-88c21f95ad0f None admin] RBAC: Authorizing `identity:get_project(project_id=06fa14b343d84890b6385d02bd48c9b7)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:40.358169 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9482b36-f185-4141-8928-88c21f95ad0f None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:40.360841 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 135/266] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:34:40 2022] GET /identity/v3/projects/06fa14b343d84890b6385d02bd48c9b7 => generated 302 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:40.367997 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9482b36-f185-4141-8928-88c21f95ad0f None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:40.417944 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:40.425393 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da81ad7c-7903-4444-98d0-9ee6f1b7516e None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:40.478336 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e574355-675f-4e05-b02b-883322fb821a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:40.479029 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e574355-675f-4e05-b02b-883322fb821a None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:40.479310 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e574355-675f-4e05-b02b-883322fb821a None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:40.479577 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e574355-675f-4e05-b02b-883322fb821a None admin] PATH_INFO: `/v3/projects/06fa14b343d84890b6385d02bd48c9b7` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:40.481000 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e574355-675f-4e05-b02b-883322fb821a None admin] RBAC: Authorizing `identity:get_project(project_id=06fa14b343d84890b6385d02bd48c9b7)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:40.485387 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e574355-675f-4e05-b02b-883322fb821a None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:40.485387 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 132/267] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:34:40 2022] GET /identity/v3/projects/06fa14b343d84890b6385d02bd48c9b7 => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:40.490275 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e574355-675f-4e05-b02b-883322fb821a None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:40.529415 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9482b36-f185-4141-8928-88c21f95ad0f None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:40.602642 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5414c7d-42ac-4160-98be-523e37043afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:40.604007 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5414c7d-42ac-4160-98be-523e37043afe None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:40.604662 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5414c7d-42ac-4160-98be-523e37043afe None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:40.605387 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5414c7d-42ac-4160-98be-523e37043afe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:40.607181 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5414c7d-42ac-4160-98be-523e37043afe None admin] RBAC: Adding query filter params (role.id=9c76f398c9e04caeab83842e70eb824b, scope.project.id=06fa14b343d84890b6385d02bd48c9b7, user.id=0b020dd3d55648628517de11c664bea5) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:40.607997 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5414c7d-42ac-4160-98be-523e37043afe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:40.610877 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5414c7d-42ac-4160-98be-523e37043afe None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:40.625452 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 136/268] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 8 13:34:40 2022] GET /identity/v3/role_assignments?user.id=0b020dd3d55648628517de11c664bea5&scope.project.id=06fa14b343d84890b6385d02bd48c9b7&role.id=9c76f398c9e04caeab83842e70eb824b => generated 608 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:40.653837 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6f5c5-ef32-4437-9ed8-34dae1beefe4 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:40.654482 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6f5c5-ef32-4437-9ed8-34dae1beefe4 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:40.654956 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6f5c5-ef32-4437-9ed8-34dae1beefe4 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:40.656515 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 137/269] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:34:40.663511 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c096a-ffb6-4aee-9194-1052e1b05a6d None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:40.664098 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c096a-ffb6-4aee-9194-1052e1b05a6d None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:40.664594 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c096a-ffb6-4aee-9194-1052e1b05a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:40.666571 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:40.676113 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e574355-675f-4e05-b02b-883322fb821a None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:40.718509 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4946b27-e384-4548-923d-2636aefea32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:40.719469 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4946b27-e384-4548-923d-2636aefea32f None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:40.719989 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4946b27-e384-4548-923d-2636aefea32f None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:40.720450 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4946b27-e384-4548-923d-2636aefea32f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:40.721474 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4946b27-e384-4548-923d-2636aefea32f None admin] RBAC: Adding query filter params (role.id=a0b9865e737f48f2975da1bb8cb386b7, scope.project.id=06fa14b343d84890b6385d02bd48c9b7, user.id=0b020dd3d55648628517de11c664bea5) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:40.721768 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-678c096a-ffb6-4aee-9194-1052e1b05a6d None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:40.722148 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4946b27-e384-4548-923d-2636aefea32f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:40.723184 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-678c096a-ffb6-4aee-9194-1052e1b05a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:40.724247 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4946b27-e384-4548-923d-2636aefea32f None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:40.731470 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 133/270] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 8 13:34:40 2022] GET /identity/v3/role_assignments?user.id=0b020dd3d55648628517de11c664bea5&scope.project.id=06fa14b343d84890b6385d02bd48c9b7&role.id=a0b9865e737f48f2975da1bb8cb386b7 => generated 608 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:34:40.733073 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92fec8d-5401-4513-bd3e-766c7fb12880 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:40.733614 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92fec8d-5401-4513-bd3e-766c7fb12880 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:40.734106 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92fec8d-5401-4513-bd3e-766c7fb12880 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:40.735649 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 134/271] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:34:40.748197 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533ff0d-b135-43db-84be-f9213028e4c5 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:40.748864 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533ff0d-b135-43db-84be-f9213028e4c5 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:40.749456 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533ff0d-b135-43db-84be-f9213028e4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:40.793743 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-b533ff0d-b135-43db-84be-f9213028e4c5 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:40.795057 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-b533ff0d-b135-43db-84be-f9213028e4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:40.868541 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 138/272] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 08 13:34:40.942924 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 135/273] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:34:41.082580 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c3557-c9db-4c8b-8d09-7b9bad82fe38 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:41.083082 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c3557-c9db-4c8b-8d09-7b9bad82fe38 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:41.083182 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c3557-c9db-4c8b-8d09-7b9bad82fe38 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:41.084646 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 139/274] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:34:41.092041 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a6b6a-d9a7-4d13-9576-a2255d516721 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:41.092420 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a6b6a-d9a7-4d13-9576-a2255d516721 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:41.092613 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a6b6a-d9a7-4d13-9576-a2255d516721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:41.114137 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-cd7a6b6a-d9a7-4d13-9576-a2255d516721 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:41.115316 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-cd7a6b6a-d9a7-4d13-9576-a2255d516721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:41.200017 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 136/275] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:34:41.253957 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c3557-c9db-4c8b-8d09-7b9bad82fe38 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:41.284848 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a6b6a-d9a7-4d13-9576-a2255d516721 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:41.314508 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:41.322796 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:41.434568 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c3557-c9db-4c8b-8d09-7b9bad82fe38 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:41.450728 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a6b6a-d9a7-4d13-9576-a2255d516721 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:41.481831 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d093c-9b50-40f7-ab89-546c35bb9669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:41.482759 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d093c-9b50-40f7-ab89-546c35bb9669 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:41.483044 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d093c-9b50-40f7-ab89-546c35bb9669 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:41.483321 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6d093c-9b50-40f7-ab89-546c35bb9669 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:41.493864 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903beeaf-cd18-4e7c-836c-b8ec08a823fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:41.494591 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903beeaf-cd18-4e7c-836c-b8ec08a823fd None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:41.494870 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903beeaf-cd18-4e7c-836c-b8ec08a823fd None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:41.495140 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903beeaf-cd18-4e7c-836c-b8ec08a823fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:41.496315 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903beeaf-cd18-4e7c-836c-b8ec08a823fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:41.497208 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6d093c-9b50-40f7-ab89-546c35bb9669 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:34:41.497803 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903beeaf-cd18-4e7c-836c-b8ec08a823fd None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:41.499437 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 137/276] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:34:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:41.502408 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-7c6d093c-9b50-40f7-ab89-546c35bb9669 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:34:41.502408 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:34:41.502408 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:34:41.502408 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:34:41.502408 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:34:41.502408 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:34:41.502408 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:34:41.502408 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:34:41.502408 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:34:41.502408 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:34:41.502408 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:34:41.502408 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:34:41.502408 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:34:41.502408 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:34:41.502408 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:34:41.502408 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:34:41.503285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:34:41.503285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:34:41.503285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:34:41.503285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:34:41.503285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:34:41.503285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:34:41.503285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:34:41.503285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:34:41.503285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:34:41.503285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:34:41.503285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:34:41.503285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:34:41.503285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:34:41.503285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:34:41.503285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:34:41.503285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:34:41.504173 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:34:41.504173 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:34:41.504173 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:34:41.504173 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:34:41.504173 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:34:41.504173 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:34:41.504173 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:34:41.504173 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:34:41.504173 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:34:41.504173 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:34:41.504173 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:34:41.504173 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:34:41.504173 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 140/277] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:34:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:34:41.509388 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903beeaf-cd18-4e7c-836c-b8ec08a823fd None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:41.511788 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d093c-9b50-40f7-ab89-546c35bb9669 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:41.611794 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:41.629117 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:41.634179 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903beeaf-cd18-4e7c-836c-b8ec08a823fd None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:41.638563 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6d093c-9b50-40f7-ab89-546c35bb9669 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:41.679212 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca60f3-89c9-420b-be9b-5b34e2a27405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:41.679929 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca60f3-89c9-420b-be9b-5b34e2a27405 None admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:41.680117 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca60f3-89c9-420b-be9b-5b34e2a27405 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:41.680444 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca60f3-89c9-420b-be9b-5b34e2a27405 None admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:41.681059 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca60f3-89c9-420b-be9b-5b34e2a27405 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:41.681168 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d3aa3-4871-47de-85fb-44f0324aebc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:41.681724 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d3aa3-4871-47de-85fb-44f0324aebc2 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:41.682001 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d3aa3-4871-47de-85fb-44f0324aebc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:41.682267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d3aa3-4871-47de-85fb-44f0324aebc2 None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:41.682563 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca60f3-89c9-420b-be9b-5b34e2a27405 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:41.682943 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d3aa3-4871-47de-85fb-44f0324aebc2 None admin] RBAC: Adding query filter params (name=member) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:41.683246 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d3aa3-4871-47de-85fb-44f0324aebc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:41.684643 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d3aa3-4871-47de-85fb-44f0324aebc2 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:41.698860 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 141/278] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 8 13:34:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:34:41.703998 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d3aa3-4871-47de-85fb-44f0324aebc2 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:41.715896 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 138/279] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Sep 8 13:34:41 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:34:41.716678 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca60f3-89c9-420b-be9b-5b34e2a27405 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:41.849247 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca60f3-89c9-420b-be9b-5b34e2a27405 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:41.854598 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d3aa3-4871-47de-85fb-44f0324aebc2 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:41.899328 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58976fe-b91b-4c5f-beb0-174d5709728c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:41.900085 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58976fe-b91b-4c5f-beb0-174d5709728c None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:41.900430 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58976fe-b91b-4c5f-beb0-174d5709728c None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:41.900770 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58976fe-b91b-4c5f-beb0-174d5709728c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:41.912313 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec29602-cee1-40b5-b64e-5eafc56434d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:41.913740 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec29602-cee1-40b5-b64e-5eafc56434d0 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:41.914233 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec29602-cee1-40b5-b64e-5eafc56434d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:41.914659 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec29602-cee1-40b5-b64e-5eafc56434d0 None admin] PATH_INFO: `/v3/users/604bd65046ae44a78a5a4342d3291b3b` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:41.920165 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58976fe-b91b-4c5f-beb0-174d5709728c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:34:41.926574 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-d58976fe-b91b-4c5f-beb0-174d5709728c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:34:41.926574 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:34:41.926574 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:34:41.926574 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:34:41.926574 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:34:41.926574 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:34:41.926574 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:34:41.926574 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:34:41.926574 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:34:41.926574 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:34:41.926574 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:34:41.926574 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:34:41.926574 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:34:41.926574 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:34:41.926574 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:34:41.926574 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:34:41.927508 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:34:41.927508 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:34:41.927508 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:34:41.927508 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:34:41.927508 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:34:41.927508 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:34:41.927508 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:34:41.927508 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:34:41.927508 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:34:41.927508 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:34:41.927508 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:34:41.927508 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:34:41.927508 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:34:41.927508 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:34:41.927508 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:34:41.927508 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:34:41.928301 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:34:41.928301 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:34:41.928301 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:34:41.928301 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:34:41.928301 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:34:41.928301 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:34:41.928301 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:34:41.928301 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:34:41.928301 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:34:41.928301 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:34:41.928301 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:34:41.928301 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:34:41.930660 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 142/280] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:34:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:34:41.936044 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:41.937277 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58976fe-b91b-4c5f-beb0-174d5709728c None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:41.940143 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec29602-cee1-40b5-b64e-5eafc56434d0 None admin] RBAC: Authorizing `identity:get_user(user_id=604bd65046ae44a78a5a4342d3291b3b)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:41.942311 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec29602-cee1-40b5-b64e-5eafc56434d0 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:41.949327 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 139/281] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:34:41 2022] GET /identity/v3/users/604bd65046ae44a78a5a4342d3291b3b => generated 293 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:41.952530 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec29602-cee1-40b5-b64e-5eafc56434d0 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:41.965034 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:42.081261 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec29602-cee1-40b5-b64e-5eafc56434d0 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:42.083569 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58976fe-b91b-4c5f-beb0-174d5709728c None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:42.120911 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877b1d1-c3c4-4d3c-adde-a2eb296d9ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:42.121571 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877b1d1-c3c4-4d3c-adde-a2eb296d9ed2 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:42.121851 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877b1d1-c3c4-4d3c-adde-a2eb296d9ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:42.122126 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877b1d1-c3c4-4d3c-adde-a2eb296d9ed2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:42.122865 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b877b1d1-c3c4-4d3c-adde-a2eb296d9ed2 None admin] RBAC: Adding query filter params (role.id=0735c260e70441cc87ad611b789d5c56, user.id=604bd65046ae44a78a5a4342d3291b3b, scope.system=all) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:42.123174 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b877b1d1-c3c4-4d3c-adde-a2eb296d9ed2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:42.124657 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b877b1d1-c3c4-4d3c-adde-a2eb296d9ed2 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:42.130502 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 140/282] 10.222.0.69 () {56 vars in 1308 bytes} [Thu Sep 8 13:34:41 2022] GET /identity/v3/role_assignments?user.id=604bd65046ae44a78a5a4342d3291b3b&scope.system=all&role.id=0735c260e70441cc87ad611b789d5c56 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:34:42.132578 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec3b4f-c6c8-48e2-a808-88ee8a383dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:42.133425 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec3b4f-c6c8-48e2-a808-88ee8a383dcc None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:42.133848 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec3b4f-c6c8-48e2-a808-88ee8a383dcc None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:42.134278 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec3b4f-c6c8-48e2-a808-88ee8a383dcc None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:42.135123 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec3b4f-c6c8-48e2-a808-88ee8a383dcc None admin] RBAC: Adding query filter params (name=reader) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:42.135577 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec3b4f-c6c8-48e2-a808-88ee8a383dcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:42.137132 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec3b4f-c6c8-48e2-a808-88ee8a383dcc None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:42.154758 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 143/283] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 8 13:34:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:34:42.156707 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877b1d1-c3c4-4d3c-adde-a2eb296d9ed2 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:42.242246 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:42.294508 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877b1d1-c3c4-4d3c-adde-a2eb296d9ed2 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:42.338730 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088a5650-50ca-43d6-b3cc-f57b0d24ff62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:42.339386 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a5650-50ca-43d6-b3cc-f57b0d24ff62 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:42.339661 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a5650-50ca-43d6-b3cc-f57b0d24ff62 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:42.339931 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088a5650-50ca-43d6-b3cc-f57b0d24ff62 None admin] PATH_INFO: `/v3/users/bcfbbfb35e5140bcae95a7859d0fa5e5` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:42.341292 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088a5650-50ca-43d6-b3cc-f57b0d24ff62 None admin] RBAC: Authorizing `identity:get_user(user_id=bcfbbfb35e5140bcae95a7859d0fa5e5)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:42.342828 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088a5650-50ca-43d6-b3cc-f57b0d24ff62 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:42.344541 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 141/284] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:34:42 2022] GET /identity/v3/users/bcfbbfb35e5140bcae95a7859d0fa5e5 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:42.353029 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec3b4f-c6c8-48e2-a808-88ee8a383dcc None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:42.375561 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b439b1d-d009-4988-9c59-9b9e0487a799 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:42.375906 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b439b1d-d009-4988-9c59-9b9e0487a799 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:42.376110 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b439b1d-d009-4988-9c59-9b9e0487a799 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:42.377555 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 142/285] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:34:42.383917 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e12cd-2cbe-4765-8f97-923348bafbf2 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:42.384279 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e12cd-2cbe-4765-8f97-923348bafbf2 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:42.384556 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e12cd-2cbe-4765-8f97-923348bafbf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:42.403747 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-d26e12cd-2cbe-4765-8f97-923348bafbf2 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:42.404937 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-d26e12cd-2cbe-4765-8f97-923348bafbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:42.478755 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:42.493675 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 143/286] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:34:42.502748 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec3b4f-c6c8-48e2-a808-88ee8a383dcc None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:42.540386 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42351a7-80e6-4a84-a1e9-c20c723e0438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:42.541025 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42351a7-80e6-4a84-a1e9-c20c723e0438 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:42.541300 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42351a7-80e6-4a84-a1e9-c20c723e0438 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:42.541614 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42351a7-80e6-4a84-a1e9-c20c723e0438 None admin] PATH_INFO: `/v3/projects/06fa14b343d84890b6385d02bd48c9b7` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:42.542960 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42351a7-80e6-4a84-a1e9-c20c723e0438 None admin] RBAC: Authorizing `identity:get_project(project_id=06fa14b343d84890b6385d02bd48c9b7)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:42.544468 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42351a7-80e6-4a84-a1e9-c20c723e0438 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:42.549444 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 144/287] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:34:42 2022] GET /identity/v3/projects/06fa14b343d84890b6385d02bd48c9b7 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:42.552444 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e12cd-2cbe-4765-8f97-923348bafbf2 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:42.621290 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:42.680149 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e12cd-2cbe-4765-8f97-923348bafbf2 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:42.728591 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a9de0-f561-43e9-975d-8acabf78ea03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:42.729259 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a9de0-f561-43e9-975d-8acabf78ea03 None admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:42.729558 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a9de0-f561-43e9-975d-8acabf78ea03 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:42.729825 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a9de0-f561-43e9-975d-8acabf78ea03 None admin] PATH_INFO: `/v3/projects/06fa14b343d84890b6385d02bd48c9b7/users/bcfbbfb35e5140bcae95a7859d0fa5e5/roles/ab9b8996e13a46418c5b25949af994de` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:42.731754 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157a9de0-f561-43e9-975d-8acabf78ea03 None admin] RBAC: Authorizing `identity:create_grant(project_id=06fa14b343d84890b6385d02bd48c9b7, user_id=bcfbbfb35e5140bcae95a7859d0fa5e5, role_id=ab9b8996e13a46418c5b25949af994de)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:42.733184 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157a9de0-f561-43e9-975d-8acabf78ea03 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:42.755320 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 144/288] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Sep 8 13:34:42 2022] PUT /identity/v3/projects/06fa14b343d84890b6385d02bd48c9b7/users/bcfbbfb35e5140bcae95a7859d0fa5e5/roles/ab9b8996e13a46418c5b25949af994de => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:34:42.774365 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42351a7-80e6-4a84-a1e9-c20c723e0438 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:42.951130 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42351a7-80e6-4a84-a1e9-c20c723e0438 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:43.012199 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8bee0-5034-49d3-a776-044f8fd9b5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:43.012786 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8bee0-5034-49d3-a776-044f8fd9b5f3 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:43.013036 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8bee0-5034-49d3-a776-044f8fd9b5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:43.013309 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8bee0-5034-49d3-a776-044f8fd9b5f3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:43.028113 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de8bee0-5034-49d3-a776-044f8fd9b5f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:34:43.035775 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-8de8bee0-5034-49d3-a776-044f8fd9b5f3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:34:43.035775 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:34:43.035775 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:34:43.035775 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:34:43.035775 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:34:43.035775 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:34:43.035775 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:34:43.035775 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:34:43.035775 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:34:43.035775 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:34:43.035775 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:34:43.035775 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:34:43.035775 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:34:43.035775 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:34:43.035775 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:34:43.035775 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:34:43.036811 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:34:43.036811 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:34:43.036811 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:34:43.036811 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:34:43.036811 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:34:43.036811 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:34:43.036811 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:34:43.036811 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:34:43.036811 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:34:43.036811 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:34:43.036811 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:34:43.036811 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:34:43.036811 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:34:43.036811 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:34:43.036811 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:34:43.036811 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:34:43.037775 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:34:43.037775 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:34:43.037775 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:34:43.037775 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:34:43.037775 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:34:43.037775 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:34:43.037775 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:34:43.037775 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:34:43.037775 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:34:43.037775 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:34:43.037775 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:34:43.037775 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:34:43.037775 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 145/289] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:34:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:34:43.044665 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a9de0-f561-43e9-975d-8acabf78ea03 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:43.243863 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a9de0-f561-43e9-975d-8acabf78ea03 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:43.286257 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:43.307375 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad4217-1bd3-4b07-8b11-ddfc44dfc5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:43.308377 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad4217-1bd3-4b07-8b11-ddfc44dfc5ad None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:43.308851 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad4217-1bd3-4b07-8b11-ddfc44dfc5ad None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:43.309322 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad4217-1bd3-4b07-8b11-ddfc44dfc5ad None admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:43.310478 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ad4217-1bd3-4b07-8b11-ddfc44dfc5ad None admin] RBAC: Adding query filter params (name=member) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:43.311005 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ad4217-1bd3-4b07-8b11-ddfc44dfc5ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:43.313542 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ad4217-1bd3-4b07-8b11-ddfc44dfc5ad None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:43.329045 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 145/290] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 8 13:34:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:43.338460 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8bee0-5034-49d3-a776-044f8fd9b5f3 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:43.358922 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:43.550279 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8bee0-5034-49d3-a776-044f8fd9b5f3 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:43.638217 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be85d5-9bfe-467b-a6e6-31c5fdab0806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:43.639232 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be85d5-9bfe-467b-a6e6-31c5fdab0806 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:43.639700 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be85d5-9bfe-467b-a6e6-31c5fdab0806 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:43.640177 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be85d5-9bfe-467b-a6e6-31c5fdab0806 None admin] PATH_INFO: `/v3/users/1a61c7a326a148c08d57b5468e6108a8` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:43.642155 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80be85d5-9bfe-467b-a6e6-31c5fdab0806 None admin] RBAC: Authorizing `identity:get_user(user_id=1a61c7a326a148c08d57b5468e6108a8)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:43.644849 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80be85d5-9bfe-467b-a6e6-31c5fdab0806 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:43.648224 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 146/291] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:34:43 2022] GET /identity/v3/users/1a61c7a326a148c08d57b5468e6108a8 => generated 297 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:34:43.656440 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad4217-1bd3-4b07-8b11-ddfc44dfc5ad None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:43.804170 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad4217-1bd3-4b07-8b11-ddfc44dfc5ad None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:43.862693 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f395bf8-621f-4635-a7bb-4e8bdb717d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:43.863317 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f395bf8-621f-4635-a7bb-4e8bdb717d2a None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:43.863595 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f395bf8-621f-4635-a7bb-4e8bdb717d2a None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:43.863861 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f395bf8-621f-4635-a7bb-4e8bdb717d2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:43.930366 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:43.952756 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f395bf8-621f-4635-a7bb-4e8bdb717d2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:43.954260 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f395bf8-621f-4635-a7bb-4e8bdb717d2a None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:44.088119 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 146/292] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:34:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 08 13:34:44.093784 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be85d5-9bfe-467b-a6e6-31c5fdab0806 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:44.212471 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:44.260011 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be85d5-9bfe-467b-a6e6-31c5fdab0806 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:44.321479 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd97124-2545-4705-ba94-cb9432f966a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:44.322135 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd97124-2545-4705-ba94-cb9432f966a9 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:44.322418 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd97124-2545-4705-ba94-cb9432f966a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:44.322695 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd97124-2545-4705-ba94-cb9432f966a9 None admin] PATH_INFO: `/v3/projects/06fa14b343d84890b6385d02bd48c9b7` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:44.324216 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd97124-2545-4705-ba94-cb9432f966a9 None admin] RBAC: Authorizing `identity:get_project(project_id=06fa14b343d84890b6385d02bd48c9b7)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:44.329771 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd97124-2545-4705-ba94-cb9432f966a9 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:44.331661 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 147/293] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:34:44 2022] GET /identity/v3/projects/06fa14b343d84890b6385d02bd48c9b7 => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:44.338575 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f395bf8-621f-4635-a7bb-4e8bdb717d2a None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:44.503264 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:44.529828 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f395bf8-621f-4635-a7bb-4e8bdb717d2a None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:44.575848 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08cfede-312e-4b56-86ff-e503bc1a2ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:44.576536 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cfede-312e-4b56-86ff-e503bc1a2ce5 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:44.576849 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cfede-312e-4b56-86ff-e503bc1a2ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:44.577262 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08cfede-312e-4b56-86ff-e503bc1a2ce5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:44.578191 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08cfede-312e-4b56-86ff-e503bc1a2ce5 None admin] RBAC: Adding query filter params (role.id=0735c260e70441cc87ad611b789d5c56, scope.project.id=06fa14b343d84890b6385d02bd48c9b7, user.id=1a61c7a326a148c08d57b5468e6108a8) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:44.578636 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08cfede-312e-4b56-86ff-e503bc1a2ce5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:44.581172 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08cfede-312e-4b56-86ff-e503bc1a2ce5 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:44.596444 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 147/294] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 8 13:34:44 2022] GET /identity/v3/role_assignments?user.id=1a61c7a326a148c08d57b5468e6108a8&scope.project.id=06fa14b343d84890b6385d02bd48c9b7&role.id=0735c260e70441cc87ad611b789d5c56 => generated 608 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:44.892508 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d89b43-f441-45ee-9458-e375c8bfb016 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:44.893205 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d89b43-f441-45ee-9458-e375c8bfb016 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:44.893205 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d89b43-f441-45ee-9458-e375c8bfb016 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:44.894601 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 148/295] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:34:44.902028 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7101b-1646-45c6-89bf-4f010ca16a1e None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:44.902532 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7101b-1646-45c6-89bf-4f010ca16a1e None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:44.902627 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7101b-1646-45c6-89bf-4f010ca16a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:44.929823 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-0db7101b-1646-45c6-89bf-4f010ca16a1e None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:44.931841 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-0db7101b-1646-45c6-89bf-4f010ca16a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:45.040391 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 148/296] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:34:45.395829 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ead18-60eb-4ea8-9145-f564b0b0a98a None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:45.396255 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ead18-60eb-4ea8-9145-f564b0b0a98a None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:45.396440 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ead18-60eb-4ea8-9145-f564b0b0a98a None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:45.399115 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 149/297] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:34:45.407258 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a83297-97f9-4cc5-aa11-840b2761993d None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:45.408080 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a83297-97f9-4cc5-aa11-840b2761993d None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:45.408645 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a83297-97f9-4cc5-aa11-840b2761993d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:45.424719 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af3abe-f400-4b72-8202-c6bbec1e5224 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:45.425198 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af3abe-f400-4b72-8202-c6bbec1e5224 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:45.425198 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af3abe-f400-4b72-8202-c6bbec1e5224 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:45.427554 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 150/298] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:34:45.428319 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af3abe-f400-4b72-8202-c6bbec1e5224 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:45.437765 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-66a83297-97f9-4cc5-aa11-840b2761993d None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:45.439114 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-66a83297-97f9-4cc5-aa11-840b2761993d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:45.526814 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 149/299] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:34:45.528548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5444bf-a87f-4c96-ad28-7a2332f07325 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:45.528845 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5444bf-a87f-4c96-ad28-7a2332f07325 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:45.529105 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5444bf-a87f-4c96-ad28-7a2332f07325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:45.550805 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-9a5444bf-a87f-4c96-ad28-7a2332f07325 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:45.552369 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-9a5444bf-a87f-4c96-ad28-7a2332f07325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:45.555529 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:45.606221 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af3abe-f400-4b72-8202-c6bbec1e5224 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:45.640042 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 150/300] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:34:45.658955 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903ee75-8194-4670-8fce-4056e847cf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:45.660000 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903ee75-8194-4670-8fce-4056e847cf21 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:45.660485 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903ee75-8194-4670-8fce-4056e847cf21 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:45.660981 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903ee75-8194-4670-8fce-4056e847cf21 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:45.673723 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5903ee75-8194-4670-8fce-4056e847cf21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:34:45.679570 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-5903ee75-8194-4670-8fce-4056e847cf21 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:34:45.679570 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:34:45.679570 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:34:45.679570 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:34:45.679570 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:34:45.679570 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:34:45.679570 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:34:45.679570 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:34:45.679570 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:34:45.679570 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:34:45.679570 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:34:45.679570 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:34:45.679570 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:34:45.679570 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:34:45.679570 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:34:45.679570 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:34:45.680588 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:34:45.680588 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:34:45.680588 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:34:45.680588 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:34:45.680588 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:34:45.680588 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:34:45.680588 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:34:45.680588 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:34:45.680588 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:34:45.680588 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:34:45.680588 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:34:45.680588 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:34:45.680588 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:34:45.680588 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:34:45.680588 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:34:45.680588 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:34:45.681473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:34:45.681473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:34:45.681473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:34:45.681473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:34:45.681473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:34:45.681473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:34:45.681473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:34:45.681473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:34:45.681473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:34:45.681473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:34:45.681473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:34:45.681473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:34:45.683708 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 151/301] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:34:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:34:45.689641 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5444bf-a87f-4c96-ad28-7a2332f07325 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:45.822334 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903ee75-8194-4670-8fce-4056e847cf21 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:45.827224 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:45.830860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5444bf-a87f-4c96-ad28-7a2332f07325 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:45.887959 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd710c-a15d-471f-9cca-9be6286694dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:45.889080 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd710c-a15d-471f-9cca-9be6286694dc None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:45.889625 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd710c-a15d-471f-9cca-9be6286694dc None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:45.890095 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd710c-a15d-471f-9cca-9be6286694dc None admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:45.891046 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcd710c-a15d-471f-9cca-9be6286694dc None admin] RBAC: Adding query filter params (name=reader) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:45.891573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcd710c-a15d-471f-9cca-9be6286694dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:45.893278 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcd710c-a15d-471f-9cca-9be6286694dc None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:45.903053 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 151/302] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 8 13:34:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:45.903648 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:45.909255 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd710c-a15d-471f-9cca-9be6286694dc None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:45.964751 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903ee75-8194-4670-8fce-4056e847cf21 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:45.999174 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6796ace-48b0-495b-9fcd-ca191ea92ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:45.999797 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6796ace-48b0-495b-9fcd-ca191ea92ee8 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:46.000061 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6796ace-48b0-495b-9fcd-ca191ea92ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:46.000326 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6796ace-48b0-495b-9fcd-ca191ea92ee8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:46.011174 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6796ace-48b0-495b-9fcd-ca191ea92ee8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:34:46.016324 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd710c-a15d-471f-9cca-9be6286694dc None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:46.016466 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-f6796ace-48b0-495b-9fcd-ca191ea92ee8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:34:46.016466 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:34:46.016466 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:34:46.016466 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:34:46.016466 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:34:46.016466 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:34:46.016466 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:34:46.016466 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:34:46.016466 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:34:46.016466 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:34:46.016466 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:34:46.016466 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:34:46.016466 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:34:46.016466 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:34:46.016466 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:34:46.016466 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:34:46.022894 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:34:46.022894 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:34:46.022894 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:34:46.022894 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:34:46.022894 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:34:46.022894 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:34:46.022894 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:34:46.022894 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:34:46.022894 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:34:46.022894 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:34:46.022894 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:34:46.022894 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:34:46.022894 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:34:46.022894 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:34:46.022894 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:34:46.022894 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:34:46.023869 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:34:46.023869 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:34:46.023869 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:34:46.023869 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:34:46.023869 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:34:46.023869 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:34:46.023869 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:34:46.023869 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:34:46.023869 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:34:46.023869 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:34:46.023869 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:34:46.023869 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:34:46.023869 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 152/303] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:34:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:34:46.023869 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b07e83-29a9-430b-85b7-fc265948fb6a None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:46.024670 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b07e83-29a9-430b-85b7-fc265948fb6a None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:46.024670 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b07e83-29a9-430b-85b7-fc265948fb6a None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:46.024670 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 153/304] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:34:46.024670 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b07e83-29a9-430b-85b7-fc265948fb6a None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:46.053302 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b66285-7a02-49a7-a67d-8d4c671f9bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:46.053953 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b66285-7a02-49a7-a67d-8d4c671f9bf9 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:46.054224 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b66285-7a02-49a7-a67d-8d4c671f9bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:46.054490 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b66285-7a02-49a7-a67d-8d4c671f9bf9 None admin] PATH_INFO: `/v3/users/253f2977cb5645eaa087460d7e142852` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:46.067915 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b66285-7a02-49a7-a67d-8d4c671f9bf9 None admin] RBAC: Authorizing `identity:get_user(user_id=253f2977cb5645eaa087460d7e142852)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:46.070969 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b66285-7a02-49a7-a67d-8d4c671f9bf9 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:46.072711 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 152/305] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:34:45 2022] GET /identity/v3/users/253f2977cb5645eaa087460d7e142852 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:46.073408 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b66285-7a02-49a7-a67d-8d4c671f9bf9 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:46.089250 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:46.130336 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b07e83-29a9-430b-85b7-fc265948fb6a None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:46.134253 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:46.167539 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb1f07-3016-48f0-b495-ecf41f4029a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:46.168164 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb1f07-3016-48f0-b495-ecf41f4029a6 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:46.168433 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb1f07-3016-48f0-b495-ecf41f4029a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:46.168699 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb1f07-3016-48f0-b495-ecf41f4029a6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:46.169804 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eb1f07-3016-48f0-b495-ecf41f4029a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:46.171240 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eb1f07-3016-48f0-b495-ecf41f4029a6 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:46.172793 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 154/306] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:34:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:46.174659 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6012fa9-86f3-4be7-814c-b41d7cabca60 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:46.175042 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6012fa9-86f3-4be7-814c-b41d7cabca60 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:46.175437 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6012fa9-86f3-4be7-814c-b41d7cabca60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:46.175809 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b66285-7a02-49a7-a67d-8d4c671f9bf9 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:46.194819 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-c6012fa9-86f3-4be7-814c-b41d7cabca60 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:46.196101 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-c6012fa9-86f3-4be7-814c-b41d7cabca60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:46.212686 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae74e7-4f00-438e-80d9-c4144f026265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:46.213292 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae74e7-4f00-438e-80d9-c4144f026265 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:46.213601 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae74e7-4f00-438e-80d9-c4144f026265 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:46.213896 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae74e7-4f00-438e-80d9-c4144f026265 None admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:46.214539 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eae74e7-4f00-438e-80d9-c4144f026265 None admin] RBAC: Adding query filter params (name=member) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:46.214842 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eae74e7-4f00-438e-80d9-c4144f026265 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:46.216217 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eae74e7-4f00-438e-80d9-c4144f026265 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:46.224812 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 153/307] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 8 13:34:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:46.229565 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae74e7-4f00-438e-80d9-c4144f026265 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:46.266624 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 155/308] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:34:46.267453 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6012fa9-86f3-4be7-814c-b41d7cabca60 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:46.336709 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae74e7-4f00-438e-80d9-c4144f026265 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:46.341281 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:46.357772 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:46.374299 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2d3ec-6c7d-4ce1-8b86-a358f9e10783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:46.374902 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2d3ec-6c7d-4ce1-8b86-a358f9e10783 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:46.375188 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2d3ec-6c7d-4ce1-8b86-a358f9e10783 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:46.375456 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2d3ec-6c7d-4ce1-8b86-a358f9e10783 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:46.376178 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc2d3ec-6c7d-4ce1-8b86-a358f9e10783 None admin] RBAC: Adding query filter params (role.id=ab9b8996e13a46418c5b25949af994de, user.id=253f2977cb5645eaa087460d7e142852, scope.system=all) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:46.376487 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc2d3ec-6c7d-4ce1-8b86-a358f9e10783 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:46.377987 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc2d3ec-6c7d-4ce1-8b86-a358f9e10783 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:46.386520 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 154/309] 10.222.0.69 () {56 vars in 1308 bytes} [Thu Sep 8 13:34:46 2022] GET /identity/v3/role_assignments?user.id=253f2977cb5645eaa087460d7e142852&scope.system=all&role.id=ab9b8996e13a46418c5b25949af994de => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:46.387329 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2d3ec-6c7d-4ce1-8b86-a358f9e10783 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:46.391623 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6012fa9-86f3-4be7-814c-b41d7cabca60 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:46.439218 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce79e0-f9dc-4937-8fef-62d46ceb88f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:46.440291 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce79e0-f9dc-4937-8fef-62d46ceb88f0 None admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:46.441068 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce79e0-f9dc-4937-8fef-62d46ceb88f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:46.441614 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ce79e0-f9dc-4937-8fef-62d46ceb88f0 None admin] PATH_INFO: `/v3/groups` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:46.442502 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ce79e0-f9dc-4937-8fef-62d46ceb88f0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:46.445194 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ce79e0-f9dc-4937-8fef-62d46ceb88f0 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:46.477680 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 156/310] 10.222.0.69 () {60 vars in 1134 bytes} [Thu Sep 8 13:34:46 2022] POST /identity/v3/groups => generated 229 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:34:46.527941 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2d3ec-6c7d-4ce1-8b86-a358f9e10783 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:46.550713 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce79e0-f9dc-4937-8fef-62d46ceb88f0 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:46.574082 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9f372-c818-45c1-9f52-4f80de449991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:46.574723 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9f372-c818-45c1-9f52-4f80de449991 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:46.575006 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9f372-c818-45c1-9f52-4f80de449991 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:46.575278 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9f372-c818-45c1-9f52-4f80de449991 None admin] PATH_INFO: `/v3/users/604bd65046ae44a78a5a4342d3291b3b` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:46.576948 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9f372-c818-45c1-9f52-4f80de449991 None admin] RBAC: Authorizing `identity:get_user(user_id=604bd65046ae44a78a5a4342d3291b3b)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:46.577988 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9f372-c818-45c1-9f52-4f80de449991 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:46.579824 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 155/311] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:34:46 2022] GET /identity/v3/users/604bd65046ae44a78a5a4342d3291b3b => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:46.591445 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9f372-c818-45c1-9f52-4f80de449991 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:46.666682 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:46.694684 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ce79e0-f9dc-4937-8fef-62d46ceb88f0 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:46.723295 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:46.737280 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9f372-c818-45c1-9f52-4f80de449991 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:46.743461 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b1b263-94b1-4cb9-a349-c12fc1c292fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:46.745141 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1b263-94b1-4cb9-a349-c12fc1c292fb None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:46.745665 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1b263-94b1-4cb9-a349-c12fc1c292fb None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:46.746188 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1b263-94b1-4cb9-a349-c12fc1c292fb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:46.761676 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b1b263-94b1-4cb9-a349-c12fc1c292fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:34:46.767110 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-84b1b263-94b1-4cb9-a349-c12fc1c292fb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:34:46.767110 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:34:46.767110 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:34:46.767110 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:34:46.767110 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:34:46.767110 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:34:46.767110 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:34:46.767110 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:34:46.767110 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:34:46.767110 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:34:46.767110 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:34:46.767110 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:34:46.767110 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:34:46.767110 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:34:46.767110 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:34:46.767110 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:34:46.768050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:34:46.768050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:34:46.768050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:34:46.768050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:34:46.768050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:34:46.768050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:34:46.768050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:34:46.768050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:34:46.768050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:34:46.768050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:34:46.768050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:34:46.768050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:34:46.768050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:34:46.768050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:34:46.768050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:34:46.768050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:34:46.769292 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:34:46.769292 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:34:46.769292 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:34:46.769292 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:34:46.769292 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:34:46.769292 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:34:46.769292 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:34:46.769292 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:34:46.769292 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:34:46.769292 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:34:46.769292 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:34:46.769292 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:34:46.769292 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 157/312] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:34:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:34:46.774787 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b1b263-94b1-4cb9-a349-c12fc1c292fb None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:46.785468 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dccb18-4f3d-440a-a0d7-1d13f97a6858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:46.786149 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dccb18-4f3d-440a-a0d7-1d13f97a6858 None admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:46.786722 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dccb18-4f3d-440a-a0d7-1d13f97a6858 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:46.786831 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dccb18-4f3d-440a-a0d7-1d13f97a6858 None admin] PATH_INFO: `/v3/system/users/604bd65046ae44a78a5a4342d3291b3b/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:46.788639 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dccb18-4f3d-440a-a0d7-1d13f97a6858 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=604bd65046ae44a78a5a4342d3291b3b, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:46.790087 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dccb18-4f3d-440a-a0d7-1d13f97a6858 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:46.800663 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 156/313] 10.222.0.69 () {58 vars in 1334 bytes} [Thu Sep 8 13:34:46 2022] PUT /identity/v3/system/users/604bd65046ae44a78a5a4342d3291b3b/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:34:46.901806 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b1b263-94b1-4cb9-a349-c12fc1c292fb None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:46.949632 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8efade-ee8a-4d17-bbc6-4f41c94497a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:46.950465 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8efade-ee8a-4d17-bbc6-4f41c94497a6 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:46.950924 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8efade-ee8a-4d17-bbc6-4f41c94497a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:46.951322 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8efade-ee8a-4d17-bbc6-4f41c94497a6 None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:46.952141 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8efade-ee8a-4d17-bbc6-4f41c94497a6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:46.952613 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8efade-ee8a-4d17-bbc6-4f41c94497a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:46.954802 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8efade-ee8a-4d17-bbc6-4f41c94497a6 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:46.966507 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 158/314] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 8 13:34:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:34:46.972975 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dccb18-4f3d-440a-a0d7-1d13f97a6858 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:47.102714 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dccb18-4f3d-440a-a0d7-1d13f97a6858 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:47.123449 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:47.146772 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b1c8e-0922-4ca8-b2ee-be67ab6c7c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:47.148696 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b1c8e-0922-4ca8-b2ee-be67ab6c7c30 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:47.149203 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b1c8e-0922-4ca8-b2ee-be67ab6c7c30 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:47.149575 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b1c8e-0922-4ca8-b2ee-be67ab6c7c30 None admin] PATH_INFO: `/v3/users/bcfbbfb35e5140bcae95a7859d0fa5e5` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:47.150916 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b1c8e-0922-4ca8-b2ee-be67ab6c7c30 None admin] RBAC: Authorizing `identity:get_user(user_id=bcfbbfb35e5140bcae95a7859d0fa5e5)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:47.152532 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b1c8e-0922-4ca8-b2ee-be67ab6c7c30 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:47.154429 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 157/315] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:34:46 2022] GET /identity/v3/users/bcfbbfb35e5140bcae95a7859d0fa5e5 => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:47.160122 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8efade-ee8a-4d17-bbc6-4f41c94497a6 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:47.223068 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:47.289987 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8efade-ee8a-4d17-bbc6-4f41c94497a6 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:47.330893 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e289c3-63c8-4540-b282-02cb3057c451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:47.331531 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e289c3-63c8-4540-b282-02cb3057c451 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:47.331814 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e289c3-63c8-4540-b282-02cb3057c451 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:47.332087 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e289c3-63c8-4540-b282-02cb3057c451 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:47.411226 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e289c3-63c8-4540-b282-02cb3057c451 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:47.413008 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e289c3-63c8-4540-b282-02cb3057c451 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:47.472571 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:47.531547 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 159/316] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:34:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:34:47.536886 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b1c8e-0922-4ca8-b2ee-be67ab6c7c30 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:47.659312 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b1c8e-0922-4ca8-b2ee-be67ab6c7c30 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:47.701385 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ac4f7-2156-4c5e-a65f-19c3826ecfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:47.702406 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ac4f7-2156-4c5e-a65f-19c3826ecfa9 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:47.702907 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ac4f7-2156-4c5e-a65f-19c3826ecfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:47.703377 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ac4f7-2156-4c5e-a65f-19c3826ecfa9 None admin] PATH_INFO: `/v3/projects/06fa14b343d84890b6385d02bd48c9b7` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:47.704767 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342ac4f7-2156-4c5e-a65f-19c3826ecfa9 None admin] RBAC: Authorizing `identity:get_project(project_id=06fa14b343d84890b6385d02bd48c9b7)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:47.706470 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342ac4f7-2156-4c5e-a65f-19c3826ecfa9 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:47.708674 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 158/317] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:34:47 2022] GET /identity/v3/projects/06fa14b343d84890b6385d02bd48c9b7 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:47.715370 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e289c3-63c8-4540-b282-02cb3057c451 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:47.835796 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e289c3-63c8-4540-b282-02cb3057c451 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:47.876897 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d159afd-b609-4b0c-afa0-a52e217b35ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:47.877613 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d159afd-b609-4b0c-afa0-a52e217b35ba None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:47.877892 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d159afd-b609-4b0c-afa0-a52e217b35ba None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:47.878165 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d159afd-b609-4b0c-afa0-a52e217b35ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:47.878904 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d159afd-b609-4b0c-afa0-a52e217b35ba None admin] RBAC: Adding query filter params (role.id=ab9b8996e13a46418c5b25949af994de, scope.project.id=06fa14b343d84890b6385d02bd48c9b7, user.id=bcfbbfb35e5140bcae95a7859d0fa5e5) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:47.879212 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d159afd-b609-4b0c-afa0-a52e217b35ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:47.880642 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d159afd-b609-4b0c-afa0-a52e217b35ba None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:47.888346 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 160/318] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 8 13:34:47 2022] GET /identity/v3/role_assignments?user.id=bcfbbfb35e5140bcae95a7859d0fa5e5&scope.project.id=06fa14b343d84890b6385d02bd48c9b7&role.id=ab9b8996e13a46418c5b25949af994de => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:34:48.654427 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5f8f8-b804-4ce5-8596-cdc3d2435e76 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:48.654911 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5f8f8-b804-4ce5-8596-cdc3d2435e76 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:48.654911 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5f8f8-b804-4ce5-8596-cdc3d2435e76 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:48.656379 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 159/319] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:34:48.661495 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80def614-8794-43d1-b00d-e65bf7f6493b None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:48.661921 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80def614-8794-43d1-b00d-e65bf7f6493b None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:48.662109 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80def614-8794-43d1-b00d-e65bf7f6493b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:48.680673 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-80def614-8794-43d1-b00d-e65bf7f6493b None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:48.681903 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-80def614-8794-43d1-b00d-e65bf7f6493b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:48.683902 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:48.752933 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 161/320] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:34:48.945671 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f3bf5-8817-4b62-b251-7f94e68514b0 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:48.946020 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f3bf5-8817-4b62-b251-7f94e68514b0 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:48.946212 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f3bf5-8817-4b62-b251-7f94e68514b0 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:48.947725 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 160/321] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:34:48.952847 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82313003-0f8e-4b9a-badf-92e2c0e471f1 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:48.953130 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82313003-0f8e-4b9a-badf-92e2c0e471f1 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:48.953423 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82313003-0f8e-4b9a-badf-92e2c0e471f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:48.977441 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-82313003-0f8e-4b9a-badf-92e2c0e471f1 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:48.978610 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-82313003-0f8e-4b9a-badf-92e2c0e471f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:49.027971 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f3bf5-8817-4b62-b251-7f94e68514b0 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:49.051364 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 162/322] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:34:49.087787 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:49.148905 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f3bf5-8817-4b62-b251-7f94e68514b0 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:49.186659 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f414235-03ad-493a-b166-9a725d49be1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:49.187550 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f414235-03ad-493a-b166-9a725d49be1f None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:49.187972 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f414235-03ad-493a-b166-9a725d49be1f None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:49.188384 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f414235-03ad-493a-b166-9a725d49be1f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:49.200003 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f414235-03ad-493a-b166-9a725d49be1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:34:49.205049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-1f414235-03ad-493a-b166-9a725d49be1f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:34:49.205049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:34:49.205049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:34:49.205049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:34:49.205049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:34:49.205049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:34:49.205049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:34:49.205049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:34:49.205049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:34:49.205049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:34:49.205049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:34:49.205049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:34:49.205049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:34:49.205049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:34:49.205049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:34:49.205049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:34:49.206016 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:34:49.206016 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:34:49.206016 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:34:49.206016 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:34:49.206016 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:34:49.206016 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:34:49.206016 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:34:49.206016 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:34:49.206016 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:34:49.206016 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:34:49.206016 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:34:49.206016 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:34:49.206016 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:34:49.206016 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:34:49.206016 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:34:49.206016 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:34:49.206821 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:34:49.206821 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:34:49.206821 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:34:49.206821 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:34:49.206821 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:34:49.206821 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:34:49.206821 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:34:49.206821 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:34:49.206821 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:34:49.206821 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:34:49.206821 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:34:49.206821 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:34:49.206821 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 161/323] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:34:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:34:49.212748 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82313003-0f8e-4b9a-badf-92e2c0e471f1 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:49.219959 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6212c81-1ceb-42bd-b5c1-45ac114294c3 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:49.220312 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6212c81-1ceb-42bd-b5c1-45ac114294c3 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:49.220534 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6212c81-1ceb-42bd-b5c1-45ac114294c3 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:49.222138 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 162/324] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:34:49.227585 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86918f19-68fd-4ac7-9642-81cf88e11b26 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:49.227867 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86918f19-68fd-4ac7-9642-81cf88e11b26 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:49.228136 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86918f19-68fd-4ac7-9642-81cf88e11b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:49.252988 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-86918f19-68fd-4ac7-9642-81cf88e11b26 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:49.254214 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-86918f19-68fd-4ac7-9642-81cf88e11b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:49.295802 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:49.332331 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 163/325] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:34:49.334043 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82313003-0f8e-4b9a-badf-92e2c0e471f1 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:49.363508 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86918f19-68fd-4ac7-9642-81cf88e11b26 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:49.370511 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90912440-5e92-475a-9e87-1985a1cd3fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:49.371110 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90912440-5e92-475a-9e87-1985a1cd3fff None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:49.371383 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90912440-5e92-475a-9e87-1985a1cd3fff None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:49.371649 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90912440-5e92-475a-9e87-1985a1cd3fff None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:49.372314 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90912440-5e92-475a-9e87-1985a1cd3fff None admin] RBAC: Adding query filter params (name=reader) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:49.372611 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90912440-5e92-475a-9e87-1985a1cd3fff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:49.374112 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90912440-5e92-475a-9e87-1985a1cd3fff None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:49.384585 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 163/326] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 8 13:34:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:49.389781 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90912440-5e92-475a-9e87-1985a1cd3fff None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:49.414445 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:49.481221 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86918f19-68fd-4ac7-9642-81cf88e11b26 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:49.502850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90912440-5e92-475a-9e87-1985a1cd3fff None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:49.521177 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc7e86-be42-46df-bb1b-233755703866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:49.521832 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc7e86-be42-46df-bb1b-233755703866 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:49.522238 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc7e86-be42-46df-bb1b-233755703866 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:49.522674 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc7e86-be42-46df-bb1b-233755703866 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:49.523816 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc7e86-be42-46df-bb1b-233755703866 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:49.525269 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bc7e86-be42-46df-bb1b-233755703866 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:49.526884 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 164/327] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:34:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:34:49.532665 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc7e86-be42-46df-bb1b-233755703866 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:49.536248 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:49.547139 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c036e-7a37-4251-ab74-40fc1f580052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:49.547837 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c036e-7a37-4251-ab74-40fc1f580052 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:49.548437 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c036e-7a37-4251-ab74-40fc1f580052 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:49.548543 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c036e-7a37-4251-ab74-40fc1f580052 None admin] PATH_INFO: `/v3/users/253f2977cb5645eaa087460d7e142852` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:49.549797 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c036e-7a37-4251-ab74-40fc1f580052 None admin] RBAC: Authorizing `identity:get_user(user_id=253f2977cb5645eaa087460d7e142852)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:49.551386 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c036e-7a37-4251-ab74-40fc1f580052 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:49.559024 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 164/328] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:34:49 2022] GET /identity/v3/users/253f2977cb5645eaa087460d7e142852 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:34:49.560885 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c036e-7a37-4251-ab74-40fc1f580052 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:49.660998 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc7e86-be42-46df-bb1b-233755703866 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:49.671869 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c036e-7a37-4251-ab74-40fc1f580052 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:49.672328 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:49.698976 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f863e-b958-4341-a680-efccfbc2663b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:49.699576 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f863e-b958-4341-a680-efccfbc2663b None admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:49.699856 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f863e-b958-4341-a680-efccfbc2663b None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:49.700123 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f863e-b958-4341-a680-efccfbc2663b None admin] PATH_INFO: `/v3/groups` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:49.700848 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5f863e-b958-4341-a680-efccfbc2663b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:49.702336 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5f863e-b958-4341-a680-efccfbc2663b None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:49.706081 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d97d1-b0c1-4ea0-9abb-33fc8285e58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:49.706715 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d97d1-b0c1-4ea0-9abb-33fc8285e58b None admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:49.706989 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d97d1-b0c1-4ea0-9abb-33fc8285e58b None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:49.707260 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d97d1-b0c1-4ea0-9abb-33fc8285e58b None admin] PATH_INFO: `/v3/system/users/253f2977cb5645eaa087460d7e142852/roles/ab9b8996e13a46418c5b25949af994de` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:49.708641 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051d97d1-b0c1-4ea0-9abb-33fc8285e58b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=253f2977cb5645eaa087460d7e142852, role_id=ab9b8996e13a46418c5b25949af994de)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:49.710074 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051d97d1-b0c1-4ea0-9abb-33fc8285e58b None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:49.719453 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 165/329] 10.222.0.69 () {58 vars in 1334 bytes} [Thu Sep 8 13:34:49 2022] PUT /identity/v3/system/users/253f2977cb5645eaa087460d7e142852/roles/ab9b8996e13a46418c5b25949af994de => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:34:49.729825 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 165/330] 10.222.0.69 () {60 vars in 1134 bytes} [Thu Sep 8 13:34:49 2022] POST /identity/v3/groups => generated 226 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:34:49.730742 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d97d1-b0c1-4ea0-9abb-33fc8285e58b None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:49.811906 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:49.865535 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d97d1-b0c1-4ea0-9abb-33fc8285e58b None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:49.919654 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b5bb02-ce4c-4a10-a0ee-936bb24d6b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:49.920001 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5bb02-ce4c-4a10-a0ee-936bb24d6b6a None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:49.920573 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5bb02-ce4c-4a10-a0ee-936bb24d6b6a None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:49.920988 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5bb02-ce4c-4a10-a0ee-936bb24d6b6a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:49.935652 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b5bb02-ce4c-4a10-a0ee-936bb24d6b6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:34:49.941291 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-f0b5bb02-ce4c-4a10-a0ee-936bb24d6b6a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:34:49.941291 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:34:49.941291 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:34:49.941291 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:34:49.941291 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:34:49.941291 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:34:49.941291 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:34:49.941291 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:34:49.941291 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:34:49.941291 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:34:49.941291 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:34:49.941291 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:34:49.941291 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:34:49.941291 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:34:49.941291 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:34:49.941291 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:34:49.942267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:34:49.942267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:34:49.942267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:34:49.942267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:34:49.942267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:34:49.942267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:34:49.942267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:34:49.942267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:34:49.942267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:34:49.942267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:34:49.942267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:34:49.942267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:34:49.942267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:34:49.942267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:34:49.942267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:34:49.942267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:34:49.943086 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:34:49.943086 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:34:49.943086 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:34:49.943086 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:34:49.943086 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:34:49.943086 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:34:49.943086 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:34:49.943086 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:34:49.943086 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:34:49.943086 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:34:49.943086 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:34:49.943086 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:34:49.943086 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 166/331] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:34:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:34:49.948779 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f863e-b958-4341-a680-efccfbc2663b None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:50.069953 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f863e-b958-4341-a680-efccfbc2663b None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:50.109723 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56a163-6ad8-4bc4-94c0-7cc7cd215324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:50.110437 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56a163-6ad8-4bc4-94c0-7cc7cd215324 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:50.110670 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56a163-6ad8-4bc4-94c0-7cc7cd215324 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:50.110937 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56a163-6ad8-4bc4-94c0-7cc7cd215324 None admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:50.111606 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56a163-6ad8-4bc4-94c0-7cc7cd215324 None admin] RBAC: Adding query filter params (name=member) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:50.111902 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56a163-6ad8-4bc4-94c0-7cc7cd215324 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:50.113281 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56a163-6ad8-4bc4-94c0-7cc7cd215324 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:50.126866 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 166/332] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 8 13:34:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:50.132675 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b5bb02-ce4c-4a10-a0ee-936bb24d6b6a None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:50.239989 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b5bb02-ce4c-4a10-a0ee-936bb24d6b6a None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:50.266697 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:50.284670 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd9943-a4e6-4839-951f-0bf36eccdd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:50.285631 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd9943-a4e6-4839-951f-0bf36eccdd8d None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:50.286078 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd9943-a4e6-4839-951f-0bf36eccdd8d None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:50.286510 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd9943-a4e6-4839-951f-0bf36eccdd8d None admin] PATH_INFO: `/v3/users/604bd65046ae44a78a5a4342d3291b3b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:50.288958 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd9943-a4e6-4839-951f-0bf36eccdd8d None admin] RBAC: Authorizing `identity:get_user(user_id=604bd65046ae44a78a5a4342d3291b3b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:50.291112 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd9943-a4e6-4839-951f-0bf36eccdd8d None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:50.293673 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 167/333] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:34:50 2022] GET /identity/v3/users/604bd65046ae44a78a5a4342d3291b3b => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:50.299267 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56a163-6ad8-4bc4-94c0-7cc7cd215324 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:50.350503 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:50.441469 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56a163-6ad8-4bc4-94c0-7cc7cd215324 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:50.493131 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70868efa-86eb-4c07-be5d-9f6164ba80c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:50.493776 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70868efa-86eb-4c07-be5d-9f6164ba80c1 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:50.494062 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70868efa-86eb-4c07-be5d-9f6164ba80c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:50.494336 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70868efa-86eb-4c07-be5d-9f6164ba80c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:50.495068 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70868efa-86eb-4c07-be5d-9f6164ba80c1 None admin] RBAC: Adding query filter params (role.id=0735c260e70441cc87ad611b789d5c56, user.id=604bd65046ae44a78a5a4342d3291b3b, scope.system=all) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:50.495376 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70868efa-86eb-4c07-be5d-9f6164ba80c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:50.496832 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70868efa-86eb-4c07-be5d-9f6164ba80c1 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:50.516469 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 167/334] 10.222.0.69 () {56 vars in 1308 bytes} [Thu Sep 8 13:34:50 2022] GET /identity/v3/role_assignments?user.id=604bd65046ae44a78a5a4342d3291b3b&scope.system=all&role.id=0735c260e70441cc87ad611b789d5c56 => generated 510 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:34:52.405869 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d7d0b-3531-4347-9767-86523a27c356 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:52.406390 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d7d0b-3531-4347-9767-86523a27c356 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:52.406390 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d7d0b-3531-4347-9767-86523a27c356 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:52.408025 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 168/335] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:34:52.414765 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3892c7-e711-4533-b9b8-d11c38d65244 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:52.415299 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3892c7-e711-4533-b9b8-d11c38d65244 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:52.415299 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3892c7-e711-4533-b9b8-d11c38d65244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:52.437044 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-5b3892c7-e711-4533-b9b8-d11c38d65244 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:52.438302 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-5b3892c7-e711-4533-b9b8-d11c38d65244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:52.531799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 168/336] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:34:52.579654 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144325e3-422f-4a07-b1e0-64f180cdc8e3 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:52.579977 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144325e3-422f-4a07-b1e0-64f180cdc8e3 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:52.580197 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144325e3-422f-4a07-b1e0-64f180cdc8e3 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:52.581801 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 169/337] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:34:52.587877 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50843b8-7fb9-4d06-b3c8-7cd2cacb9618 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:52.588171 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50843b8-7fb9-4d06-b3c8-7cd2cacb9618 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:52.588451 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50843b8-7fb9-4d06-b3c8-7cd2cacb9618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:52.611036 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-a50843b8-7fb9-4d06-b3c8-7cd2cacb9618 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:52.612235 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-a50843b8-7fb9-4d06-b3c8-7cd2cacb9618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:52.634827 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:52.701592 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 169/338] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:34:53.073631 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144325e3-422f-4a07-b1e0-64f180cdc8e3 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:53.181394 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6af35-514a-4ddb-86df-f10eebe03970 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:53.181394 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6af35-514a-4ddb-86df-f10eebe03970 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:53.181394 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6af35-514a-4ddb-86df-f10eebe03970 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:53.181394 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 170/339] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:34:53.198679 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540d8e0-c941-41cc-9c29-997950d80ab2 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:53.198996 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540d8e0-c941-41cc-9c29-997950d80ab2 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:53.199222 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540d8e0-c941-41cc-9c29-997950d80ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:53.224726 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-5540d8e0-c941-41cc-9c29-997950d80ab2 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:53.226163 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-5540d8e0-c941-41cc-9c29-997950d80ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:53.229954 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144325e3-422f-4a07-b1e0-64f180cdc8e3 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:53.299681 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a14c23-086e-4cb0-8cb8-8b2a512b2df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:53.300326 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a14c23-086e-4cb0-8cb8-8b2a512b2df8 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:53.300602 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a14c23-086e-4cb0-8cb8-8b2a512b2df8 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:53.300873 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a14c23-086e-4cb0-8cb8-8b2a512b2df8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:53.329276 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a14c23-086e-4cb0-8cb8-8b2a512b2df8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:34:53.334564 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-65a14c23-086e-4cb0-8cb8-8b2a512b2df8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:34:53.334564 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:34:53.334564 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:34:53.334564 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:34:53.334564 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:34:53.334564 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:34:53.334564 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:34:53.334564 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:34:53.334564 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:34:53.334564 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:34:53.334564 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:34:53.334564 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:34:53.334564 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:34:53.334564 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:34:53.334564 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:34:53.334564 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:34:53.335547 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:34:53.335547 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:34:53.335547 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:34:53.335547 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:34:53.335547 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:34:53.335547 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:34:53.335547 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:34:53.335547 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:34:53.335547 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:34:53.335547 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:34:53.335547 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:34:53.335547 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:34:53.335547 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:34:53.335547 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:34:53.335547 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:34:53.335547 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:34:53.336342 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:34:53.336342 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:34:53.336342 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:34:53.336342 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:34:53.336342 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:34:53.336342 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:34:53.336342 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:34:53.336342 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:34:53.336342 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:34:53.336342 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:34:53.336342 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:34:53.336342 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:34:53.341525 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 170/340] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:34:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:34:53.342452 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a14c23-086e-4cb0-8cb8-8b2a512b2df8 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:53.367730 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 171/341] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:34:53.368589 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5540d8e0-c941-41cc-9c29-997950d80ab2 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:53.474763 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:53.520392 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:53.539999 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5540d8e0-c941-41cc-9c29-997950d80ab2 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:53.584880 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362aa40-0e7c-4604-8ff0-6e4a94be06b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:53.585432 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362aa40-0e7c-4604-8ff0-6e4a94be06b3 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:53.585709 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362aa40-0e7c-4604-8ff0-6e4a94be06b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:53.585977 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362aa40-0e7c-4604-8ff0-6e4a94be06b3 None admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:53.586650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362aa40-0e7c-4604-8ff0-6e4a94be06b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:53.586945 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362aa40-0e7c-4604-8ff0-6e4a94be06b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:53.588346 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362aa40-0e7c-4604-8ff0-6e4a94be06b3 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:53.598142 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 172/342] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 8 13:34:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:53.605142 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362aa40-0e7c-4604-8ff0-6e4a94be06b3 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:53.610545 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a14c23-086e-4cb0-8cb8-8b2a512b2df8 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:53.700048 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3740ef3c-cdd6-467d-8bdb-a3210d0879c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:53.701114 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740ef3c-cdd6-467d-8bdb-a3210d0879c6 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:53.701572 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740ef3c-cdd6-467d-8bdb-a3210d0879c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:53.702237 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3740ef3c-cdd6-467d-8bdb-a3210d0879c6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:53.721343 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3740ef3c-cdd6-467d-8bdb-a3210d0879c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:34:53.733307 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-3740ef3c-cdd6-467d-8bdb-a3210d0879c6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:34:53.733307 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:34:53.733307 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:34:53.733307 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:34:53.733307 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:34:53.733307 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:34:53.733307 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:34:53.733307 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:34:53.733307 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:34:53.733307 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:34:53.733307 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:34:53.733307 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:34:53.733307 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:34:53.733307 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:34:53.733307 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:34:53.733307 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:34:53.734267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:34:53.734267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:34:53.734267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:34:53.734267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:34:53.734267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:34:53.734267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:34:53.734267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:34:53.734267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:34:53.734267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:34:53.734267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:34:53.734267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:34:53.734267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:34:53.734267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:34:53.734267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:34:53.734267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:34:53.734267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:34:53.735054 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:34:53.735054 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:34:53.735054 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:34:53.735054 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:34:53.735054 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:34:53.735054 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:34:53.735054 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:34:53.735054 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:34:53.735054 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:34:53.735054 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:34:53.735054 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 08 13:34:53.735054 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:34:53.737475 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 171/343] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:34:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:34:53.744223 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3740ef3c-cdd6-467d-8bdb-a3210d0879c6 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:53.843639 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362aa40-0e7c-4604-8ff0-6e4a94be06b3 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:53.877317 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3740ef3c-cdd6-467d-8bdb-a3210d0879c6 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:53.890718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:53.891524 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b96f6b0-7f4f-4921-83f0-3c62ca757652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:53.892130 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96f6b0-7f4f-4921-83f0-3c62ca757652 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:53.892499 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96f6b0-7f4f-4921-83f0-3c62ca757652 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:53.892862 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b96f6b0-7f4f-4921-83f0-3c62ca757652 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:53.909824 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:53.926549 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5ab342-2b54-4e3b-8a4f-eb9c4fb61929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:53.928630 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ab342-2b54-4e3b-8a4f-eb9c4fb61929 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:53.929462 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ab342-2b54-4e3b-8a4f-eb9c4fb61929 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:53.930060 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ab342-2b54-4e3b-8a4f-eb9c4fb61929 None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:53.931057 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5ab342-2b54-4e3b-8a4f-eb9c4fb61929 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:53.931578 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5ab342-2b54-4e3b-8a4f-eb9c4fb61929 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:53.933304 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5ab342-2b54-4e3b-8a4f-eb9c4fb61929 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:53.944946 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 172/344] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 8 13:34:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:34:53.946185 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5ab342-2b54-4e3b-8a4f-eb9c4fb61929 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:53.985201 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b96f6b0-7f4f-4921-83f0-3c62ca757652 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:53.986708 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b96f6b0-7f4f-4921-83f0-3c62ca757652 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:54.088446 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5ab342-2b54-4e3b-8a4f-eb9c4fb61929 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:54.122353 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 173/345] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:34:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:34:54.124178 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027e0cd-6ec7-42c3-863b-ed250da2697f None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:54.124691 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027e0cd-6ec7-42c3-863b-ed250da2697f None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:54.125334 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027e0cd-6ec7-42c3-863b-ed250da2697f None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:54.126946 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 174/346] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:34:54.127900 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027e0cd-6ec7-42c3-863b-ed250da2697f None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:54.138885 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41704c6-9364-470b-96e4-617dcfc40877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:54.139967 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41704c6-9364-470b-96e4-617dcfc40877 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:54.139967 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41704c6-9364-470b-96e4-617dcfc40877 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:54.140136 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41704c6-9364-470b-96e4-617dcfc40877 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:54.152411 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41704c6-9364-470b-96e4-617dcfc40877 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:34:54.157867 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-b41704c6-9364-470b-96e4-617dcfc40877 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:34:54.157867 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:34:54.157867 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:34:54.157867 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:34:54.157867 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:34:54.157867 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:34:54.157867 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:34:54.157867 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:34:54.157867 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:34:54.157867 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:34:54.157867 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:34:54.157867 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:34:54.157867 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:34:54.157867 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:34:54.157867 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:34:54.157867 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:34:54.159093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:34:54.159093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:34:54.159093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:34:54.159093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:34:54.159093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:34:54.159093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:34:54.159093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:34:54.159093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:34:54.159093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:34:54.159093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:34:54.159093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:34:54.159093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:34:54.159093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:34:54.159093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:34:54.159093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:34:54.159093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:34:54.160108 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:34:54.160108 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:34:54.160108 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:34:54.160108 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:34:54.160108 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:34:54.160108 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:34:54.160108 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:34:54.160108 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:34:54.160108 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:34:54.160108 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:34:54.160108 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:34:54.160108 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:34:54.160108 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 173/347] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Sep 8 13:34:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:34:54.160866 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563185e-de18-4cf1-8bfa-6c5d3d59258f None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:54.160933 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563185e-de18-4cf1-8bfa-6c5d3d59258f None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:54.161213 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563185e-de18-4cf1-8bfa-6c5d3d59258f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:54.180464 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-8563185e-de18-4cf1-8bfa-6c5d3d59258f None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:54.182435 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-8563185e-de18-4cf1-8bfa-6c5d3d59258f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:54.186253 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:54.219380 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:54.263616 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027e0cd-6ec7-42c3-863b-ed250da2697f None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:54.281623 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 174/348] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:34:54.282712 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563185e-de18-4cf1-8bfa-6c5d3d59258f None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:54.310746 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379fb454-d681-4516-929a-ef9547f07489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:54.311655 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379fb454-d681-4516-929a-ef9547f07489 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:54.312080 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379fb454-d681-4516-929a-ef9547f07489 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:54.312504 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379fb454-d681-4516-929a-ef9547f07489 None admin] PATH_INFO: `/v3/users/253f2977cb5645eaa087460d7e142852` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:54.314578 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379fb454-d681-4516-929a-ef9547f07489 None admin] RBAC: Authorizing `identity:get_user(user_id=253f2977cb5645eaa087460d7e142852)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:54.316363 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379fb454-d681-4516-929a-ef9547f07489 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:54.319335 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 175/349] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:34:54 2022] GET /identity/v3/users/253f2977cb5645eaa087460d7e142852 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:54.320689 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d076fbf-0ece-4244-b7dc-eb96ff85ffd6 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:54.321103 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d076fbf-0ece-4244-b7dc-eb96ff85ffd6 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:54.321530 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d076fbf-0ece-4244-b7dc-eb96ff85ffd6 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:54.322872 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 176/350] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:34:54.323714 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d076fbf-0ece-4244-b7dc-eb96ff85ffd6 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:54.417524 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563185e-de18-4cf1-8bfa-6c5d3d59258f None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:54.455418 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d076fbf-0ece-4244-b7dc-eb96ff85ffd6 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:54.456663 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a1cf8-06e7-421d-9e7e-bcdc31c45a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:54.457609 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a1cf8-06e7-421d-9e7e-bcdc31c45a1e None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:54.457963 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a1cf8-06e7-421d-9e7e-bcdc31c45a1e None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:54.458335 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a1cf8-06e7-421d-9e7e-bcdc31c45a1e None admin] PATH_INFO: `/v3/projects/8afaf32861dc4e62a9b32129a27c4900` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:54.459865 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294a1cf8-06e7-421d-9e7e-bcdc31c45a1e None admin] RBAC: Authorizing `identity:get_project(project_id=8afaf32861dc4e62a9b32129a27c4900)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:54.461580 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294a1cf8-06e7-421d-9e7e-bcdc31c45a1e None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:54.463662 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 175/351] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:34:54 2022] GET /identity/v3/projects/8afaf32861dc4e62a9b32129a27c4900 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:54.465456 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5c3ab-aeec-4ab3-8ed3-6c4a3159712f None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:54.465456 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5c3ab-aeec-4ab3-8ed3-6c4a3159712f None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:54.465874 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5c3ab-aeec-4ab3-8ed3-6c4a3159712f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:54.469577 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:54.486419 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-cbe5c3ab-aeec-4ab3-8ed3-6c4a3159712f None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:54.487883 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-cbe5c3ab-aeec-4ab3-8ed3-6c4a3159712f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:54.499016 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598dd0ed-8303-443f-81b0-694c5e000cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:54.499850 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598dd0ed-8303-443f-81b0-694c5e000cbf None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:54.500317 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598dd0ed-8303-443f-81b0-694c5e000cbf None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:54.500784 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598dd0ed-8303-443f-81b0-694c5e000cbf None admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:54.501635 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598dd0ed-8303-443f-81b0-694c5e000cbf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:54.502083 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598dd0ed-8303-443f-81b0-694c5e000cbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:54.503697 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598dd0ed-8303-443f-81b0-694c5e000cbf None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:54.513518 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 177/352] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:34:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:54.514555 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598dd0ed-8303-443f-81b0-694c5e000cbf None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:54.516720 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:54.581581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 176/353] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:34:54.586151 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5c3ab-aeec-4ab3-8ed3-6c4a3159712f None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:54.644757 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598dd0ed-8303-443f-81b0-694c5e000cbf None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:54.682912 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb3aed-7d7b-473e-ac42-56f9bcd35d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:54.683524 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb3aed-7d7b-473e-ac42-56f9bcd35d51 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:54.683803 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb3aed-7d7b-473e-ac42-56f9bcd35d51 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:54.684074 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb3aed-7d7b-473e-ac42-56f9bcd35d51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:54.684798 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb3aed-7d7b-473e-ac42-56f9bcd35d51 None admin] RBAC: Adding query filter params (role.id=ab9b8996e13a46418c5b25949af994de, user.id=253f2977cb5645eaa087460d7e142852, scope.system=all) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:54.685103 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb3aed-7d7b-473e-ac42-56f9bcd35d51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:54.686576 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb3aed-7d7b-473e-ac42-56f9bcd35d51 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:54.700685 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 178/354] 10.222.0.69 () {56 vars in 1308 bytes} [Thu Sep 8 13:34:54 2022] GET /identity/v3/role_assignments?user.id=253f2977cb5645eaa087460d7e142852&scope.system=all&role.id=ab9b8996e13a46418c5b25949af994de => generated 510 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:54.701408 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb3aed-7d7b-473e-ac42-56f9bcd35d51 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:54.720234 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5c3ab-aeec-4ab3-8ed3-6c4a3159712f None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:54.741944 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:54.777057 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f086c-cd7c-46b5-b140-78bab8f05207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:54.778858 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f086c-cd7c-46b5-b140-78bab8f05207 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:54.779350 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f086c-cd7c-46b5-b140-78bab8f05207 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:54.779810 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f086c-cd7c-46b5-b140-78bab8f05207 None admin] PATH_INFO: `/v3/groups/3ba5e6d8fb3d438597b383a9a40eaf0b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:54.793602 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f086c-cd7c-46b5-b140-78bab8f05207 None admin] RBAC: Authorizing `identity:get_group(group_id=3ba5e6d8fb3d438597b383a9a40eaf0b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:54.795398 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308f086c-cd7c-46b5-b140-78bab8f05207 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:54.797446 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 177/355] 10.222.0.69 () {56 vars in 1180 bytes} [Thu Sep 8 13:34:54 2022] GET /identity/v3/groups/3ba5e6d8fb3d438597b383a9a40eaf0b => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:54.799221 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f086c-cd7c-46b5-b140-78bab8f05207 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:54.833029 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb3aed-7d7b-473e-ac42-56f9bcd35d51 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:54.850612 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:54.873067 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6fb62-3047-4132-955c-ef629036bb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:54.873798 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6fb62-3047-4132-955c-ef629036bb7d None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:54.874151 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6fb62-3047-4132-955c-ef629036bb7d None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:54.874433 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6fb62-3047-4132-955c-ef629036bb7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:54.964565 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac6fb62-3047-4132-955c-ef629036bb7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:54.966093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f086c-cd7c-46b5-b140-78bab8f05207 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:54.966231 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac6fb62-3047-4132-955c-ef629036bb7d None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:55.005340 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:55.020836 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582f445-38dd-40f5-9559-6e62e257c57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:55.021515 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582f445-38dd-40f5-9559-6e62e257c57d None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:55.021802 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582f445-38dd-40f5-9559-6e62e257c57d None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:55.022861 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582f445-38dd-40f5-9559-6e62e257c57d None admin] PATH_INFO: `/v3/roles/member` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:55.037909 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4582f445-38dd-40f5-9559-6e62e257c57d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:34:55.043328 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-4582f445-38dd-40f5-9559-6e62e257c57d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:34:55.043328 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:34:55.043328 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:34:55.043328 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:34:55.043328 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:34:55.043328 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:34:55.043328 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:34:55.043328 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:34:55.043328 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:34:55.043328 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:34:55.043328 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:34:55.043328 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:34:55.043328 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:34:55.043328 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:34:55.043328 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:34:55.043328 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:34:55.044260 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:34:55.044260 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:34:55.044260 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:34:55.044260 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:34:55.044260 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:34:55.044260 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:34:55.044260 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:34:55.044260 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:34:55.044260 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:34:55.044260 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:34:55.044260 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:34:55.044260 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:34:55.044260 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:34:55.044260 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:34:55.044260 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:34:55.044260 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:34:55.045061 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:34:55.045061 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:34:55.045061 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:34:55.045061 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:34:55.045061 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:34:55.045061 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:34:55.045061 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:34:55.045061 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:34:55.045061 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:34:55.045061 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:34:55.045061 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:34:55.045061 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:34:55.045061 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 178/356] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:34:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:34:55.045770 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582f445-38dd-40f5-9559-6e62e257c57d None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:55.106653 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 179/357] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:34:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:34:55.109096 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e3381-adaf-4f18-9b8a-9fddc827016a None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:55.109540 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e3381-adaf-4f18-9b8a-9fddc827016a None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:55.109949 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e3381-adaf-4f18-9b8a-9fddc827016a None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:55.111600 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 180/358] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:34:55.112745 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e3381-adaf-4f18-9b8a-9fddc827016a None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:55.150718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:55.179199 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582f445-38dd-40f5-9559-6e62e257c57d None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:55.221461 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d4ad7-f356-4256-af55-84529bdb43ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:55.222004 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d4ad7-f356-4256-af55-84529bdb43ee None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:55.222294 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d4ad7-f356-4256-af55-84529bdb43ee None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:55.222558 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d4ad7-f356-4256-af55-84529bdb43ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:55.223299 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97d4ad7-f356-4256-af55-84529bdb43ee None admin] RBAC: Adding query filter params (group.id=3ba5e6d8fb3d438597b383a9a40eaf0b, role.id=0735c260e70441cc87ad611b789d5c56, scope.project.id=8afaf32861dc4e62a9b32129a27c4900) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:55.223865 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97d4ad7-f356-4256-af55-84529bdb43ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:55.225998 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97d4ad7-f356-4256-af55-84529bdb43ee None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:55.232795 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 179/359] 10.222.0.69 () {56 vars in 1376 bytes} [Thu Sep 8 13:34:55 2022] GET /identity/v3/role_assignments?group.id=3ba5e6d8fb3d438597b383a9a40eaf0b&scope.project.id=8afaf32861dc4e62a9b32129a27c4900&role.id=0735c260e70441cc87ad611b789d5c56 => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:55.233687 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d4ad7-f356-4256-af55-84529bdb43ee None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:55.252753 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e3381-adaf-4f18-9b8a-9fddc827016a None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:55.295839 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:55.302250 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b726b-3083-4e18-b5f5-d1eb7d09998b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:55.302923 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b726b-3083-4e18-b5f5-d1eb7d09998b None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:55.303239 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b726b-3083-4e18-b5f5-d1eb7d09998b None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:55.303583 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b726b-3083-4e18-b5f5-d1eb7d09998b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:55.320876 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17b726b-3083-4e18-b5f5-d1eb7d09998b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:34:55.327222 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-a17b726b-3083-4e18-b5f5-d1eb7d09998b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:34:55.327222 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:34:55.327222 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:34:55.327222 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:34:55.327222 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:34:55.327222 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:34:55.327222 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:34:55.327222 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:34:55.327222 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:34:55.327222 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:34:55.327222 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:34:55.327222 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:34:55.327222 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:34:55.327222 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:34:55.327222 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:34:55.327222 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:34:55.328217 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:34:55.328217 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:34:55.328217 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:34:55.328217 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:34:55.328217 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:34:55.328217 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:34:55.328217 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:34:55.328217 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:34:55.328217 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:34:55.328217 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:34:55.328217 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:34:55.328217 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:34:55.328217 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:34:55.328217 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:34:55.328217 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:34:55.328217 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:34:55.329240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:34:55.329240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:34:55.329240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:34:55.329240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:34:55.329240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:34:55.329240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:34:55.329240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:34:55.329240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:34:55.329240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:34:55.329240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:34:55.329240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:34:55.329240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:34:55.329240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 181/360] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Sep 8 13:34:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:34:55.335658 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b726b-3083-4e18-b5f5-d1eb7d09998b None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:55.365941 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d4ad7-f356-4256-af55-84529bdb43ee None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:55.421690 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28020387-f787-4378-86f8-b62311f33d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:55.423128 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28020387-f787-4378-86f8-b62311f33d69 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:55.423406 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28020387-f787-4378-86f8-b62311f33d69 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:55.423677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28020387-f787-4378-86f8-b62311f33d69 None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:55.424706 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28020387-f787-4378-86f8-b62311f33d69 None admin] RBAC: Adding query filter params (name=member) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:55.425163 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28020387-f787-4378-86f8-b62311f33d69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:55.426690 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28020387-f787-4378-86f8-b62311f33d69 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:55.439560 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 180/361] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 8 13:34:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:55.441173 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8f6a5-fb63-4951-82ab-0fff695f6008 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:55.441512 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8f6a5-fb63-4951-82ab-0fff695f6008 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:55.441844 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8f6a5-fb63-4951-82ab-0fff695f6008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:55.465457 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-61d8f6a5-fb63-4951-82ab-0fff695f6008 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:55.466672 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-61d8f6a5-fb63-4951-82ab-0fff695f6008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:55.470834 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:55.474885 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b726b-3083-4e18-b5f5-d1eb7d09998b None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:55.517657 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae8498-d394-428c-9204-a5dfde058b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:55.518405 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae8498-d394-428c-9204-a5dfde058b07 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:55.518687 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae8498-d394-428c-9204-a5dfde058b07 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:55.518965 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae8498-d394-428c-9204-a5dfde058b07 None admin] PATH_INFO: `/v3/projects/8afaf32861dc4e62a9b32129a27c4900` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:55.520118 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae8498-d394-428c-9204-a5dfde058b07 None admin] RBAC: Authorizing `identity:get_project(project_id=8afaf32861dc4e62a9b32129a27c4900)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:55.521606 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae8498-d394-428c-9204-a5dfde058b07 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:55.523951 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 182/362] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:34:55 2022] GET /identity/v3/projects/8afaf32861dc4e62a9b32129a27c4900 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:55.525080 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae8498-d394-428c-9204-a5dfde058b07 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:55.556304 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 181/363] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:34:55.557835 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d8f6a5-fb63-4951-82ab-0fff695f6008 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:55.601644 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:55.654435 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae8498-d394-428c-9204-a5dfde058b07 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:55.684837 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d8f6a5-fb63-4951-82ab-0fff695f6008 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:55.693461 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f182f-ca9f-4c7e-a848-1926b91dae17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:55.694113 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f182f-ca9f-4c7e-a848-1926b91dae17 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:55.694393 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f182f-ca9f-4c7e-a848-1926b91dae17 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:55.694663 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f182f-ca9f-4c7e-a848-1926b91dae17 None admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:55.695434 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67f182f-ca9f-4c7e-a848-1926b91dae17 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:55.695739 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67f182f-ca9f-4c7e-a848-1926b91dae17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:55.697132 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67f182f-ca9f-4c7e-a848-1926b91dae17 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:55.709087 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 183/364] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:34:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:55.710309 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f182f-ca9f-4c7e-a848-1926b91dae17 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:55.735344 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab18fe-c3db-4b5d-a493-0a05206fa4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:55.736205 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab18fe-c3db-4b5d-a493-0a05206fa4d4 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:55.736537 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab18fe-c3db-4b5d-a493-0a05206fa4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:55.736819 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab18fe-c3db-4b5d-a493-0a05206fa4d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:55.751500 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:55.836958 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab18fe-c3db-4b5d-a493-0a05206fa4d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:55.838810 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab18fe-c3db-4b5d-a493-0a05206fa4d4 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:55.850839 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f182f-ca9f-4c7e-a848-1926b91dae17 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:55.873520 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:55.892476 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d96d3-2266-48c7-8e75-a08da25f7efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:55.893114 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d96d3-2266-48c7-8e75-a08da25f7efe None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:55.893755 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d96d3-2266-48c7-8e75-a08da25f7efe None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:55.894037 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d96d3-2266-48c7-8e75-a08da25f7efe None admin] PATH_INFO: `/v3/groups/3ba5e6d8fb3d438597b383a9a40eaf0b` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:55.895448 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d96d3-2266-48c7-8e75-a08da25f7efe None admin] RBAC: Authorizing `identity:get_group(group_id=3ba5e6d8fb3d438597b383a9a40eaf0b)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:55.898266 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d96d3-2266-48c7-8e75-a08da25f7efe None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:55.900678 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 184/365] 10.222.0.69 () {56 vars in 1180 bytes} [Thu Sep 8 13:34:55 2022] GET /identity/v3/groups/3ba5e6d8fb3d438597b383a9a40eaf0b => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:55.902756 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d96d3-2266-48c7-8e75-a08da25f7efe None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:55.984713 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 182/366] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:34:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:34:55.984713 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab18fe-c3db-4b5d-a493-0a05206fa4d4 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:56.036758 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:56.039540 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d96d3-2266-48c7-8e75-a08da25f7efe None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:56.091856 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eabb182-49eb-437b-a5bd-0fb0ee622953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:56.091856 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eabb182-49eb-437b-a5bd-0fb0ee622953 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:56.091856 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eabb182-49eb-437b-a5bd-0fb0ee622953 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:56.091856 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eabb182-49eb-437b-a5bd-0fb0ee622953 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:56.136555 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab18fe-c3db-4b5d-a493-0a05206fa4d4 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:56.174708 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:56.183671 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b8db3-e21c-4c90-809f-8096635f2718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:56.185201 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b8db3-e21c-4c90-809f-8096635f2718 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:56.185201 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b8db3-e21c-4c90-809f-8096635f2718 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:56.185201 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b8db3-e21c-4c90-809f-8096635f2718 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:56.196692 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eabb182-49eb-437b-a5bd-0fb0ee622953 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:56.198425 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eabb182-49eb-437b-a5bd-0fb0ee622953 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:56.202943 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b8db3-e21c-4c90-809f-8096635f2718 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:34:56.209500 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-e77b8db3-e21c-4c90-809f-8096635f2718 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:34:56.209500 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:34:56.209500 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:34:56.209500 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:34:56.209500 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:34:56.209500 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:34:56.209500 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:34:56.209500 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:34:56.209500 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:34:56.209500 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:34:56.209500 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:34:56.209500 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:34:56.209500 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:34:56.209500 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:34:56.209500 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:34:56.209500 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:34:56.210703 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:34:56.210703 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:34:56.210703 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:34:56.210703 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:34:56.210703 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:34:56.210703 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:34:56.210703 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:34:56.210703 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:34:56.210703 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:34:56.210703 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:34:56.210703 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:34:56.210703 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:34:56.210703 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:34:56.210703 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:34:56.210703 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:34:56.210703 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:34:56.211739 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:34:56.211739 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:34:56.211739 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:34:56.211739 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:34:56.211739 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:34:56.211739 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:34:56.211739 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:34:56.211739 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:34:56.211739 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:34:56.211739 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:34:56.211739 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:34:56.211739 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:34:56.211739 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 183/367] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 8 13:34:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:34:56.212588 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b8db3-e21c-4c90-809f-8096635f2718 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:56.360439 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 185/368] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:34:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:34:56.361946 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eabb182-49eb-437b-a5bd-0fb0ee622953 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:56.373051 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:56.376964 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b8db3-e21c-4c90-809f-8096635f2718 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:56.424812 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ba6c7-356a-4c79-bc2c-cae310f3e4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:56.425609 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ba6c7-356a-4c79-bc2c-cae310f3e4f0 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:56.425885 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ba6c7-356a-4c79-bc2c-cae310f3e4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:56.426424 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ba6c7-356a-4c79-bc2c-cae310f3e4f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:56.427531 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434ba6c7-356a-4c79-bc2c-cae310f3e4f0 None admin] RBAC: Adding query filter params (group.id=3ba5e6d8fb3d438597b383a9a40eaf0b, role.id=a0b9865e737f48f2975da1bb8cb386b7, scope.project.id=8afaf32861dc4e62a9b32129a27c4900) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:56.427848 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434ba6c7-356a-4c79-bc2c-cae310f3e4f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:56.429958 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434ba6c7-356a-4c79-bc2c-cae310f3e4f0 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:56.437213 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 184/369] 10.222.0.69 () {56 vars in 1376 bytes} [Thu Sep 8 13:34:56 2022] GET /identity/v3/role_assignments?group.id=3ba5e6d8fb3d438597b383a9a40eaf0b&scope.project.id=8afaf32861dc4e62a9b32129a27c4900&role.id=a0b9865e737f48f2975da1bb8cb386b7 => generated 260 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:56.440934 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ba6c7-356a-4c79-bc2c-cae310f3e4f0 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:56.482067 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:56.498003 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eabb182-49eb-437b-a5bd-0fb0ee622953 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:56.538201 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a9102-ad8e-4ef6-b9f8-1005b7ceb69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:56.538949 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a9102-ad8e-4ef6-b9f8-1005b7ceb69e None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:56.539229 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a9102-ad8e-4ef6-b9f8-1005b7ceb69e None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:56.539502 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a9102-ad8e-4ef6-b9f8-1005b7ceb69e None admin] PATH_INFO: `/v3/projects/06fa14b343d84890b6385d02bd48c9b7` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:56.540700 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a9102-ad8e-4ef6-b9f8-1005b7ceb69e None admin] RBAC: Authorizing `identity:get_project(project_id=06fa14b343d84890b6385d02bd48c9b7)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:56.542217 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a9102-ad8e-4ef6-b9f8-1005b7ceb69e None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:56.544101 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 186/370] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:34:56 2022] GET /identity/v3/projects/06fa14b343d84890b6385d02bd48c9b7 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:56.544706 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a9102-ad8e-4ef6-b9f8-1005b7ceb69e None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:56.583818 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ba6c7-356a-4c79-bc2c-cae310f3e4f0 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:56.635679 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1eb057-7377-4056-bf2a-0b288e7c717b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:56.636220 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1eb057-7377-4056-bf2a-0b288e7c717b None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:56.636492 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1eb057-7377-4056-bf2a-0b288e7c717b None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:56.636780 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1eb057-7377-4056-bf2a-0b288e7c717b None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:56.637578 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1eb057-7377-4056-bf2a-0b288e7c717b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:56.637883 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1eb057-7377-4056-bf2a-0b288e7c717b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:56.639455 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1eb057-7377-4056-bf2a-0b288e7c717b None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:56.651949 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 185/371] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:34:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:56.652999 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1eb057-7377-4056-bf2a-0b288e7c717b None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:56.684969 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a9102-ad8e-4ef6-b9f8-1005b7ceb69e None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:56.690520 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:56.730159 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f744c3cd-7a91-4c3b-8830-8e243d958195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:56.730799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744c3cd-7a91-4c3b-8830-8e243d958195 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:56.731238 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744c3cd-7a91-4c3b-8830-8e243d958195 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:56.731660 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744c3cd-7a91-4c3b-8830-8e243d958195 None admin] PATH_INFO: `/v3/projects/06fa14b343d84890b6385d02bd48c9b7` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:56.733109 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f744c3cd-7a91-4c3b-8830-8e243d958195 None admin] RBAC: Authorizing `identity:get_project(project_id=06fa14b343d84890b6385d02bd48c9b7)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:56.735300 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f744c3cd-7a91-4c3b-8830-8e243d958195 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:56.737909 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 187/372] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:34:56 2022] GET /identity/v3/projects/06fa14b343d84890b6385d02bd48c9b7 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:56.738851 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f744c3cd-7a91-4c3b-8830-8e243d958195 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:56.777375 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:56.791707 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1eb057-7377-4056-bf2a-0b288e7c717b None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:56.839242 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a91018-6537-4088-989d-4ae13c9b2e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:56.839880 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a91018-6537-4088-989d-4ae13c9b2e29 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:56.840162 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a91018-6537-4088-989d-4ae13c9b2e29 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:56.840437 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a91018-6537-4088-989d-4ae13c9b2e29 None admin] PATH_INFO: `/v3/groups/3ba5e6d8fb3d438597b383a9a40eaf0b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:56.842086 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a91018-6537-4088-989d-4ae13c9b2e29 None admin] RBAC: Authorizing `identity:get_group(group_id=3ba5e6d8fb3d438597b383a9a40eaf0b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:56.844427 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a91018-6537-4088-989d-4ae13c9b2e29 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:56.847068 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 186/373] 10.222.0.69 () {56 vars in 1180 bytes} [Thu Sep 8 13:34:56 2022] GET /identity/v3/groups/3ba5e6d8fb3d438597b383a9a40eaf0b => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:56.848093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a91018-6537-4088-989d-4ae13c9b2e29 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:56.878596 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f744c3cd-7a91-4c3b-8830-8e243d958195 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:56.927707 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b3e45-276c-4b40-8d55-63d8cffe0d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:56.928873 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b3e45-276c-4b40-8d55-63d8cffe0d49 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:56.929439 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b3e45-276c-4b40-8d55-63d8cffe0d49 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:56.929889 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b3e45-276c-4b40-8d55-63d8cffe0d49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:56.977109 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:56.985218 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a91018-6537-4088-989d-4ae13c9b2e29 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:57.013956 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b3e45-276c-4b40-8d55-63d8cffe0d49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:57.015783 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b3e45-276c-4b40-8d55-63d8cffe0d49 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:57.028866 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382417d4-4d54-4904-9484-fc8ab9e5c092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:57.029552 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382417d4-4d54-4904-9484-fc8ab9e5c092 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:57.029838 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382417d4-4d54-4904-9484-fc8ab9e5c092 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:57.030119 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382417d4-4d54-4904-9484-fc8ab9e5c092 None admin] PATH_INFO: `/v3/groups/3ba5e6d8fb3d438597b383a9a40eaf0b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:57.031348 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382417d4-4d54-4904-9484-fc8ab9e5c092 None admin] RBAC: Authorizing `identity:get_group(group_id=3ba5e6d8fb3d438597b383a9a40eaf0b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:57.033601 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382417d4-4d54-4904-9484-fc8ab9e5c092 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:57.035999 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 187/374] 10.222.0.69 () {56 vars in 1180 bytes} [Thu Sep 8 13:34:56 2022] GET /identity/v3/groups/3ba5e6d8fb3d438597b383a9a40eaf0b => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:57.036847 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382417d4-4d54-4904-9484-fc8ab9e5c092 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:57.070545 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:57.155454 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 188/375] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:34:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:34:57.156737 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b3e45-276c-4b40-8d55-63d8cffe0d49 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:57.171100 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382417d4-4d54-4904-9484-fc8ab9e5c092 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:57.226091 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66d622-1ec1-46c7-801e-2844d75e2183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:57.226719 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66d622-1ec1-46c7-801e-2844d75e2183 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:57.226999 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66d622-1ec1-46c7-801e-2844d75e2183 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:57.227485 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb66d622-1ec1-46c7-801e-2844d75e2183 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:57.228231 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb66d622-1ec1-46c7-801e-2844d75e2183 None admin] RBAC: Adding query filter params (group.id=3ba5e6d8fb3d438597b383a9a40eaf0b, role.id=0735c260e70441cc87ad611b789d5c56, scope.project.id=06fa14b343d84890b6385d02bd48c9b7) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:57.228547 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb66d622-1ec1-46c7-801e-2844d75e2183 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:57.230059 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb66d622-1ec1-46c7-801e-2844d75e2183 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:57.238330 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 188/376] 10.222.0.69 () {56 vars in 1376 bytes} [Thu Sep 8 13:34:57 2022] GET /identity/v3/role_assignments?group.id=3ba5e6d8fb3d438597b383a9a40eaf0b&scope.project.id=06fa14b343d84890b6385d02bd48c9b7&role.id=0735c260e70441cc87ad611b789d5c56 => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:57.239516 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66d622-1ec1-46c7-801e-2844d75e2183 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:57.308698 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:57.344746 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b3e45-276c-4b40-8d55-63d8cffe0d49 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:57.393770 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:57.420890 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2836676-19f5-43ee-ba90-b551dd4fb008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:57.421978 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2836676-19f5-43ee-ba90-b551dd4fb008 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:57.422266 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2836676-19f5-43ee-ba90-b551dd4fb008 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:57.422543 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2836676-19f5-43ee-ba90-b551dd4fb008 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:57.423304 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2836676-19f5-43ee-ba90-b551dd4fb008 None admin] RBAC: Adding query filter params (group.id=3ba5e6d8fb3d438597b383a9a40eaf0b, role.id=a0b9865e737f48f2975da1bb8cb386b7, scope.project.id=06fa14b343d84890b6385d02bd48c9b7) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:57.423616 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2836676-19f5-43ee-ba90-b551dd4fb008 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:57.425120 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2836676-19f5-43ee-ba90-b551dd4fb008 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:57.436252 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 189/377] 10.222.0.69 () {56 vars in 1376 bytes} [Thu Sep 8 13:34:57 2022] GET /identity/v3/role_assignments?group.id=3ba5e6d8fb3d438597b383a9a40eaf0b&scope.project.id=06fa14b343d84890b6385d02bd48c9b7&role.id=a0b9865e737f48f2975da1bb8cb386b7 => generated 260 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:57.457869 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb66d622-1ec1-46c7-801e-2844d75e2183 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:57.509272 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56650d15-4b93-417e-9d25-fbbf31d75e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:57.509932 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56650d15-4b93-417e-9d25-fbbf31d75e22 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:57.510217 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56650d15-4b93-417e-9d25-fbbf31d75e22 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:57.510494 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56650d15-4b93-417e-9d25-fbbf31d75e22 None admin] PATH_INFO: `/v3/projects/a72572f147214da489cf8bb75dc22284` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:57.513409 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56650d15-4b93-417e-9d25-fbbf31d75e22 None admin] RBAC: Authorizing `identity:get_project(project_id=a72572f147214da489cf8bb75dc22284)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:57.515010 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56650d15-4b93-417e-9d25-fbbf31d75e22 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:57.517309 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 189/378] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:34:57 2022] GET /identity/v3/projects/a72572f147214da489cf8bb75dc22284 => generated 344 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:57.523694 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2836676-19f5-43ee-ba90-b551dd4fb008 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:57.654665 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2836676-19f5-43ee-ba90-b551dd4fb008 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:57.699854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e748b-b0fc-4495-9372-e6d6ee5461ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:57.700591 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e748b-b0fc-4495-9372-e6d6ee5461ef None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:57.700946 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e748b-b0fc-4495-9372-e6d6ee5461ef None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:57.701220 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e748b-b0fc-4495-9372-e6d6ee5461ef None admin] PATH_INFO: `/v3/groups/5d5b1d6a711d47339f4fc7f269bf4c1d` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:57.707789 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914e748b-b0fc-4495-9372-e6d6ee5461ef None admin] RBAC: Authorizing `identity:get_group(group_id=5d5b1d6a711d47339f4fc7f269bf4c1d)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:57.709347 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914e748b-b0fc-4495-9372-e6d6ee5461ef None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:57.711454 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 190/379] 10.222.0.69 () {56 vars in 1180 bytes} [Thu Sep 8 13:34:57 2022] GET /identity/v3/groups/5d5b1d6a711d47339f4fc7f269bf4c1d => generated 229 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:57.717133 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56650d15-4b93-417e-9d25-fbbf31d75e22 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:57.833347 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:57.843869 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56650d15-4b93-417e-9d25-fbbf31d75e22 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:57.894813 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d366c4f-80b4-4414-9dcd-2b301f82b25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:57.895448 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d366c4f-80b4-4414-9dcd-2b301f82b25d None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:57.895735 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d366c4f-80b4-4414-9dcd-2b301f82b25d None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:57.896014 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d366c4f-80b4-4414-9dcd-2b301f82b25d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:57.896779 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d366c4f-80b4-4414-9dcd-2b301f82b25d None admin] RBAC: Adding query filter params (group.id=5d5b1d6a711d47339f4fc7f269bf4c1d, role.id=9c76f398c9e04caeab83842e70eb824b, scope.project.id=a72572f147214da489cf8bb75dc22284) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:57.897640 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d366c4f-80b4-4414-9dcd-2b301f82b25d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:57.899196 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d366c4f-80b4-4414-9dcd-2b301f82b25d None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:57.907299 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 190/380] 10.222.0.69 () {56 vars in 1376 bytes} [Thu Sep 8 13:34:57 2022] GET /identity/v3/role_assignments?group.id=5d5b1d6a711d47339f4fc7f269bf4c1d&scope.project.id=a72572f147214da489cf8bb75dc22284&role.id=9c76f398c9e04caeab83842e70eb824b => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:57.990037 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930cfe4f-5873-403c-b5ca-9b5b057c0ef0 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:57.990440 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930cfe4f-5873-403c-b5ca-9b5b057c0ef0 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:57.990765 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930cfe4f-5873-403c-b5ca-9b5b057c0ef0 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:57.992405 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 191/381] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:34:57.998101 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa1a53-17e3-48c6-bc83-6b119af11b5f None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:57.998385 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa1a53-17e3-48c6-bc83-6b119af11b5f None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:57.998664 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa1a53-17e3-48c6-bc83-6b119af11b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:58.031417 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-f3aa1a53-17e3-48c6-bc83-6b119af11b5f None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:58.032671 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-f3aa1a53-17e3-48c6-bc83-6b119af11b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:58.125692 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 191/382] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:34:58.609700 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930cfe4f-5873-403c-b5ca-9b5b057c0ef0 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:58.682367 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:58.751010 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930cfe4f-5873-403c-b5ca-9b5b057c0ef0 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:58.800208 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859de69a-d0c9-4a31-8ac1-dd0fe93ac391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:58.800867 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859de69a-d0c9-4a31-8ac1-dd0fe93ac391 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:58.801149 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859de69a-d0c9-4a31-8ac1-dd0fe93ac391 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:58.801445 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859de69a-d0c9-4a31-8ac1-dd0fe93ac391 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:58.819341 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859de69a-d0c9-4a31-8ac1-dd0fe93ac391 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:34:58.824376 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-859de69a-d0c9-4a31-8ac1-dd0fe93ac391 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:34:58.824376 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:34:58.824376 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:34:58.824376 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:34:58.824376 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:34:58.824376 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:34:58.824376 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:34:58.824376 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:34:58.824376 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:34:58.824376 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:34:58.824376 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:34:58.824376 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:34:58.824376 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:34:58.824376 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:34:58.824376 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:34:58.824376 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:34:58.825387 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:34:58.825387 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:34:58.825387 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:34:58.825387 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:34:58.825387 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:34:58.825387 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:34:58.825387 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:34:58.825387 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:34:58.825387 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:34:58.825387 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:34:58.825387 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:34:58.825387 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:34:58.825387 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:34:58.825387 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:34:58.825387 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:34:58.825387 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:34:58.826188 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:34:58.826188 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:34:58.826188 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:34:58.826188 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:34:58.826188 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:34:58.826188 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:34:58.826188 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:34:58.826188 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:34:58.826188 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:34:58.826188 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:34:58.826188 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:34:58.826188 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:34:58.826188 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 192/383] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:34:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:34:58.833302 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa1a53-17e3-48c6-bc83-6b119af11b5f None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:58.993998 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:58.995206 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb8b40-412f-438f-a512-6c52ac47dadb None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:58.995692 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb8b40-412f-438f-a512-6c52ac47dadb None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:58.996196 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb8b40-412f-438f-a512-6c52ac47dadb None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:58.999078 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 193/384] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:34:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:34:59.004692 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0106e2-ef1d-433a-8212-46d5e41ebdfb None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:59.005238 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0106e2-ef1d-433a-8212-46d5e41ebdfb None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:59.005754 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0106e2-ef1d-433a-8212-46d5e41ebdfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:59.013732 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa1a53-17e3-48c6-bc83-6b119af11b5f None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:59.030303 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-cb0106e2-ef1d-433a-8212-46d5e41ebdfb None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:34:59.031867 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-cb0106e2-ef1d-433a-8212-46d5e41ebdfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:34:59.065186 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf49bb-bc78-4294-a0e4-81fdfcde6571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:59.066169 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf49bb-bc78-4294-a0e4-81fdfcde6571 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:59.066640 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf49bb-bc78-4294-a0e4-81fdfcde6571 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:59.067121 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf49bb-bc78-4294-a0e4-81fdfcde6571 None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:59.067992 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadf49bb-bc78-4294-a0e4-81fdfcde6571 None admin] RBAC: Adding query filter params (name=member) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:59.068485 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadf49bb-bc78-4294-a0e4-81fdfcde6571 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:59.070862 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadf49bb-bc78-4294-a0e4-81fdfcde6571 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:59.080575 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 192/385] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 8 13:34:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:59.086393 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf49bb-bc78-4294-a0e4-81fdfcde6571 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:59.171694 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 194/386] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:34:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:34:59.256568 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf49bb-bc78-4294-a0e4-81fdfcde6571 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:59.301733 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfc259-6c85-489c-a150-25619c713ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:59.302826 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfc259-6c85-489c-a150-25619c713ef0 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:59.303506 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfc259-6c85-489c-a150-25619c713ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:59.303971 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfc259-6c85-489c-a150-25619c713ef0 None admin] PATH_INFO: `/v3/groups/3ba5e6d8fb3d438597b383a9a40eaf0b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:59.305350 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbfc259-6c85-489c-a150-25619c713ef0 None admin] RBAC: Authorizing `identity:get_group(group_id=3ba5e6d8fb3d438597b383a9a40eaf0b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:59.306984 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbfc259-6c85-489c-a150-25619c713ef0 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:59.309112 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 193/387] 10.222.0.69 () {56 vars in 1180 bytes} [Thu Sep 8 13:34:59 2022] GET /identity/v3/groups/3ba5e6d8fb3d438597b383a9a40eaf0b => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:34:59.314417 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0106e2-ef1d-433a-8212-46d5e41ebdfb None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:59.388572 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:59.465825 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0106e2-ef1d-433a-8212-46d5e41ebdfb None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:59.516504 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75411b-781d-4e57-8531-272547b93a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:59.517056 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75411b-781d-4e57-8531-272547b93a08 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:59.517334 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75411b-781d-4e57-8531-272547b93a08 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:59.517635 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd75411b-781d-4e57-8531-272547b93a08 None admin] PATH_INFO: `/v3/projects/8afaf32861dc4e62a9b32129a27c4900` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:59.518782 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd75411b-781d-4e57-8531-272547b93a08 None admin] RBAC: Authorizing `identity:get_project(project_id=8afaf32861dc4e62a9b32129a27c4900)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:59.520228 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd75411b-781d-4e57-8531-272547b93a08 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:59.522215 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 195/388] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:34:59 2022] GET /identity/v3/projects/8afaf32861dc4e62a9b32129a27c4900 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:34:59.527959 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfc259-6c85-489c-a150-25619c713ef0 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:59.554615 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:59.556345 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75411b-781d-4e57-8531-272547b93a08 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:59.686077 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd75411b-781d-4e57-8531-272547b93a08 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:59.698525 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:59.724426 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfc259-6c85-489c-a150-25619c713ef0 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:59.728373 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afcfbd-c4ef-4bc6-a6e2-f5683635e8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:59.729195 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afcfbd-c4ef-4bc6-a6e2-f5683635e8e0 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:59.729663 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afcfbd-c4ef-4bc6-a6e2-f5683635e8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:59.730150 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afcfbd-c4ef-4bc6-a6e2-f5683635e8e0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:59.742296 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5afcfbd-c4ef-4bc6-a6e2-f5683635e8e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:34:59.748164 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-b5afcfbd-c4ef-4bc6-a6e2-f5683635e8e0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:34:59.748164 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:34:59.748164 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:34:59.748164 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:34:59.748164 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:34:59.748164 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:34:59.748164 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:34:59.748164 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:34:59.748164 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:34:59.748164 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:34:59.748164 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:34:59.748164 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:34:59.748164 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:34:59.748164 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:34:59.748164 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:34:59.748164 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:34:59.749042 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:34:59.749042 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:34:59.749042 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:34:59.749042 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:34:59.749042 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:34:59.749042 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:34:59.749042 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:34:59.749042 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:34:59.749042 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:34:59.749042 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:34:59.749042 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:34:59.749042 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:34:59.749042 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:34:59.749042 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:34:59.749042 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:34:59.749042 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:34:59.749885 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:34:59.749885 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:34:59.749885 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:34:59.749885 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:34:59.749885 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:34:59.749885 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:34:59.749885 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:34:59.749885 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:34:59.749885 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:34:59.749885 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:34:59.749885 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:34:59.749885 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:34:59.752131 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 196/389] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Sep 8 13:34:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:34:59.759436 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afcfbd-c4ef-4bc6-a6e2-f5683635e8e0 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:34:59.784920 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0097faf-c54c-4973-a69d-c67fd5ee4bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:59.785905 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0097faf-c54c-4973-a69d-c67fd5ee4bb1 None admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:59.786322 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0097faf-c54c-4973-a69d-c67fd5ee4bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:59.786736 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0097faf-c54c-4973-a69d-c67fd5ee4bb1 None admin] PATH_INFO: `/v3/projects/8afaf32861dc4e62a9b32129a27c4900/groups/3ba5e6d8fb3d438597b383a9a40eaf0b/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:59.788927 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0097faf-c54c-4973-a69d-c67fd5ee4bb1 None admin] RBAC: Authorizing `identity:create_grant(project_id=8afaf32861dc4e62a9b32129a27c4900, group_id=3ba5e6d8fb3d438597b383a9a40eaf0b, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:59.790950 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0097faf-c54c-4973-a69d-c67fd5ee4bb1 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:59.811808 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 194/390] 10.222.0.69 () {58 vars in 1442 bytes} [Thu Sep 8 13:34:59 2022] PUT /identity/v3/projects/8afaf32861dc4e62a9b32129a27c4900/groups/3ba5e6d8fb3d438597b383a9a40eaf0b/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:34:59.905672 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afcfbd-c4ef-4bc6-a6e2-f5683635e8e0 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:34:59.944334 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c167d2-8e2a-4d5b-bc17-8ef0cb9c1da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:34:59.945269 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c167d2-8e2a-4d5b-bc17-8ef0cb9c1da1 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:34:59.945784 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c167d2-8e2a-4d5b-bc17-8ef0cb9c1da1 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:34:59.946413 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c167d2-8e2a-4d5b-bc17-8ef0cb9c1da1 None admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:34:59.947313 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c167d2-8e2a-4d5b-bc17-8ef0cb9c1da1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:34:59.947831 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c167d2-8e2a-4d5b-bc17-8ef0cb9c1da1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:34:59.949430 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c167d2-8e2a-4d5b-bc17-8ef0cb9c1da1 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:34:59.959777 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 197/391] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:34:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:34:59.966892 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0097faf-c54c-4973-a69d-c67fd5ee4bb1 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:00.076757 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:00.103377 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0097faf-c54c-4973-a69d-c67fd5ee4bb1 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:00.144023 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344bf6eb-5c1c-463c-9121-136582e83485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:00.145114 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344bf6eb-5c1c-463c-9121-136582e83485 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:00.145662 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344bf6eb-5c1c-463c-9121-136582e83485 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:00.146170 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344bf6eb-5c1c-463c-9121-136582e83485 None admin] PATH_INFO: `/v3/groups/3ba5e6d8fb3d438597b383a9a40eaf0b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:00.148745 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344bf6eb-5c1c-463c-9121-136582e83485 None admin] RBAC: Authorizing `identity:get_group(group_id=3ba5e6d8fb3d438597b383a9a40eaf0b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:00.151566 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344bf6eb-5c1c-463c-9121-136582e83485 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:00.154968 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 195/392] 10.222.0.69 () {56 vars in 1180 bytes} [Thu Sep 8 13:34:59 2022] GET /identity/v3/groups/3ba5e6d8fb3d438597b383a9a40eaf0b => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:00.160398 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c167d2-8e2a-4d5b-bc17-8ef0cb9c1da1 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:00.193351 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:00.237057 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681049c0-ad4c-4e8a-baa5-1f0f671b834d None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:00.237338 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681049c0-ad4c-4e8a-baa5-1f0f671b834d None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:00.237645 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681049c0-ad4c-4e8a-baa5-1f0f671b834d None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:00.239258 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 196/393] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:35:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:35:00.250827 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6eed1-445f-45b8-bb97-1a5a006c3799 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:00.251120 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6eed1-445f-45b8-bb97-1a5a006c3799 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:00.251384 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6eed1-445f-45b8-bb97-1a5a006c3799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:00.271311 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-f1e6eed1-445f-45b8-bb97-1a5a006c3799 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:35:00.272931 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-f1e6eed1-445f-45b8-bb97-1a5a006c3799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:35:00.318480 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c167d2-8e2a-4d5b-bc17-8ef0cb9c1da1 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:00.389311 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 197/394] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:35:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:35:00.406323 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b98dc8-f7fc-407d-9dd5-9fedc4250968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:00.406998 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b98dc8-f7fc-407d-9dd5-9fedc4250968 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:00.407281 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b98dc8-f7fc-407d-9dd5-9fedc4250968 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:00.407554 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b98dc8-f7fc-407d-9dd5-9fedc4250968 None admin] PATH_INFO: `/v3/projects/8afaf32861dc4e62a9b32129a27c4900` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:00.408927 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b98dc8-f7fc-407d-9dd5-9fedc4250968 None admin] RBAC: Authorizing `identity:get_project(project_id=8afaf32861dc4e62a9b32129a27c4900)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:00.410483 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b98dc8-f7fc-407d-9dd5-9fedc4250968 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:00.413185 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 198/395] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:35:00 2022] GET /identity/v3/projects/8afaf32861dc4e62a9b32129a27c4900 => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:00.418761 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6eed1-445f-45b8-bb97-1a5a006c3799 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:00.510530 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:00.537205 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa153ec-8a5a-43fe-936e-835ef776a40c None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:00.538087 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa153ec-8a5a-43fe-936e-835ef776a40c None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:00.538375 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa153ec-8a5a-43fe-936e-835ef776a40c None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:00.539838 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 199/396] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:35:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:35:00.545132 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6eed1-445f-45b8-bb97-1a5a006c3799 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:00.548968 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acb155-e283-42df-99b2-bedb7f39c0c4 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:00.549264 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acb155-e283-42df-99b2-bedb7f39c0c4 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:00.549581 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acb155-e283-42df-99b2-bedb7f39c0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:00.593388 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-c4acb155-e283-42df-99b2-bedb7f39c0c4 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:35:00.593388 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-c4acb155-e283-42df-99b2-bedb7f39c0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:35:00.593681 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71179d0-3c67-44d3-98ea-9ac9c40ef5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:00.593773 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71179d0-3c67-44d3-98ea-9ac9c40ef5b2 None admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:00.594056 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71179d0-3c67-44d3-98ea-9ac9c40ef5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:00.594332 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71179d0-3c67-44d3-98ea-9ac9c40ef5b2 None admin] PATH_INFO: `/v3/projects/8afaf32861dc4e62a9b32129a27c4900/groups/3ba5e6d8fb3d438597b383a9a40eaf0b/roles/a0b9865e737f48f2975da1bb8cb386b7` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:00.603450 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71179d0-3c67-44d3-98ea-9ac9c40ef5b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=8afaf32861dc4e62a9b32129a27c4900, group_id=3ba5e6d8fb3d438597b383a9a40eaf0b, role_id=a0b9865e737f48f2975da1bb8cb386b7)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:00.604888 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71179d0-3c67-44d3-98ea-9ac9c40ef5b2 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:00.626097 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 198/397] 10.222.0.69 () {58 vars in 1442 bytes} [Thu Sep 8 13:35:00 2022] PUT /identity/v3/projects/8afaf32861dc4e62a9b32129a27c4900/groups/3ba5e6d8fb3d438597b383a9a40eaf0b/roles/a0b9865e737f48f2975da1bb8cb386b7 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:35:00.696574 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 200/398] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:35:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:35:00.749348 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71179d0-3c67-44d3-98ea-9ac9c40ef5b2 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:00.881617 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431fd38-ced4-4684-b1b4-1a4308687049 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:00.882237 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431fd38-ced4-4684-b1b4-1a4308687049 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:00.882457 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431fd38-ced4-4684-b1b4-1a4308687049 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:00.883982 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 201/399] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:35:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:35:00.890175 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b066a0-95a4-432a-a73d-44669521faae None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:00.890463 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b066a0-95a4-432a-a73d-44669521faae None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:00.890732 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b066a0-95a4-432a-a73d-44669521faae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:00.892733 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71179d0-3c67-44d3-98ea-9ac9c40ef5b2 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:00.913793 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-49b066a0-95a4-432a-a73d-44669521faae None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:35:00.915007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-49b066a0-95a4-432a-a73d-44669521faae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:35:00.931690 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fec8e3-8cec-4a42-af52-2dd5530011c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:00.932334 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fec8e3-8cec-4a42-af52-2dd5530011c1 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:00.932615 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fec8e3-8cec-4a42-af52-2dd5530011c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:00.933034 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fec8e3-8cec-4a42-af52-2dd5530011c1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:00.936351 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:00.947392 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fec8e3-8cec-4a42-af52-2dd5530011c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:35:00.949736 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:00.952930 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-75fec8e3-8cec-4a42-af52-2dd5530011c1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:35:00.952930 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:00.952930 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:00.952930 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:00.952930 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:00.952930 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:00.952930 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:00.952930 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:00.952930 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:00.952930 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:00.952930 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:00.952930 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:00.952930 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:35:00.952930 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:35:00.952930 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:35:00.952930 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:35:00.953897 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:35:00.953897 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:35:00.953897 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:35:00.953897 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:35:00.953897 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:00.953897 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:00.953897 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:00.953897 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:00.953897 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:00.953897 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:00.953897 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:00.953897 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:00.953897 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:00.953897 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:00.953897 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:00.953897 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:00.954689 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:00.954689 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:00.954689 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:00.954689 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:00.954689 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:35:00.954689 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:35:00.954689 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:35:00.954689 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:35:00.954689 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:35:00.954689 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:35:00.954689 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:35:00.954689 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:00.954689 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 199/400] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:35:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:00.960998 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fec8e3-8cec-4a42-af52-2dd5530011c1 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:01.035256 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 202/401] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:35:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:35:01.036129 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b066a0-95a4-432a-a73d-44669521faae None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:01.152540 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b066a0-95a4-432a-a73d-44669521faae None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:01.191766 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fec8e3-8cec-4a42-af52-2dd5530011c1 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:01.192552 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3be6f7-2c2a-4e3d-a046-33228eca0b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:01.193275 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3be6f7-2c2a-4e3d-a046-33228eca0b34 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:01.193701 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3be6f7-2c2a-4e3d-a046-33228eca0b34 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:01.193986 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3be6f7-2c2a-4e3d-a046-33228eca0b34 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:01.206640 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3be6f7-2c2a-4e3d-a046-33228eca0b34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:35:01.212338 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-3e3be6f7-2c2a-4e3d-a046-33228eca0b34 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:35:01.212338 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:01.212338 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:01.212338 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:01.212338 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:01.212338 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:01.212338 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:01.212338 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:01.212338 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:01.212338 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:01.212338 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:01.212338 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:01.212338 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:35:01.212338 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:35:01.212338 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:35:01.212338 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:35:01.213236 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:35:01.213236 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:35:01.213236 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:35:01.213236 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:35:01.213236 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:01.213236 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:01.213236 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:01.213236 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:01.213236 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:01.213236 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:01.213236 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:01.213236 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:01.213236 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:01.213236 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:01.213236 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:01.213236 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:01.214089 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:01.214089 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:01.214089 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:01.214089 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:01.214089 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:35:01.214089 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:35:01.214089 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:35:01.214089 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:35:01.214089 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:35:01.214089 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:35:01.214089 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:35:01.214089 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:01.214089 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 203/402] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Sep 8 13:35:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:01.221209 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3be6f7-2c2a-4e3d-a046-33228eca0b34 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:01.251670 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:01.276069 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90f5042-5dd4-40a6-92eb-85db2a11f7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:01.278413 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f5042-5dd4-40a6-92eb-85db2a11f7c8 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:01.279175 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f5042-5dd4-40a6-92eb-85db2a11f7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:01.280335 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f5042-5dd4-40a6-92eb-85db2a11f7c8 None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:01.281255 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90f5042-5dd4-40a6-92eb-85db2a11f7c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:01.282178 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90f5042-5dd4-40a6-92eb-85db2a11f7c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:01.284471 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90f5042-5dd4-40a6-92eb-85db2a11f7c8 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:01.305009 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 200/403] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 8 13:35:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:01.310777 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90f5042-5dd4-40a6-92eb-85db2a11f7c8 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:01.417946 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:01.419199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3be6f7-2c2a-4e3d-a046-33228eca0b34 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:01.460333 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a3e9a-a1f8-4ef2-a60d-eb8a9601fe20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:01.460862 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a3e9a-a1f8-4ef2-a60d-eb8a9601fe20 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:01.461136 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a3e9a-a1f8-4ef2-a60d-eb8a9601fe20 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:01.461457 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a3e9a-a1f8-4ef2-a60d-eb8a9601fe20 None admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:01.462367 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a3e9a-a1f8-4ef2-a60d-eb8a9601fe20 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:01.462544 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a3e9a-a1f8-4ef2-a60d-eb8a9601fe20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:01.463898 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a3e9a-a1f8-4ef2-a60d-eb8a9601fe20 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:01.468942 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90f5042-5dd4-40a6-92eb-85db2a11f7c8 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:01.477402 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 204/404] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:35:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:35:01.477402 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a3e9a-a1f8-4ef2-a60d-eb8a9601fe20 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:01.514331 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b9ce4-7027-4185-915d-17d08a098af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:01.515363 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b9ce4-7027-4185-915d-17d08a098af7 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:01.515965 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b9ce4-7027-4185-915d-17d08a098af7 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:01.516531 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b9ce4-7027-4185-915d-17d08a098af7 None admin] PATH_INFO: `/v3/groups/3ba5e6d8fb3d438597b383a9a40eaf0b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:01.518074 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34b9ce4-7027-4185-915d-17d08a098af7 None admin] RBAC: Authorizing `identity:get_group(group_id=3ba5e6d8fb3d438597b383a9a40eaf0b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:01.519782 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34b9ce4-7027-4185-915d-17d08a098af7 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:01.522192 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 201/405] 10.222.0.69 () {56 vars in 1180 bytes} [Thu Sep 8 13:35:01 2022] GET /identity/v3/groups/3ba5e6d8fb3d438597b383a9a40eaf0b => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:35:01.523433 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b9ce4-7027-4185-915d-17d08a098af7 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:01.571252 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:01.592687 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a3e9a-a1f8-4ef2-a60d-eb8a9601fe20 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:01.631402 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff9852-dd8c-4bee-9ae8-018c9f4fa043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:01.632366 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff9852-dd8c-4bee-9ae8-018c9f4fa043 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:01.632480 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff9852-dd8c-4bee-9ae8-018c9f4fa043 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:01.632808 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff9852-dd8c-4bee-9ae8-018c9f4fa043 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:01.642524 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34b9ce4-7027-4185-915d-17d08a098af7 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:01.649909 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff9852-dd8c-4bee-9ae8-018c9f4fa043 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:35:01.658680 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-66ff9852-dd8c-4bee-9ae8-018c9f4fa043 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:35:01.658680 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:01.658680 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:01.658680 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:01.658680 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:01.658680 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:01.658680 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:01.658680 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:01.658680 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:01.658680 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:01.658680 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:01.658680 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:01.658680 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:35:01.658680 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:35:01.658680 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:35:01.658680 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:35:01.659651 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:35:01.659651 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:35:01.659651 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:35:01.659651 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:35:01.659651 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:01.659651 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:01.659651 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:01.659651 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:01.659651 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:01.659651 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:01.659651 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:01.659651 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:01.659651 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:01.659651 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:01.659651 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:01.659651 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:01.660463 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:01.660463 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:01.660463 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:01.660463 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:01.660463 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:35:01.660463 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:35:01.660463 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:35:01.660463 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:35:01.660463 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:35:01.660463 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:35:01.660463 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:35:01.660463 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:01.661071 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 205/406] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 8 13:35:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:01.665680 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff9852-dd8c-4bee-9ae8-018c9f4fa043 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:01.684908 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:01.698622 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06cdb9-79d4-46bf-a0c6-8ccc9d3adc18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:01.699525 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06cdb9-79d4-46bf-a0c6-8ccc9d3adc18 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:01.699870 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06cdb9-79d4-46bf-a0c6-8ccc9d3adc18 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:01.700680 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06cdb9-79d4-46bf-a0c6-8ccc9d3adc18 None admin] PATH_INFO: `/v3/groups/3ba5e6d8fb3d438597b383a9a40eaf0b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:01.702168 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d06cdb9-79d4-46bf-a0c6-8ccc9d3adc18 None admin] RBAC: Authorizing `identity:get_group(group_id=3ba5e6d8fb3d438597b383a9a40eaf0b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:01.704187 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d06cdb9-79d4-46bf-a0c6-8ccc9d3adc18 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:01.710835 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 202/407] 10.222.0.69 () {56 vars in 1180 bytes} [Thu Sep 8 13:35:01 2022] GET /identity/v3/groups/3ba5e6d8fb3d438597b383a9a40eaf0b => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:01.710835 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06cdb9-79d4-46bf-a0c6-8ccc9d3adc18 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:01.805579 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff9852-dd8c-4bee-9ae8-018c9f4fa043 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:01.852785 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f361c1f-a2b9-484a-a7f3-db98081af813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:01.854022 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f361c1f-a2b9-484a-a7f3-db98081af813 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:01.854481 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f361c1f-a2b9-484a-a7f3-db98081af813 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:01.854932 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f361c1f-a2b9-484a-a7f3-db98081af813 None admin] PATH_INFO: `/v3/projects/06fa14b343d84890b6385d02bd48c9b7` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:01.856817 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f361c1f-a2b9-484a-a7f3-db98081af813 None admin] RBAC: Authorizing `identity:get_project(project_id=06fa14b343d84890b6385d02bd48c9b7)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:01.858850 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f361c1f-a2b9-484a-a7f3-db98081af813 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:01.861431 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 206/408] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:35:01 2022] GET /identity/v3/projects/06fa14b343d84890b6385d02bd48c9b7 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:01.862483 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f361c1f-a2b9-484a-a7f3-db98081af813 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:01.881659 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:01.882560 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06cdb9-79d4-46bf-a0c6-8ccc9d3adc18 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:01.940419 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837f120-7669-490c-940f-a8ccd6d05886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:01.941201 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837f120-7669-490c-940f-a8ccd6d05886 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:01.941883 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837f120-7669-490c-940f-a8ccd6d05886 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:01.942205 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837f120-7669-490c-940f-a8ccd6d05886 None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:01.942938 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1837f120-7669-490c-940f-a8ccd6d05886 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:01.943300 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1837f120-7669-490c-940f-a8ccd6d05886 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:01.945571 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1837f120-7669-490c-940f-a8ccd6d05886 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:01.961616 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 203/409] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:35:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:01.962746 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837f120-7669-490c-940f-a8ccd6d05886 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:01.998759 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f361c1f-a2b9-484a-a7f3-db98081af813 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:02.042774 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34412643-dec3-4733-bb4a-dabefd1b4e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:02.043706 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34412643-dec3-4733-bb4a-dabefd1b4e4f None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:02.044164 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34412643-dec3-4733-bb4a-dabefd1b4e4f None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:02.044613 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34412643-dec3-4733-bb4a-dabefd1b4e4f None admin] PATH_INFO: `/v3/projects/06fa14b343d84890b6385d02bd48c9b7` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:02.046329 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34412643-dec3-4733-bb4a-dabefd1b4e4f None admin] RBAC: Authorizing `identity:get_project(project_id=06fa14b343d84890b6385d02bd48c9b7)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:02.046915 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:02.048245 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34412643-dec3-4733-bb4a-dabefd1b4e4f None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:02.055874 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 207/410] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:35:01 2022] GET /identity/v3/projects/06fa14b343d84890b6385d02bd48c9b7 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:02.057017 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34412643-dec3-4733-bb4a-dabefd1b4e4f None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:02.111147 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837f120-7669-490c-940f-a8ccd6d05886 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:02.146718 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:02.167827 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e10ad-acb9-42b1-b1c7-0c8fe29f1b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:02.168588 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e10ad-acb9-42b1-b1c7-0c8fe29f1b41 None admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:02.169149 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e10ad-acb9-42b1-b1c7-0c8fe29f1b41 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:02.169444 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4e10ad-acb9-42b1-b1c7-0c8fe29f1b41 None admin] PATH_INFO: `/v3/projects/06fa14b343d84890b6385d02bd48c9b7/groups/3ba5e6d8fb3d438597b383a9a40eaf0b/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:02.172142 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4e10ad-acb9-42b1-b1c7-0c8fe29f1b41 None admin] RBAC: Authorizing `identity:create_grant(project_id=06fa14b343d84890b6385d02bd48c9b7, group_id=3ba5e6d8fb3d438597b383a9a40eaf0b, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:02.172786 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34412643-dec3-4733-bb4a-dabefd1b4e4f None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:02.173606 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4e10ad-acb9-42b1-b1c7-0c8fe29f1b41 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:02.201795 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 204/411] 10.222.0.69 () {58 vars in 1442 bytes} [Thu Sep 8 13:35:01 2022] PUT /identity/v3/projects/06fa14b343d84890b6385d02bd48c9b7/groups/3ba5e6d8fb3d438597b383a9a40eaf0b/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:35:02.202966 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e10ad-acb9-42b1-b1c7-0c8fe29f1b41 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:02.248500 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7ac3b-bb4d-4ee8-9c05-44bfbec9a711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:02.248500 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7ac3b-bb4d-4ee8-9c05-44bfbec9a711 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:02.248500 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7ac3b-bb4d-4ee8-9c05-44bfbec9a711 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:02.248834 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7ac3b-bb4d-4ee8-9c05-44bfbec9a711 None admin] PATH_INFO: `/v3/groups/5d5b1d6a711d47339f4fc7f269bf4c1d` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:02.253403 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d7ac3b-bb4d-4ee8-9c05-44bfbec9a711 None admin] RBAC: Authorizing `identity:get_group(group_id=5d5b1d6a711d47339f4fc7f269bf4c1d)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:02.254232 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d7ac3b-bb4d-4ee8-9c05-44bfbec9a711 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:02.258987 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 208/412] 10.222.0.69 () {56 vars in 1180 bytes} [Thu Sep 8 13:35:02 2022] GET /identity/v3/groups/5d5b1d6a711d47339f4fc7f269bf4c1d => generated 229 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:02.268219 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7ac3b-bb4d-4ee8-9c05-44bfbec9a711 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:02.420562 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7ac3b-bb4d-4ee8-9c05-44bfbec9a711 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:02.470342 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7f64c-a18d-4e3d-ac85-959e7cf53b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:02.470987 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7f64c-a18d-4e3d-ac85-959e7cf53b14 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:02.471565 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7f64c-a18d-4e3d-ac85-959e7cf53b14 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:02.471841 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7f64c-a18d-4e3d-ac85-959e7cf53b14 None admin] PATH_INFO: `/v3/projects/a72572f147214da489cf8bb75dc22284` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:02.473839 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f7f64c-a18d-4e3d-ac85-959e7cf53b14 None admin] RBAC: Authorizing `identity:get_project(project_id=a72572f147214da489cf8bb75dc22284)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:02.475866 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f7f64c-a18d-4e3d-ac85-959e7cf53b14 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:02.478113 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 209/413] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:35:02 2022] GET /identity/v3/projects/a72572f147214da489cf8bb75dc22284 => generated 344 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:02.484275 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7f64c-a18d-4e3d-ac85-959e7cf53b14 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:02.493381 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4e10ad-acb9-42b1-b1c7-0c8fe29f1b41 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:02.520016 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:02.523008 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:02.557035 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b0a57-cbfa-44d5-80e3-6dab62b9b12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:02.557784 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b0a57-cbfa-44d5-80e3-6dab62b9b12f None admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:02.558071 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b0a57-cbfa-44d5-80e3-6dab62b9b12f None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:02.558351 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b0a57-cbfa-44d5-80e3-6dab62b9b12f None admin] PATH_INFO: `/v3/projects/06fa14b343d84890b6385d02bd48c9b7/groups/3ba5e6d8fb3d438597b383a9a40eaf0b/roles/a0b9865e737f48f2975da1bb8cb386b7` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:02.560578 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2b0a57-cbfa-44d5-80e3-6dab62b9b12f None admin] RBAC: Authorizing `identity:create_grant(project_id=06fa14b343d84890b6385d02bd48c9b7, group_id=3ba5e6d8fb3d438597b383a9a40eaf0b, role_id=a0b9865e737f48f2975da1bb8cb386b7)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:02.562742 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2b0a57-cbfa-44d5-80e3-6dab62b9b12f None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:02.580332 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 205/414] 10.222.0.69 () {58 vars in 1442 bytes} [Thu Sep 8 13:35:02 2022] PUT /identity/v3/projects/06fa14b343d84890b6385d02bd48c9b7/groups/3ba5e6d8fb3d438597b383a9a40eaf0b/roles/a0b9865e737f48f2975da1bb8cb386b7 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:35:02.582093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2325c-2fb4-4810-a910-b4d65a84c25c None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:02.582420 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2325c-2fb4-4810-a910-b4d65a84c25c None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:02.583214 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2325c-2fb4-4810-a910-b4d65a84c25c None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:02.585116 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 206/415] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:35:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:35:02.591560 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89bb29-e21b-4f15-b6a6-ca447de583c9 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:02.591795 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89bb29-e21b-4f15-b6a6-ca447de583c9 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:02.592211 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89bb29-e21b-4f15-b6a6-ca447de583c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:02.618246 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-3b89bb29-e21b-4f15-b6a6-ca447de583c9 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:35:02.619777 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-3b89bb29-e21b-4f15-b6a6-ca447de583c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:35:02.645715 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7f64c-a18d-4e3d-ac85-959e7cf53b14 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:02.685902 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961aa4f4-8812-474a-9595-a1795353fb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:02.686939 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961aa4f4-8812-474a-9595-a1795353fb55 None admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:02.687360 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961aa4f4-8812-474a-9595-a1795353fb55 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:02.687774 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961aa4f4-8812-474a-9595-a1795353fb55 None admin] PATH_INFO: `/v3/projects/a72572f147214da489cf8bb75dc22284/groups/5d5b1d6a711d47339f4fc7f269bf4c1d/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:02.690212 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961aa4f4-8812-474a-9595-a1795353fb55 None admin] RBAC: Authorizing `identity:create_grant(project_id=a72572f147214da489cf8bb75dc22284, group_id=5d5b1d6a711d47339f4fc7f269bf4c1d, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:02.692105 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961aa4f4-8812-474a-9595-a1795353fb55 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:02.710433 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 207/416] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:35:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:35:02.711086 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 210/417] 10.222.0.69 () {58 vars in 1442 bytes} [Thu Sep 8 13:35:02 2022] PUT /identity/v3/projects/a72572f147214da489cf8bb75dc22284/groups/5d5b1d6a711d47339f4fc7f269bf4c1d/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:35:03.053626 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89bb29-e21b-4f15-b6a6-ca447de583c9 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:03.170570 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89bb29-e21b-4f15-b6a6-ca447de583c9 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:03.178660 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:03.218163 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c26a1-01c3-4aee-a1bc-2a2f6db7c2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:03.218822 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c26a1-01c3-4aee-a1bc-2a2f6db7c2e0 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:03.219078 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c26a1-01c3-4aee-a1bc-2a2f6db7c2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:03.219348 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c26a1-01c3-4aee-a1bc-2a2f6db7c2e0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:03.234504 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c26a1-01c3-4aee-a1bc-2a2f6db7c2e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:35:03.239458 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-790c26a1-01c3-4aee-a1bc-2a2f6db7c2e0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:35:03.239458 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:03.239458 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:03.239458 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:03.239458 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:03.239458 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:03.239458 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:03.239458 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:03.239458 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:03.239458 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:03.239458 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:03.239458 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:03.239458 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:35:03.239458 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:35:03.239458 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:35:03.239458 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:35:03.240410 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:35:03.240410 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:35:03.240410 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:35:03.240410 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:35:03.240410 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:03.240410 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:03.240410 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:03.240410 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:03.240410 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:03.240410 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:03.240410 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:03.240410 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:03.240410 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:03.240410 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:03.240410 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:03.240410 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:03.241211 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:03.241211 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:03.241211 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:03.241211 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:03.241211 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:35:03.241211 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:35:03.241211 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:35:03.241211 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:35:03.241211 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:35:03.241211 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:35:03.241211 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:35:03.241211 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:03.241211 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 208/418] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:35:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:03.248738 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961aa4f4-8812-474a-9595-a1795353fb55 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:03.361821 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:03.396018 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961aa4f4-8812-474a-9595-a1795353fb55 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:03.449794 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67a9ee-2f95-4651-9369-2667001a032f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:03.450416 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67a9ee-2f95-4651-9369-2667001a032f None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:03.450693 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67a9ee-2f95-4651-9369-2667001a032f None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:03.450794 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e311cd0-01af-4ca7-a40e-6d461db9b321 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:03.450949 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e67a9ee-2f95-4651-9369-2667001a032f None admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:03.451038 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e311cd0-01af-4ca7-a40e-6d461db9b321 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:03.451296 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e311cd0-01af-4ca7-a40e-6d461db9b321 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:03.451620 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e67a9ee-2f95-4651-9369-2667001a032f None admin] RBAC: Adding query filter params (name=member) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:03.451917 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e67a9ee-2f95-4651-9369-2667001a032f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:03.452925 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 209/419] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:35:03.453302 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e67a9ee-2f95-4651-9369-2667001a032f None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:03.459713 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f46bd-e4e7-49c6-976a-b9d1799399cc None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:03.460086 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f46bd-e4e7-49c6-976a-b9d1799399cc None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:03.460594 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f46bd-e4e7-49c6-976a-b9d1799399cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:03.468023 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 211/420] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 8 13:35:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:03.473875 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67a9ee-2f95-4651-9369-2667001a032f None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:03.481886 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-d40f46bd-e4e7-49c6-976a-b9d1799399cc None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:35:03.483231 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-d40f46bd-e4e7-49c6-976a-b9d1799399cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:35:03.565526 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 210/421] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:35:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:35:03.643216 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e67a9ee-2f95-4651-9369-2667001a032f None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:03.685430 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f2386b-6bd9-442c-9196-8f7c3538b41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:03.686037 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2386b-6bd9-442c-9196-8f7c3538b41c None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:03.686312 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2386b-6bd9-442c-9196-8f7c3538b41c None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:03.686576 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2386b-6bd9-442c-9196-8f7c3538b41c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:03.691854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:03.781018 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f2386b-6bd9-442c-9196-8f7c3538b41c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:03.782556 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f2386b-6bd9-442c-9196-8f7c3538b41c None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:03.892426 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f46bd-e4e7-49c6-976a-b9d1799399cc None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:03.941527 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 212/422] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:35:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:35:03.944953 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f2386b-6bd9-442c-9196-8f7c3538b41c None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:04.007330 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:04.065733 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:04.077794 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f46bd-e4e7-49c6-976a-b9d1799399cc None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:04.124365 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f2386b-6bd9-442c-9196-8f7c3538b41c None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:04.140397 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9e901-9cbe-4245-b1ab-9e32bc0523fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:04.141026 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9e901-9cbe-4245-b1ab-9e32bc0523fa None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:04.141298 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9e901-9cbe-4245-b1ab-9e32bc0523fa None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:04.141590 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9e901-9cbe-4245-b1ab-9e32bc0523fa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:04.159985 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c9e901-9cbe-4245-b1ab-9e32bc0523fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:35:04.168950 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-d3c9e901-9cbe-4245-b1ab-9e32bc0523fa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:35:04.168950 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:04.168950 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:04.168950 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:04.168950 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:04.168950 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:04.168950 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:04.168950 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:04.168950 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:04.168950 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:04.168950 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:04.168950 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:04.168950 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:35:04.168950 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:35:04.168950 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:35:04.168950 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:35:04.169860 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:35:04.169860 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:35:04.169860 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:35:04.169860 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:35:04.169860 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:04.169860 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:04.169860 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:04.169860 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:04.169860 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:04.169860 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:04.169860 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:04.169860 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:04.169860 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:04.169860 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:04.169860 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:04.169860 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:04.170683 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:04.170683 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:04.170683 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:04.170683 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:04.170683 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:35:04.170683 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:35:04.170683 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:35:04.170683 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:35:04.170683 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:35:04.170683 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:35:04.170683 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:35:04.170683 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:04.172250 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 211/423] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Sep 8 13:35:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:04.179782 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9e901-9cbe-4245-b1ab-9e32bc0523fa None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:04.202033 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b7a95-f319-4014-bf10-1d33ed9a9cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:04.202579 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b7a95-f319-4014-bf10-1d33ed9a9cd5 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:04.202849 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b7a95-f319-4014-bf10-1d33ed9a9cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:04.203111 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b7a95-f319-4014-bf10-1d33ed9a9cd5 None admin] PATH_INFO: `/v3/projects/8afaf32861dc4e62a9b32129a27c4900` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:04.204370 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b7a95-f319-4014-bf10-1d33ed9a9cd5 None admin] RBAC: Authorizing `identity:get_project(project_id=8afaf32861dc4e62a9b32129a27c4900)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:04.205864 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b7a95-f319-4014-bf10-1d33ed9a9cd5 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:04.211506 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 213/424] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:35:03 2022] GET /identity/v3/projects/8afaf32861dc4e62a9b32129a27c4900 => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:04.218341 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b7a95-f319-4014-bf10-1d33ed9a9cd5 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:04.382180 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9e901-9cbe-4245-b1ab-9e32bc0523fa None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:04.409463 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b7a95-f319-4014-bf10-1d33ed9a9cd5 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:04.414747 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:04.437719 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2786c144-8d6f-4c71-865c-670083f2f8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:04.438328 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786c144-8d6f-4c71-865c-670083f2f8d1 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:04.438606 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786c144-8d6f-4c71-865c-670083f2f8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:04.438874 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786c144-8d6f-4c71-865c-670083f2f8d1 None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:04.439547 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2786c144-8d6f-4c71-865c-670083f2f8d1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:04.439905 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2786c144-8d6f-4c71-865c-670083f2f8d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:04.441281 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2786c144-8d6f-4c71-865c-670083f2f8d1 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:04.460326 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 212/425] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:35:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:04.466352 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2786c144-8d6f-4c71-865c-670083f2f8d1 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:04.482425 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28269c21-2d55-4159-bb42-cc5cc22c0f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:04.483058 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28269c21-2d55-4159-bb42-cc5cc22c0f03 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:04.483335 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28269c21-2d55-4159-bb42-cc5cc22c0f03 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:04.483605 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28269c21-2d55-4159-bb42-cc5cc22c0f03 None admin] PATH_INFO: `/v3/groups/3ba5e6d8fb3d438597b383a9a40eaf0b` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:04.485868 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28269c21-2d55-4159-bb42-cc5cc22c0f03 None admin] RBAC: Authorizing `identity:get_group(group_id=3ba5e6d8fb3d438597b383a9a40eaf0b)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:04.487303 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28269c21-2d55-4159-bb42-cc5cc22c0f03 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:04.490044 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 214/426] 10.222.0.69 () {56 vars in 1180 bytes} [Thu Sep 8 13:35:04 2022] GET /identity/v3/groups/3ba5e6d8fb3d438597b383a9a40eaf0b => generated 226 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:04.501341 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28269c21-2d55-4159-bb42-cc5cc22c0f03 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:04.504320 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:04.640642 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28269c21-2d55-4159-bb42-cc5cc22c0f03 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:04.680989 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2786c144-8d6f-4c71-865c-670083f2f8d1 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:04.707732 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170f3f3-b50b-471d-a21a-e5c38108073f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:04.708339 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170f3f3-b50b-471d-a21a-e5c38108073f None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:04.708614 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170f3f3-b50b-471d-a21a-e5c38108073f None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:04.708939 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170f3f3-b50b-471d-a21a-e5c38108073f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:04.710880 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2170f3f3-b50b-471d-a21a-e5c38108073f None admin] RBAC: Adding query filter params (group.id=3ba5e6d8fb3d438597b383a9a40eaf0b, role.id=0735c260e70441cc87ad611b789d5c56, scope.project.id=8afaf32861dc4e62a9b32129a27c4900) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:04.711133 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2170f3f3-b50b-471d-a21a-e5c38108073f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:04.713942 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2170f3f3-b50b-471d-a21a-e5c38108073f None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:04.730288 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 215/427] 10.222.0.69 () {56 vars in 1376 bytes} [Thu Sep 8 13:35:04 2022] GET /identity/v3/role_assignments?group.id=3ba5e6d8fb3d438597b383a9a40eaf0b&scope.project.id=8afaf32861dc4e62a9b32129a27c4900&role.id=0735c260e70441cc87ad611b789d5c56 => generated 611 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:04.742686 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5c0a4-e132-4ea1-9da3-66d987854a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:04.743316 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5c0a4-e132-4ea1-9da3-66d987854a72 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:04.743595 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5c0a4-e132-4ea1-9da3-66d987854a72 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:04.743872 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5c0a4-e132-4ea1-9da3-66d987854a72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:04.823191 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c5c0a4-e132-4ea1-9da3-66d987854a72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:04.824737 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c5c0a4-e132-4ea1-9da3-66d987854a72 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:04.849893 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:04.937786 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 213/428] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:35:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:35:04.946735 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170f3f3-b50b-471d-a21a-e5c38108073f None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:05.008026 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:05.087482 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170f3f3-b50b-471d-a21a-e5c38108073f None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:05.102076 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa040524-5d60-47eb-b823-3dd0e574b0f5 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:05.102361 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa040524-5d60-47eb-b823-3dd0e574b0f5 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:05.102610 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa040524-5d60-47eb-b823-3dd0e574b0f5 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:05.103949 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 214/429] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:35:05.114222 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e46320-fefc-4ec4-810c-29f41c302aa8 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:05.114863 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e46320-fefc-4ec4-810c-29f41c302aa8 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:05.115194 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e46320-fefc-4ec4-810c-29f41c302aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:05.138719 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-74e46320-fefc-4ec4-810c-29f41c302aa8 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:35:05.139616 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ef292-3822-49bb-8b3b-9b5a7f8b6cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:05.140265 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ef292-3822-49bb-8b3b-9b5a7f8b6cc6 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:05.140546 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ef292-3822-49bb-8b3b-9b5a7f8b6cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:05.140818 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ef292-3822-49bb-8b3b-9b5a7f8b6cc6 None admin] PATH_INFO: `/v3/projects/8afaf32861dc4e62a9b32129a27c4900` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:05.141155 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-74e46320-fefc-4ec4-810c-29f41c302aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:35:05.142118 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ef292-3822-49bb-8b3b-9b5a7f8b6cc6 None admin] RBAC: Authorizing `identity:get_project(project_id=8afaf32861dc4e62a9b32129a27c4900)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:05.143894 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ef292-3822-49bb-8b3b-9b5a7f8b6cc6 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:05.146388 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 216/430] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:35:04 2022] GET /identity/v3/projects/8afaf32861dc4e62a9b32129a27c4900 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:05.156000 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ef292-3822-49bb-8b3b-9b5a7f8b6cc6 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:05.237725 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 215/431] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:35:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:35:05.316160 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ef292-3822-49bb-8b3b-9b5a7f8b6cc6 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:05.320959 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:05.362281 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192d648-7460-4810-898c-43e8002d8a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:05.362911 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192d648-7460-4810-898c-43e8002d8a1f None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:05.363184 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192d648-7460-4810-898c-43e8002d8a1f None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:05.363456 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192d648-7460-4810-898c-43e8002d8a1f None admin] PATH_INFO: `/v3/groups/3ba5e6d8fb3d438597b383a9a40eaf0b` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:05.364609 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192d648-7460-4810-898c-43e8002d8a1f None admin] RBAC: Authorizing `identity:get_group(group_id=3ba5e6d8fb3d438597b383a9a40eaf0b)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:05.366289 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192d648-7460-4810-898c-43e8002d8a1f None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:05.368287 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 217/432] 10.222.0.69 () {56 vars in 1180 bytes} [Thu Sep 8 13:35:05 2022] GET /identity/v3/groups/3ba5e6d8fb3d438597b383a9a40eaf0b => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:35:05.374725 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e46320-fefc-4ec4-810c-29f41c302aa8 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:05.435943 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268d228-7035-40f4-9e19-19583037a532 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:05.436646 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268d228-7035-40f4-9e19-19583037a532 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:05.436646 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268d228-7035-40f4-9e19-19583037a532 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:05.438171 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 218/433] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:35:05.444106 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a5b4f-6065-432c-bcbf-7367d12b69c5 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:05.444422 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a5b4f-6065-432c-bcbf-7367d12b69c5 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:05.444700 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a5b4f-6065-432c-bcbf-7367d12b69c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:05.468374 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:05.478788 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-7b4a5b4f-6065-432c-bcbf-7367d12b69c5 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:35:05.480440 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-7b4a5b4f-6065-432c-bcbf-7367d12b69c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:35:05.554499 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e46320-fefc-4ec4-810c-29f41c302aa8 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:05.596008 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 219/434] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:35:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:35:05.599197 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35fe75-6324-434e-b07c-6971afc6f2c2 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:05.599706 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35fe75-6324-434e-b07c-6971afc6f2c2 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:05.600200 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35fe75-6324-434e-b07c-6971afc6f2c2 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:05.602222 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 220/435] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:35:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:35:05.606077 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba35fe75-6324-434e-b07c-6971afc6f2c2 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:05.615659 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe58d9-02f0-459d-8b26-c83bf2625c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:05.616320 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe58d9-02f0-459d-8b26-c83bf2625c43 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:05.616635 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe58d9-02f0-459d-8b26-c83bf2625c43 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:05.616906 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe58d9-02f0-459d-8b26-c83bf2625c43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:05.617705 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe58d9-02f0-459d-8b26-c83bf2625c43 None admin] RBAC: Adding query filter params (group.id=3ba5e6d8fb3d438597b383a9a40eaf0b, role.id=a0b9865e737f48f2975da1bb8cb386b7, scope.project.id=8afaf32861dc4e62a9b32129a27c4900) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:05.618069 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe58d9-02f0-459d-8b26-c83bf2625c43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:05.619560 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe58d9-02f0-459d-8b26-c83bf2625c43 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:05.627382 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 216/436] 10.222.0.69 () {56 vars in 1376 bytes} [Thu Sep 8 13:35:05 2022] GET /identity/v3/role_assignments?group.id=3ba5e6d8fb3d438597b383a9a40eaf0b&scope.project.id=8afaf32861dc4e62a9b32129a27c4900&role.id=a0b9865e737f48f2975da1bb8cb386b7 => generated 611 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:05.628712 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df411b-e4c0-48a0-9ca5-856d8609e744 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:05.629002 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df411b-e4c0-48a0-9ca5-856d8609e744 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:05.629262 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df411b-e4c0-48a0-9ca5-856d8609e744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:05.653044 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-a1df411b-e4c0-48a0-9ca5-856d8609e744 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:35:05.654343 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-a1df411b-e4c0-48a0-9ca5-856d8609e744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:35:05.751050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 217/437] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:35:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:35:05.755105 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba35fe75-6324-434e-b07c-6971afc6f2c2 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:05.758698 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:05.802055 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecff53f-8387-4a44-991a-9674f7cfd525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:05.803362 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecff53f-8387-4a44-991a-9674f7cfd525 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:05.804186 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecff53f-8387-4a44-991a-9674f7cfd525 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:05.804905 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecff53f-8387-4a44-991a-9674f7cfd525 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:05.823169 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecff53f-8387-4a44-991a-9674f7cfd525 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:35:05.831572 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-8ecff53f-8387-4a44-991a-9674f7cfd525 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:35:05.831572 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:05.831572 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:05.831572 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:05.831572 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:05.831572 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:05.831572 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:05.831572 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:05.831572 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:05.831572 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:05.831572 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:05.831572 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:05.831572 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:35:05.831572 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:35:05.831572 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:35:05.831572 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:35:05.832950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:35:05.832950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:35:05.832950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:35:05.832950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:35:05.832950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:05.832950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:05.832950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:05.832950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:05.832950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:05.832950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:05.832950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:05.832950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:05.832950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:05.832950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:05.832950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:05.832950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:05.834857 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:05.834857 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:05.834857 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:05.834857 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:05.834857 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:35:05.834857 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:35:05.834857 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:35:05.834857 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:35:05.834857 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:35:05.834857 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:35:05.834857 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 08 13:35:05.834857 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:05.837902 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 221/438] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:35:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:35:05.842154 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df411b-e4c0-48a0-9ca5-856d8609e744 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:05.895568 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecff53f-8387-4a44-991a-9674f7cfd525 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:05.898101 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:05.978621 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df411b-e4c0-48a0-9ca5-856d8609e744 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:06.028356 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3915e-b7e8-482b-a6bb-e0cf12bb13c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:06.029322 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3915e-b7e8-482b-a6bb-e0cf12bb13c6 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:06.029867 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3915e-b7e8-482b-a6bb-e0cf12bb13c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:06.030153 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3915e-b7e8-482b-a6bb-e0cf12bb13c6 None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:06.031351 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3915e-b7e8-482b-a6bb-e0cf12bb13c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:06.031738 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3915e-b7e8-482b-a6bb-e0cf12bb13c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:06.033503 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3915e-b7e8-482b-a6bb-e0cf12bb13c6 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:06.044318 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 218/439] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 8 13:35:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:06.045010 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3915e-b7e8-482b-a6bb-e0cf12bb13c6 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:06.046498 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecff53f-8387-4a44-991a-9674f7cfd525 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:06.093023 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb7c71-cba1-4be0-834d-e686755f6988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:06.093023 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb7c71-cba1-4be0-834d-e686755f6988 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:06.093023 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb7c71-cba1-4be0-834d-e686755f6988 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:06.093023 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb7c71-cba1-4be0-834d-e686755f6988 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:06.103439 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb7c71-cba1-4be0-834d-e686755f6988 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:35:06.108411 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-11cb7c71-cba1-4be0-834d-e686755f6988 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:35:06.108411 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:06.108411 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:06.108411 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:06.108411 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:06.108411 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:06.108411 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:06.108411 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:06.108411 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:06.108411 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:06.108411 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:06.108411 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:06.108411 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:35:06.108411 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:35:06.108411 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:35:06.108411 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:35:06.109317 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:35:06.109317 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:35:06.109317 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:35:06.109317 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:35:06.109317 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:06.109317 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:06.109317 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:06.109317 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:06.109317 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:06.109317 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:06.109317 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:06.109317 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:06.109317 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:06.109317 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:06.109317 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:06.109317 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:06.110161 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:06.110161 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:06.110161 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:06.110161 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:06.110161 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:35:06.110161 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:35:06.110161 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:35:06.110161 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:35:06.110161 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:35:06.110161 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:35:06.110161 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:35:06.110161 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:06.110161 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 222/440] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 8 13:35:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:06.110832 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb7c71-cba1-4be0-834d-e686755f6988 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:06.137015 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:06.164388 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3915e-b7e8-482b-a6bb-e0cf12bb13c6 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:06.166680 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:06.200394 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2955f34-9492-4d67-a83b-6a59915c93e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:06.201029 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2955f34-9492-4d67-a83b-6a59915c93e9 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:06.201309 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2955f34-9492-4d67-a83b-6a59915c93e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:06.201604 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2955f34-9492-4d67-a83b-6a59915c93e9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:06.212990 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2955f34-9492-4d67-a83b-6a59915c93e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:35:06.215626 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb7c71-cba1-4be0-834d-e686755f6988 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:06.218518 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-d2955f34-9492-4d67-a83b-6a59915c93e9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:35:06.218518 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:06.218518 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:06.218518 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:06.218518 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:06.218518 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:06.218518 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:06.218518 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:06.218518 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:06.218518 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:06.218518 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:06.218518 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:06.218518 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:35:06.218518 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:35:06.218518 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:35:06.218518 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:35:06.219718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:35:06.219718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:35:06.219718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:35:06.219718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:35:06.219718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:06.219718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:06.219718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:06.219718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:06.219718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:06.219718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:06.219718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:06.219718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:06.219718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:06.219718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:06.219718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:06.219718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:06.220520 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:06.220520 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:06.220520 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:06.220520 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:06.220520 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:35:06.220520 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:35:06.220520 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:35:06.220520 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:35:06.220520 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:35:06.220520 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:35:06.220520 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:35:06.220520 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:06.220520 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 219/441] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Sep 8 13:35:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:06.220520 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2955f34-9492-4d67-a83b-6a59915c93e9 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:06.259012 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100bed84-1658-4e8f-81bd-0f0699e2f43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:06.259625 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100bed84-1658-4e8f-81bd-0f0699e2f43d None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:06.259903 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100bed84-1658-4e8f-81bd-0f0699e2f43d None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:06.260172 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100bed84-1658-4e8f-81bd-0f0699e2f43d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:06.337956 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2955f34-9492-4d67-a83b-6a59915c93e9 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:06.343781 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100bed84-1658-4e8f-81bd-0f0699e2f43d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:06.345535 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100bed84-1658-4e8f-81bd-0f0699e2f43d None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:06.370029 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:06.372563 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b14f9-e6a2-43ca-902e-6c4948bb9d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:06.373129 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b14f9-e6a2-43ca-902e-6c4948bb9d93 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:06.373459 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b14f9-e6a2-43ca-902e-6c4948bb9d93 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:06.373738 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b14f9-e6a2-43ca-902e-6c4948bb9d93 None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:06.374405 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b14f9-e6a2-43ca-902e-6c4948bb9d93 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:06.374715 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b14f9-e6a2-43ca-902e-6c4948bb9d93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:06.376088 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b14f9-e6a2-43ca-902e-6c4948bb9d93 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:06.384850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 220/442] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:35:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:06.385694 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b14f9-e6a2-43ca-902e-6c4948bb9d93 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:06.415857 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:06.453726 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 223/443] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:35:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:35:06.454584 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100bed84-1658-4e8f-81bd-0f0699e2f43d None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:06.496019 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b14f9-e6a2-43ca-902e-6c4948bb9d93 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:06.529972 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e20eba-a104-4f4e-bc33-0a4abb3e479d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:06.530574 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e20eba-a104-4f4e-bc33-0a4abb3e479d None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:06.530853 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e20eba-a104-4f4e-bc33-0a4abb3e479d None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:06.531121 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e20eba-a104-4f4e-bc33-0a4abb3e479d None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:06.531775 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e20eba-a104-4f4e-bc33-0a4abb3e479d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:06.532075 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e20eba-a104-4f4e-bc33-0a4abb3e479d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:06.533466 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e20eba-a104-4f4e-bc33-0a4abb3e479d None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:06.541978 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 221/444] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:35:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:06.542781 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e20eba-a104-4f4e-bc33-0a4abb3e479d None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:06.557411 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100bed84-1658-4e8f-81bd-0f0699e2f43d None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:06.586041 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:06.600773 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e70223-a0b7-4f30-b0f3-5c63e27ea042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:06.601158 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e70223-a0b7-4f30-b0f3-5c63e27ea042 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:06.601455 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e70223-a0b7-4f30-b0f3-5c63e27ea042 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:06.601727 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e70223-a0b7-4f30-b0f3-5c63e27ea042 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:06.638644 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:06.651197 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e20eba-a104-4f4e-bc33-0a4abb3e479d None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:06.672710 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e70223-a0b7-4f30-b0f3-5c63e27ea042 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:06.674188 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e70223-a0b7-4f30-b0f3-5c63e27ea042 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:06.683898 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397dacd3-e811-4a5b-8050-64e0fb908d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:06.684574 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397dacd3-e811-4a5b-8050-64e0fb908d57 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:06.684854 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397dacd3-e811-4a5b-8050-64e0fb908d57 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:06.685121 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397dacd3-e811-4a5b-8050-64e0fb908d57 None admin] PATH_INFO: `/v3/projects/06fa14b343d84890b6385d02bd48c9b7` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:06.686276 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397dacd3-e811-4a5b-8050-64e0fb908d57 None admin] RBAC: Authorizing `identity:get_project(project_id=06fa14b343d84890b6385d02bd48c9b7)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:06.687684 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397dacd3-e811-4a5b-8050-64e0fb908d57 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:06.689282 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 222/445] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:35:06 2022] GET /identity/v3/projects/06fa14b343d84890b6385d02bd48c9b7 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:06.690057 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397dacd3-e811-4a5b-8050-64e0fb908d57 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:06.786458 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 224/446] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:35:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:35:06.786458 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e70223-a0b7-4f30-b0f3-5c63e27ea042 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:06.794671 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397dacd3-e811-4a5b-8050-64e0fb908d57 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:06.808150 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:06.829794 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0335f2f8-2f55-4433-89b5-2ec5f0ca8f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:06.830395 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335f2f8-2f55-4433-89b5-2ec5f0ca8f40 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:06.830683 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335f2f8-2f55-4433-89b5-2ec5f0ca8f40 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:06.830957 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335f2f8-2f55-4433-89b5-2ec5f0ca8f40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:06.856646 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:06.890060 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e70223-a0b7-4f30-b0f3-5c63e27ea042 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:06.902560 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0335f2f8-2f55-4433-89b5-2ec5f0ca8f40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:06.904010 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0335f2f8-2f55-4433-89b5-2ec5f0ca8f40 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:06.925463 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5b2c7-48ef-4e49-961a-7cddcb806845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:06.926090 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5b2c7-48ef-4e49-961a-7cddcb806845 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:06.926364 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5b2c7-48ef-4e49-961a-7cddcb806845 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:06.926628 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5b2c7-48ef-4e49-961a-7cddcb806845 None admin] PATH_INFO: `/v3/groups/3ba5e6d8fb3d438597b383a9a40eaf0b` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:06.927722 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a5b2c7-48ef-4e49-961a-7cddcb806845 None admin] RBAC: Authorizing `identity:get_group(group_id=3ba5e6d8fb3d438597b383a9a40eaf0b)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:06.929230 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a5b2c7-48ef-4e49-961a-7cddcb806845 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:06.930805 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 225/447] 10.222.0.69 () {56 vars in 1180 bytes} [Thu Sep 8 13:35:06 2022] GET /identity/v3/groups/3ba5e6d8fb3d438597b383a9a40eaf0b => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:06.935925 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5b2c7-48ef-4e49-961a-7cddcb806845 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:07.008751 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 223/448] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:35:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:35:07.009781 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0335f2f8-2f55-4433-89b5-2ec5f0ca8f40 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:07.031900 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:07.041941 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5b2c7-48ef-4e49-961a-7cddcb806845 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:07.072931 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:07.077846 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb1b4f-cd90-4c0a-b779-5a2be4d32d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:07.078477 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb1b4f-cd90-4c0a-b779-5a2be4d32d45 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:07.078758 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb1b4f-cd90-4c0a-b779-5a2be4d32d45 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:07.079056 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb1b4f-cd90-4c0a-b779-5a2be4d32d45 None admin] PATH_INFO: `/v3/projects/a72572f147214da489cf8bb75dc22284` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:07.080182 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb1b4f-cd90-4c0a-b779-5a2be4d32d45 None admin] RBAC: Authorizing `identity:get_project(project_id=a72572f147214da489cf8bb75dc22284)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:07.081669 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb1b4f-cd90-4c0a-b779-5a2be4d32d45 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:07.083291 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 226/449] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:35:06 2022] GET /identity/v3/projects/a72572f147214da489cf8bb75dc22284 => generated 344 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:07.084116 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb1b4f-cd90-4c0a-b779-5a2be4d32d45 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:07.119738 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0335f2f8-2f55-4433-89b5-2ec5f0ca8f40 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:07.162013 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b62cdb-c3a7-4bfd-bf3c-c7a4b59f297b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:07.163239 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b62cdb-c3a7-4bfd-bf3c-c7a4b59f297b None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:07.163515 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b62cdb-c3a7-4bfd-bf3c-c7a4b59f297b None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:07.163784 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b62cdb-c3a7-4bfd-bf3c-c7a4b59f297b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:07.164510 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b62cdb-c3a7-4bfd-bf3c-c7a4b59f297b None admin] RBAC: Adding query filter params (group.id=3ba5e6d8fb3d438597b383a9a40eaf0b, role.id=0735c260e70441cc87ad611b789d5c56, scope.project.id=06fa14b343d84890b6385d02bd48c9b7) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:07.164817 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b62cdb-c3a7-4bfd-bf3c-c7a4b59f297b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:07.166279 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b62cdb-c3a7-4bfd-bf3c-c7a4b59f297b None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:07.172143 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 224/450] 10.222.0.69 () {56 vars in 1376 bytes} [Thu Sep 8 13:35:07 2022] GET /identity/v3/role_assignments?group.id=3ba5e6d8fb3d438597b383a9a40eaf0b&scope.project.id=06fa14b343d84890b6385d02bd48c9b7&role.id=0735c260e70441cc87ad611b789d5c56 => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:07.172926 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b62cdb-c3a7-4bfd-bf3c-c7a4b59f297b None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:07.202459 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb1b4f-cd90-4c0a-b779-5a2be4d32d45 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:07.239626 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa38692-ef28-4105-8786-a502e5f6e023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:07.240789 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa38692-ef28-4105-8786-a502e5f6e023 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:07.241071 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa38692-ef28-4105-8786-a502e5f6e023 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:07.241343 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa38692-ef28-4105-8786-a502e5f6e023 None admin] PATH_INFO: `/v3/projects/06fa14b343d84890b6385d02bd48c9b7` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:07.242542 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa38692-ef28-4105-8786-a502e5f6e023 None admin] RBAC: Authorizing `identity:get_project(project_id=06fa14b343d84890b6385d02bd48c9b7)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:07.244005 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa38692-ef28-4105-8786-a502e5f6e023 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:07.246092 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 227/451] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:35:07 2022] GET /identity/v3/projects/06fa14b343d84890b6385d02bd48c9b7 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:07.251904 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa38692-ef28-4105-8786-a502e5f6e023 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:07.286983 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:07.305729 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b62cdb-c3a7-4bfd-bf3c-c7a4b59f297b None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:07.331126 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:07.348950 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34832d65-5170-4ad5-9f0e-6a0aafc86bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:07.350325 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34832d65-5170-4ad5-9f0e-6a0aafc86bbb None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:07.350713 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34832d65-5170-4ad5-9f0e-6a0aafc86bbb None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:07.350994 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34832d65-5170-4ad5-9f0e-6a0aafc86bbb None admin] PATH_INFO: `/v3/groups/5d5b1d6a711d47339f4fc7f269bf4c1d` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:07.352464 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34832d65-5170-4ad5-9f0e-6a0aafc86bbb None admin] RBAC: Authorizing `identity:get_group(group_id=5d5b1d6a711d47339f4fc7f269bf4c1d)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:07.353954 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34832d65-5170-4ad5-9f0e-6a0aafc86bbb None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:07.355725 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 225/452] 10.222.0.69 () {56 vars in 1180 bytes} [Thu Sep 8 13:35:07 2022] GET /identity/v3/groups/5d5b1d6a711d47339f4fc7f269bf4c1d => generated 229 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:07.361905 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34832d65-5170-4ad5-9f0e-6a0aafc86bbb None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:07.378190 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa38692-ef28-4105-8786-a502e5f6e023 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:07.420922 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3946ba93-3172-4342-b18c-48bb0b9c271c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:07.421255 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946ba93-3172-4342-b18c-48bb0b9c271c None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:07.421502 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946ba93-3172-4342-b18c-48bb0b9c271c None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:07.421767 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946ba93-3172-4342-b18c-48bb0b9c271c None admin] PATH_INFO: `/v3/groups/3ba5e6d8fb3d438597b383a9a40eaf0b` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:07.423213 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3946ba93-3172-4342-b18c-48bb0b9c271c None admin] RBAC: Authorizing `identity:get_group(group_id=3ba5e6d8fb3d438597b383a9a40eaf0b)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:07.425621 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3946ba93-3172-4342-b18c-48bb0b9c271c None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:07.427557 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 228/453] 10.222.0.69 () {56 vars in 1180 bytes} [Thu Sep 8 13:35:07 2022] GET /identity/v3/groups/3ba5e6d8fb3d438597b383a9a40eaf0b => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:07.434059 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3946ba93-3172-4342-b18c-48bb0b9c271c None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:07.495089 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34832d65-5170-4ad5-9f0e-6a0aafc86bbb None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:07.539378 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20d0d1b-d97a-49ef-81ca-ff33b4798e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:07.540157 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d0d1b-d97a-49ef-81ca-ff33b4798e07 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:07.540398 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d0d1b-d97a-49ef-81ca-ff33b4798e07 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:07.540679 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20d0d1b-d97a-49ef-81ca-ff33b4798e07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:07.542496 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20d0d1b-d97a-49ef-81ca-ff33b4798e07 None admin] RBAC: Adding query filter params (group.id=5d5b1d6a711d47339f4fc7f269bf4c1d, role.id=9c76f398c9e04caeab83842e70eb824b, scope.project.id=a72572f147214da489cf8bb75dc22284) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:07.542757 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20d0d1b-d97a-49ef-81ca-ff33b4798e07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:07.544202 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20d0d1b-d97a-49ef-81ca-ff33b4798e07 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:07.555280 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 226/454] 10.222.0.69 () {56 vars in 1376 bytes} [Thu Sep 8 13:35:07 2022] GET /identity/v3/role_assignments?group.id=5d5b1d6a711d47339f4fc7f269bf4c1d&scope.project.id=a72572f147214da489cf8bb75dc22284&role.id=9c76f398c9e04caeab83842e70eb824b => generated 611 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:35:07.556720 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:07.565302 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3946ba93-3172-4342-b18c-48bb0b9c271c None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:07.606851 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23da1a14-1297-47c8-ad9a-3458cf2ed84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:07.607515 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da1a14-1297-47c8-ad9a-3458cf2ed84f None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:07.607797 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da1a14-1297-47c8-ad9a-3458cf2ed84f None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:07.608107 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23da1a14-1297-47c8-ad9a-3458cf2ed84f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:07.608891 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23da1a14-1297-47c8-ad9a-3458cf2ed84f None admin] RBAC: Adding query filter params (group.id=3ba5e6d8fb3d438597b383a9a40eaf0b, role.id=a0b9865e737f48f2975da1bb8cb386b7, scope.project.id=06fa14b343d84890b6385d02bd48c9b7) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:07.609203 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23da1a14-1297-47c8-ad9a-3458cf2ed84f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:07.610802 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23da1a14-1297-47c8-ad9a-3458cf2ed84f None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:07.617698 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 229/455] 10.222.0.69 () {56 vars in 1376 bytes} [Thu Sep 8 13:35:07 2022] GET /identity/v3/role_assignments?group.id=3ba5e6d8fb3d438597b383a9a40eaf0b&scope.project.id=06fa14b343d84890b6385d02bd48c9b7&role.id=a0b9865e737f48f2975da1bb8cb386b7 => generated 611 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:10.601313 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c76af-b989-4a7f-a894-3b8051443bba None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:10.601313 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c76af-b989-4a7f-a894-3b8051443bba None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:10.601313 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c76af-b989-4a7f-a894-3b8051443bba None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:10.602464 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 227/456] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:35:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:35:10.606809 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec047d6-0d68-402d-b9bc-98b7f73f9305 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:10.607637 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec047d6-0d68-402d-b9bc-98b7f73f9305 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:10.608112 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec047d6-0d68-402d-b9bc-98b7f73f9305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:10.634425 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-fec047d6-0d68-402d-b9bc-98b7f73f9305 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:35:10.636016 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-fec047d6-0d68-402d-b9bc-98b7f73f9305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:35:10.734740 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 230/457] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:35:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:35:10.819864 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bffef07-8525-4de1-8d4e-bc366ecba0d6 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:10.820519 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bffef07-8525-4de1-8d4e-bc366ecba0d6 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:10.820992 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bffef07-8525-4de1-8d4e-bc366ecba0d6 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:10.822580 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 228/458] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:35:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:35:10.828238 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fbca5-f3e3-4bb8-b207-93bf45680ca2 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:10.828785 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fbca5-f3e3-4bb8-b207-93bf45680ca2 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:10.829255 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fbca5-f3e3-4bb8-b207-93bf45680ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:10.854728 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-5a7fbca5-f3e3-4bb8-b207-93bf45680ca2 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:35:10.856397 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-5a7fbca5-f3e3-4bb8-b207-93bf45680ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:35:10.902996 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22471c74-35f1-4c3a-9017-95b86dbe2555 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:10.902996 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22471c74-35f1-4c3a-9017-95b86dbe2555 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:10.902996 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22471c74-35f1-4c3a-9017-95b86dbe2555 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:10.903726 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 229/459] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:35:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:35:10.915233 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e1809-884c-448b-8f8f-d54e4213e5a4 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:10.915518 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e1809-884c-448b-8f8f-d54e4213e5a4 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:10.915785 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e1809-884c-448b-8f8f-d54e4213e5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:10.942251 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-bc9e1809-884c-448b-8f8f-d54e4213e5a4 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:35:10.944094 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-bc9e1809-884c-448b-8f8f-d54e4213e5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:35:10.968850 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 231/460] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:35:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:35:11.010734 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:11.046303 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 230/461] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:35:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:35:11.083931 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7fbca5-f3e3-4bb8-b207-93bf45680ca2 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:11.109034 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:11.236347 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7fbca5-f3e3-4bb8-b207-93bf45680ca2 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:11.300258 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c797e8b-07bc-43f6-8fd2-94117f8d5b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:11.300938 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c797e8b-07bc-43f6-8fd2-94117f8d5b9d None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:11.301215 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c797e8b-07bc-43f6-8fd2-94117f8d5b9d None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:11.301510 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c797e8b-07bc-43f6-8fd2-94117f8d5b9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:11.319942 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c797e8b-07bc-43f6-8fd2-94117f8d5b9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:11.321438 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c797e8b-07bc-43f6-8fd2-94117f8d5b9d None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:11.343506 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-9c797e8b-07bc-43f6-8fd2-94117f8d5b9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:11.343506 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:11.343506 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:11.343506 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:11.343506 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:11.343506 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:11.343506 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:11.343506 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:11.343506 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:11.343506 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:11.343506 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:11.343506 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:11.343506 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:11.343506 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:11.343506 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:11.343506 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:11.344487 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:11.344487 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:11.344487 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:11.344487 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:11.344487 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:11.344487 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:11.344487 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:11.344487 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:11.344487 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:11.344487 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:11.344487 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:11.344487 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:11.344487 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:11.344487 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:11.344487 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:11.344487 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:11.344487 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:11.345356 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:11.345356 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:11.345356 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:11.345356 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 232/462] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:11.351179 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e1809-884c-448b-8f8f-d54e4213e5a4 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:11.379919 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c797e8b-07bc-43f6-8fd2-94117f8d5b9d None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:11.461832 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:11.491802 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e1809-884c-448b-8f8f-d54e4213e5a4 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:11.499825 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c797e8b-07bc-43f6-8fd2-94117f8d5b9d None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:11.529215 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52deaeae-24f4-43fe-8f74-1aa81b54364d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:11.530093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52deaeae-24f4-43fe-8f74-1aa81b54364d None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:11.530537 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52deaeae-24f4-43fe-8f74-1aa81b54364d None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:11.530956 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52deaeae-24f4-43fe-8f74-1aa81b54364d None admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:11.531749 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52deaeae-24f4-43fe-8f74-1aa81b54364d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:11.532196 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52deaeae-24f4-43fe-8f74-1aa81b54364d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:11.533734 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52deaeae-24f4-43fe-8f74-1aa81b54364d None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:11.538210 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb816ef2-a582-4e40-9927-7afd71a7fb28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:11.538965 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb816ef2-a582-4e40-9927-7afd71a7fb28 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:11.539341 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb816ef2-a582-4e40-9927-7afd71a7fb28 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:11.539713 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb816ef2-a582-4e40-9927-7afd71a7fb28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:11.547551 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 231/463] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:11.548604 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52deaeae-24f4-43fe-8f74-1aa81b54364d None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:11.551399 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb816ef2-a582-4e40-9927-7afd71a7fb28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:11.553138 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb816ef2-a582-4e40-9927-7afd71a7fb28 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:11.573272 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-eb816ef2-a582-4e40-9927-7afd71a7fb28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:11.573272 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:11.573272 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:11.573272 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:11.573272 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:11.573272 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:11.573272 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:11.573272 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:11.573272 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:11.573272 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:11.573272 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:11.573272 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:11.573272 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:11.573272 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:11.573272 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:11.573272 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:11.574263 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:11.574263 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:11.574263 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:11.574263 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:11.574263 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:11.574263 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:11.574263 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:11.574263 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:11.574263 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:11.574263 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:11.574263 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:11.574263 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:11.574263 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:11.574263 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:11.574263 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:11.574263 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:11.574263 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:11.575131 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:11.575131 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:11.575131 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:11.575131 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 233/464] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:35:11.575950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb816ef2-a582-4e40-9927-7afd71a7fb28 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:11.597791 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:11.662371 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52deaeae-24f4-43fe-8f74-1aa81b54364d None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:11.688906 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb816ef2-a582-4e40-9927-7afd71a7fb28 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:11.701546 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b6e31-4503-4b32-8b79-1283e40a70f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:11.702229 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b6e31-4503-4b32-8b79-1283e40a70f0 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:11.702517 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b6e31-4503-4b32-8b79-1283e40a70f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:11.702825 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b6e31-4503-4b32-8b79-1283e40a70f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:11.714934 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:11.716710 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3b6e31-4503-4b32-8b79-1283e40a70f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:11.718582 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3b6e31-4503-4b32-8b79-1283e40a70f0 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:11.729841 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8564f49-d3bc-4315-a7ea-6f0e6bceb8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:11.730574 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8564f49-d3bc-4315-a7ea-6f0e6bceb8e2 None admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:11.730959 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8564f49-d3bc-4315-a7ea-6f0e6bceb8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:11.731333 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8564f49-d3bc-4315-a7ea-6f0e6bceb8e2 None admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:11.732116 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8564f49-d3bc-4315-a7ea-6f0e6bceb8e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:11.733851 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8564f49-d3bc-4315-a7ea-6f0e6bceb8e2 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:11.737682 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-7a3b6e31-4503-4b32-8b79-1283e40a70f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:11.737682 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:11.737682 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:11.737682 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:11.737682 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:11.737682 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:11.737682 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:11.737682 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:11.737682 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:11.737682 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:11.737682 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:11.737682 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:11.737682 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:11.737682 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:11.737682 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:11.737682 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:11.738621 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:11.738621 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:11.738621 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:11.738621 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:11.738621 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:11.738621 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:11.738621 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:11.738621 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:11.738621 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:11.738621 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:11.738621 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:11.738621 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:11.738621 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:11.738621 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:11.738621 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:11.738621 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:11.738621 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:11.739516 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:11.739516 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:11.739516 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:11.739516 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 232/465] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:11.740710 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b6e31-4503-4b32-8b79-1283e40a70f0 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:11.760485 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 234/466] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Sep 8 13:35:11 2022] POST /identity/v3/users => generated 246 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:35:11.762035 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35bbda-2bd3-459a-8f4a-b7d4897839a5 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:11.762385 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35bbda-2bd3-459a-8f4a-b7d4897839a5 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:11.762732 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35bbda-2bd3-459a-8f4a-b7d4897839a5 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:11.768786 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 235/467] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:35:11.768786 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35bbda-2bd3-459a-8f4a-b7d4897839a5 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:11.862465 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:11.872873 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b6e31-4503-4b32-8b79-1283e40a70f0 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:11.917795 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5353b-79dd-4924-b069-57e03332723d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:11.918654 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5353b-79dd-4924-b069-57e03332723d None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:11.919085 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5353b-79dd-4924-b069-57e03332723d None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:11.919504 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5353b-79dd-4924-b069-57e03332723d None admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:11.920321 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5353b-79dd-4924-b069-57e03332723d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:11.920793 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5353b-79dd-4924-b069-57e03332723d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:11.922854 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5353b-79dd-4924-b069-57e03332723d None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:11.923025 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35bbda-2bd3-459a-8f4a-b7d4897839a5 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:11.941299 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 233/468] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:11.942839 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d35bb2-f1eb-4bd7-8589-72cba1154489 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:11.943348 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d35bb2-f1eb-4bd7-8589-72cba1154489 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:11.944297 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d35bb2-f1eb-4bd7-8589-72cba1154489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:11.967011 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-52d35bb2-f1eb-4bd7-8589-72cba1154489 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:35:11.968456 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-52d35bb2-f1eb-4bd7-8589-72cba1154489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:35:11.973710 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a5dab0-3a36-4cec-a1f3-7bb53427aafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:11.974338 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5dab0-3a36-4cec-a1f3-7bb53427aafc None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:11.975178 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5dab0-3a36-4cec-a1f3-7bb53427aafc None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:11.975531 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5dab0-3a36-4cec-a1f3-7bb53427aafc None admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:11.976521 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a5dab0-3a36-4cec-a1f3-7bb53427aafc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:11.976829 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a5dab0-3a36-4cec-a1f3-7bb53427aafc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:11.978260 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a5dab0-3a36-4cec-a1f3-7bb53427aafc None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:11.998460 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 236/469] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:11.999489 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a5dab0-3a36-4cec-a1f3-7bb53427aafc None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:12.051932 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:12.053881 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 234/470] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:35:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:35:12.054950 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d35bb2-f1eb-4bd7-8589-72cba1154489 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:12.123720 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a5dab0-3a36-4cec-a1f3-7bb53427aafc None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:12.163480 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723be2ad-367e-4704-96e9-3a3f8c90b43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:12.164333 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723be2ad-367e-4704-96e9-3a3f8c90b43e None admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:12.164800 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723be2ad-367e-4704-96e9-3a3f8c90b43e None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:12.165169 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723be2ad-367e-4704-96e9-3a3f8c90b43e None admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:12.165966 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723be2ad-367e-4704-96e9-3a3f8c90b43e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:12.167472 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:12.168343 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723be2ad-367e-4704-96e9-3a3f8c90b43e None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:12.198447 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d35bb2-f1eb-4bd7-8589-72cba1154489 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:12.204730 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 237/471] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Sep 8 13:35:11 2022] POST /identity/v3/users => generated 248 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:35:12.255588 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc61fe4-a70e-410a-bbae-166a5f23d7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:12.256469 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc61fe4-a70e-410a-bbae-166a5f23d7b5 None admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:12.256900 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc61fe4-a70e-410a-bbae-166a5f23d7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:12.257373 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc61fe4-a70e-410a-bbae-166a5f23d7b5 None admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:12.258223 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc61fe4-a70e-410a-bbae-166a5f23d7b5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:12.259843 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc61fe4-a70e-410a-bbae-166a5f23d7b5 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:12.291584 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 235/472] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Sep 8 13:35:12 2022] POST /identity/v3/users => generated 248 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:35:12.456816 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d043d0-7c65-4856-9de8-5042c91a40a8 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:12.457223 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d043d0-7c65-4856-9de8-5042c91a40a8 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:12.457349 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d043d0-7c65-4856-9de8-5042c91a40a8 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:12.459567 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 238/473] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:35:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:35:12.465759 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb234f6-2eae-4462-b3a2-82a2a79b477b None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:12.466059 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb234f6-2eae-4462-b3a2-82a2a79b477b None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:12.466327 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb234f6-2eae-4462-b3a2-82a2a79b477b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:12.488745 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d043d0-7c65-4856-9de8-5042c91a40a8 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:12.489057 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-2bb234f6-2eae-4462-b3a2-82a2a79b477b None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:35:12.491120 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-2bb234f6-2eae-4462-b3a2-82a2a79b477b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:35:12.588826 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 236/474] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:35:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:35:12.615374 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:12.625685 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d043d0-7c65-4856-9de8-5042c91a40a8 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:12.663975 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea1eda-a687-4965-954f-3c1ab65eb7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:12.664607 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea1eda-a687-4965-954f-3c1ab65eb7c6 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:12.664875 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea1eda-a687-4965-954f-3c1ab65eb7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:12.665139 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea1eda-a687-4965-954f-3c1ab65eb7c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:12.675752 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea1eda-a687-4965-954f-3c1ab65eb7c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:12.677199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea1eda-a687-4965-954f-3c1ab65eb7c6 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:12.696036 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-42ea1eda-a687-4965-954f-3c1ab65eb7c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:12.696036 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:12.696036 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:12.696036 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:12.696036 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:12.696036 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:12.696036 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:12.696036 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:12.696036 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:12.696036 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:12.696036 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:12.696036 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:12.696036 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:12.696036 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:12.696036 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:12.696036 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:12.697494 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:12.697494 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:12.697494 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:12.697494 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:12.697494 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:12.697494 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:12.697494 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:12.697494 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:12.697494 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:12.697494 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:12.697494 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:12.697494 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:12.697494 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:12.697494 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:12.697494 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:12.697494 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:12.697494 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:12.698377 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:12.698377 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:12.698377 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:12.701439 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 239/475] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:35:12.703561 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb234f6-2eae-4462-b3a2-82a2a79b477b None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:12.787924 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:12.824958 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb234f6-2eae-4462-b3a2-82a2a79b477b None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:12.868874 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522acd6-2b6e-4a4c-b754-d5343de91c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:12.869511 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522acd6-2b6e-4a4c-b754-d5343de91c45 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:12.869787 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522acd6-2b6e-4a4c-b754-d5343de91c45 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:12.870055 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522acd6-2b6e-4a4c-b754-d5343de91c45 None admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:12.870704 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522acd6-2b6e-4a4c-b754-d5343de91c45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:12.871001 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522acd6-2b6e-4a4c-b754-d5343de91c45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:12.872374 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522acd6-2b6e-4a4c-b754-d5343de91c45 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:12.893328 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 237/476] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:12.894848 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea1eda-a687-4965-954f-3c1ab65eb7c6 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:12.926273 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522acd6-2b6e-4a4c-b754-d5343de91c45 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:13.061740 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522acd6-2b6e-4a4c-b754-d5343de91c45 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:13.095063 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:13.108069 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19c588-4474-4747-8f3f-0bfc7b312e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:13.108683 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19c588-4474-4747-8f3f-0bfc7b312e68 None admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:13.108960 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19c588-4474-4747-8f3f-0bfc7b312e68 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:13.109229 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19c588-4474-4747-8f3f-0bfc7b312e68 None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:13.109934 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b19c588-4474-4747-8f3f-0bfc7b312e68 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:13.111294 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b19c588-4474-4747-8f3f-0bfc7b312e68 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:13.125266 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.sql.core [None req-7b19c588-4474-4747-8f3f-0bfc7b312e68 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 08 13:35:13.125266 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 08 13:35:13.125266 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [parameters: {'id': 'f548da448e3a44d99c21f2dc2e4373a9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 08 13:35:13.125266 dv-cinder-856463-2-smb devstack@keystone.service[88208]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88208) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 08 13:35:13.137918 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea1eda-a687-4965-954f-3c1ab65eb7c6 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:13.158690 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-7b19c588-4474-4747-8f3f-0bfc7b312e68 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 08 13:35:13.158690 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:13.158690 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 13:35:13.158690 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 08 13:35:13.158690 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 13:35:13.158690 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 08 13:35:13.158690 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 13:35:13.158690 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application result = self._query(query) Sep 08 13:35:13.158690 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 13:35:13.158690 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application conn.query(q) Sep 08 13:35:13.158690 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 13:35:13.158690 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 13:35:13.158690 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 13:35:13.158690 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application result.read() Sep 08 13:35:13.158690 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 13:35:13.159677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 08 13:35:13.159677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 13:35:13.159677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 08 13:35:13.159677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 13:35:13.159677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 08 13:35:13.159677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 13:35:13.159677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 08 13:35:13.159677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 08 13:35:13.159677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:13.159677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 08 13:35:13.159677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:13.159677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:13.159677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 08 13:35:13.159677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 08 13:35:13.159677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 08 13:35:13.159677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return ref.to_dict() Sep 08 13:35:13.159677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 08 13:35:13.159677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application next(self.gen) Sep 08 13:35:13.160601 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 08 13:35:13.160601 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application yield resource Sep 08 13:35:13.160601 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 08 13:35:13.160601 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application next(self.gen) Sep 08 13:35:13.160601 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 08 13:35:13.160601 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application self.session.rollback() Sep 08 13:35:13.160601 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 13:35:13.160601 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application self.force_reraise() Sep 08 13:35:13.160601 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 13:35:13.160601 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise self.value Sep 08 13:35:13.160601 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 08 13:35:13.160601 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 08 13:35:13.160601 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 08 13:35:13.160601 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application session.commit() Sep 08 13:35:13.160601 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 08 13:35:13.160601 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 08 13:35:13.160601 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 08 13:35:13.162118 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application self._prepare_impl() Sep 08 13:35:13.162118 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 08 13:35:13.162118 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application self.session.flush() Sep 08 13:35:13.162118 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 08 13:35:13.162118 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application self._flush(objects) Sep 08 13:35:13.162118 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 08 13:35:13.162118 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 08 13:35:13.162118 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 08 13:35:13.162118 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application compat.raise_( Sep 08 13:35:13.162118 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 13:35:13.162118 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception Sep 08 13:35:13.162118 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 08 13:35:13.162118 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application flush_context.execute() Sep 08 13:35:13.162118 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 08 13:35:13.162118 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rec.execute(self) Sep 08 13:35:13.162118 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 08 13:35:13.162118 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 08 13:35:13.163408 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 08 13:35:13.163408 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 08 13:35:13.163408 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 08 13:35:13.163408 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 08 13:35:13.163408 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 08 13:35:13.163408 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 08 13:35:13.163408 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 08 13:35:13.163408 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 08 13:35:13.163408 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 08 13:35:13.163408 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 08 13:35:13.163408 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 08 13:35:13.163408 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 08 13:35:13.163408 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 08 13:35:13.163408 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 08 13:35:13.163408 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 13:35:13.163408 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception Sep 08 13:35:13.164306 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 13:35:13.164306 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 08 13:35:13.164306 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 13:35:13.164306 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 08 13:35:13.164306 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 13:35:13.164306 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application result = self._query(query) Sep 08 13:35:13.164306 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 13:35:13.164306 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application conn.query(q) Sep 08 13:35:13.164306 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 13:35:13.164306 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 13:35:13.164306 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 13:35:13.164306 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application result.read() Sep 08 13:35:13.164306 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 13:35:13.164306 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 08 13:35:13.164306 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 13:35:13.164306 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 08 13:35:13.165097 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 13:35:13.165097 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 08 13:35:13.165097 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 13:35:13.165097 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 08 13:35:13.165097 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 08 13:35:13.165097 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 08 13:35:13.165097 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [parameters: {'id': 'f548da448e3a44d99c21f2dc2e4373a9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 08 13:35:13.165097 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 08 13:35:13.165097 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:13.165097 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:35:13.165097 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:13.165097 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:13.165097 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:13.165097 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:13.165097 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:13.165097 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:13.167405 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:13.167405 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:13.167405 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:13.167405 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:13.167405 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:13.167405 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:13.167405 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 08 13:35:13.167405 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 08 13:35:13.167405 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:13.167405 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:13.167405 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 08 13:35:13.167405 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 08 13:35:13.167405 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 08 13:35:13.167405 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 08 13:35:13.167405 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 08 13:35:13.167405 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:13.174031 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 238/477] 10.222.0.69 () {60 vars in 1131 bytes} [Thu Sep 8 13:35:12 2022] POST /identity/v3/roles => generated 144 bytes in 250 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:35:13.180676 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2976eb-a709-4c98-9772-50167852d8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:13.181012 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19c588-4474-4747-8f3f-0bfc7b312e68 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:13.181286 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2976eb-a709-4c98-9772-50167852d8c4 None admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:13.181592 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2976eb-a709-4c98-9772-50167852d8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:13.181859 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2976eb-a709-4c98-9772-50167852d8c4 None admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:13.182522 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2976eb-a709-4c98-9772-50167852d8c4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:13.183965 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2976eb-a709-4c98-9772-50167852d8c4 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:13.221159 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 240/478] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Sep 8 13:35:12 2022] POST /identity/v3/users => generated 249 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:35:13.320791 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19c588-4474-4747-8f3f-0bfc7b312e68 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:13.371357 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f8569-eac6-4f56-b348-9b711122b6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:13.372767 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f8569-eac6-4f56-b348-9b711122b6be None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:13.373283 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f8569-eac6-4f56-b348-9b711122b6be None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:13.373833 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f8569-eac6-4f56-b348-9b711122b6be None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:13.391273 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f8569-eac6-4f56-b348-9b711122b6be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:35:13.398139 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-553f8569-eac6-4f56-b348-9b711122b6be None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:35:13.398139 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:13.398139 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:13.398139 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:13.398139 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:13.398139 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:13.398139 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:13.398139 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:13.398139 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:13.398139 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:13.398139 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:13.398139 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:13.398139 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:35:13.398139 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:35:13.398139 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:35:13.398139 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:35:13.399116 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:35:13.399116 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:35:13.399116 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:35:13.399116 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:35:13.399116 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:13.399116 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:13.399116 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:13.399116 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:13.399116 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:13.399116 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:13.399116 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:13.399116 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:13.399116 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:13.399116 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:13.399116 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:13.399116 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:13.399987 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:13.399987 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:13.399987 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:13.399987 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:13.399987 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:35:13.399987 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:35:13.399987 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:35:13.399987 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:35:13.399987 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:35:13.399987 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:35:13.399987 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 08 13:35:13.399987 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:13.407746 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 239/479] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Sep 8 13:35:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:13.414384 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2976eb-a709-4c98-9772-50167852d8c4 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:13.420326 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:13.548670 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2976eb-a709-4c98-9772-50167852d8c4 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:13.587877 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601baa87-6a36-43ea-a79b-172ac5f8b5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:13.588842 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601baa87-6a36-43ea-a79b-172ac5f8b5f1 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:13.589344 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601baa87-6a36-43ea-a79b-172ac5f8b5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:13.589844 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601baa87-6a36-43ea-a79b-172ac5f8b5f1 None admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:13.590713 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601baa87-6a36-43ea-a79b-172ac5f8b5f1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:13.591219 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601baa87-6a36-43ea-a79b-172ac5f8b5f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:13.592826 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601baa87-6a36-43ea-a79b-172ac5f8b5f1 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:13.603234 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 241/480] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:35:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:35:14.517031 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbca4c4-c078-4e22-91f1-798b524b7320 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:14.517571 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbca4c4-c078-4e22-91f1-798b524b7320 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:14.517681 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbca4c4-c078-4e22-91f1-798b524b7320 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:14.519313 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 240/481] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:35:14.525556 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd93bf-9c74-4868-92b8-2f258c93ecc0 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:14.526007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd93bf-9c74-4868-92b8-2f258c93ecc0 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:14.526082 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd93bf-9c74-4868-92b8-2f258c93ecc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:14.545161 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-d5cd93bf-9c74-4868-92b8-2f258c93ecc0 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:35:14.546390 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-d5cd93bf-9c74-4868-92b8-2f258c93ecc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:35:14.611258 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:14.620817 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 242/482] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:35:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:35:14.904239 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbca4c4-c078-4e22-91f1-798b524b7320 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:14.985867 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:15.038716 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbca4c4-c078-4e22-91f1-798b524b7320 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:15.092301 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d929f6f-a5b4-46ff-8da5-a767ae1d8bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:15.092930 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d929f6f-a5b4-46ff-8da5-a767ae1d8bec None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:15.093205 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d929f6f-a5b4-46ff-8da5-a767ae1d8bec None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:15.093500 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d929f6f-a5b4-46ff-8da5-a767ae1d8bec None admin] PATH_INFO: `/v3/roles/service` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:15.109537 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d929f6f-a5b4-46ff-8da5-a767ae1d8bec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:35:15.114543 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-3d929f6f-a5b4-46ff-8da5-a767ae1d8bec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:35:15.114543 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:15.114543 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:15.114543 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:15.114543 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:15.114543 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:15.114543 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:15.114543 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:15.114543 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:15.114543 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:15.114543 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:15.114543 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:15.114543 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:35:15.114543 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:35:15.114543 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:35:15.114543 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:35:15.115874 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:35:15.115874 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:35:15.115874 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:35:15.115874 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:35:15.115874 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:15.115874 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:15.115874 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:15.115874 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:15.115874 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:15.115874 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:15.115874 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:15.115874 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:15.115874 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:15.115874 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:15.115874 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:15.115874 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:15.116924 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:15.116924 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:15.116924 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:15.116924 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:15.116924 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:35:15.116924 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:35:15.116924 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:35:15.116924 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:35:15.116924 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:35:15.116924 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:35:15.116924 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:35:15.116924 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:15.116924 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 241/483] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Sep 8 13:35:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:15.122347 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd93bf-9c74-4868-92b8-2f258c93ecc0 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:15.244508 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd93bf-9c74-4868-92b8-2f258c93ecc0 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:15.247167 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a9a2e-a08f-4dbc-9804-e8f17cbd6481 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:15.247447 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a9a2e-a08f-4dbc-9804-e8f17cbd6481 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:15.247719 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a9a2e-a08f-4dbc-9804-e8f17cbd6481 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:15.249118 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 242/484] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:35:15.258436 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e07f1b-ee8a-47e3-8102-5f585409ed93 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:15.258758 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e07f1b-ee8a-47e3-8102-5f585409ed93 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:15.258979 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e07f1b-ee8a-47e3-8102-5f585409ed93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:15.282445 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-70e07f1b-ee8a-47e3-8102-5f585409ed93 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:35:15.283639 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-70e07f1b-ee8a-47e3-8102-5f585409ed93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:35:15.317826 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce59f041-c341-4a74-a08a-3ec10ba6ea78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:15.318989 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59f041-c341-4a74-a08a-3ec10ba6ea78 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:15.319439 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59f041-c341-4a74-a08a-3ec10ba6ea78 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:15.319974 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59f041-c341-4a74-a08a-3ec10ba6ea78 None admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:15.320655 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce59f041-c341-4a74-a08a-3ec10ba6ea78 None admin] RBAC: Adding query filter params (name=service) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:15.321210 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce59f041-c341-4a74-a08a-3ec10ba6ea78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:15.323762 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce59f041-c341-4a74-a08a-3ec10ba6ea78 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:15.340608 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 243/485] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Sep 8 13:35:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:15.347422 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce59f041-c341-4a74-a08a-3ec10ba6ea78 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:15.420728 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 243/486] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:35:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:35:15.465007 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6fcdb-b314-4a14-815a-315a7452175c None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:15.465339 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6fcdb-b314-4a14-815a-315a7452175c None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:15.465592 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6fcdb-b314-4a14-815a-315a7452175c None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:15.467199 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 244/487] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:35:15.467609 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:15.472649 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfc04e-9e96-41e2-9302-fcee6ded74e5 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:15.473167 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfc04e-9e96-41e2-9302-fcee6ded74e5 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:15.473876 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfc04e-9e96-41e2-9302-fcee6ded74e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:15.509321 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-f5cfc04e-9e96-41e2-9302-fcee6ded74e5 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:35:15.510904 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-f5cfc04e-9e96-41e2-9302-fcee6ded74e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:35:15.570137 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce59f041-c341-4a74-a08a-3ec10ba6ea78 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:15.597759 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:15.651163 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fabde5-3fd1-4bef-ad36-089c200a231c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:15.651793 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fabde5-3fd1-4bef-ad36-089c200a231c None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:15.652069 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fabde5-3fd1-4bef-ad36-089c200a231c None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:15.652337 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fabde5-3fd1-4bef-ad36-089c200a231c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:15.658422 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 245/488] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:35:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:35:15.669114 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fabde5-3fd1-4bef-ad36-089c200a231c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:15.670882 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fabde5-3fd1-4bef-ad36-089c200a231c None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:15.698565 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-a5fabde5-3fd1-4bef-ad36-089c200a231c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:15.698565 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:15.698565 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:15.698565 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:15.698565 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:15.698565 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:15.698565 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:15.698565 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:15.698565 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:15.698565 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:15.698565 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:15.698565 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:15.698565 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:15.698565 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:15.698565 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:15.698565 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:15.700004 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:15.700004 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:15.700004 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:15.700004 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:15.700004 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:15.700004 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:15.700004 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:15.700004 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:15.700004 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:15.700004 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:15.700004 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:15.700004 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:15.700004 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:15.700004 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:15.700004 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:15.700004 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:15.700004 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:15.701224 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:15.701224 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:15.701224 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:15.703074 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 244/489] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:15.708534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cfc04e-9e96-41e2-9302-fcee6ded74e5 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:15.742566 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fabde5-3fd1-4bef-ad36-089c200a231c None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:15.879497 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cfc04e-9e96-41e2-9302-fcee6ded74e5 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:15.931885 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d09e2-dd4f-4279-bd7e-750f840bad42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:15.932508 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d09e2-dd4f-4279-bd7e-750f840bad42 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:15.932790 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d09e2-dd4f-4279-bd7e-750f840bad42 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:15.933159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d09e2-dd4f-4279-bd7e-750f840bad42 None admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:15.933930 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d09e2-dd4f-4279-bd7e-750f840bad42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:15.934436 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d09e2-dd4f-4279-bd7e-750f840bad42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:15.936132 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d09e2-dd4f-4279-bd7e-750f840bad42 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:15.950098 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 246/490] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:15.954535 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fabde5-3fd1-4bef-ad36-089c200a231c None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:15.955495 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d09e2-dd4f-4279-bd7e-750f840bad42 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:15.976622 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:16.007828 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:16.023430 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9ea9a-cc5d-4870-b7d3-fdcce44ed284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:16.024063 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9ea9a-cc5d-4870-b7d3-fdcce44ed284 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:16.024339 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9ea9a-cc5d-4870-b7d3-fdcce44ed284 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:16.024611 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9ea9a-cc5d-4870-b7d3-fdcce44ed284 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:16.037787 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a9ea9a-cc5d-4870-b7d3-fdcce44ed284 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:35:16.043428 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-01a9ea9a-cc5d-4870-b7d3-fdcce44ed284 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:35:16.043428 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:16.043428 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:16.043428 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:16.043428 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:16.043428 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:16.043428 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:16.043428 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:16.043428 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:16.043428 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:16.043428 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:16.043428 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:16.043428 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:35:16.043428 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:35:16.043428 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:35:16.043428 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:35:16.044419 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:35:16.044419 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:35:16.044419 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:35:16.044419 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:35:16.044419 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:16.044419 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:16.044419 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:16.044419 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:16.044419 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:16.044419 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:16.044419 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:16.044419 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:16.044419 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:16.044419 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:16.044419 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:16.044419 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:16.045292 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:16.045292 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:16.045292 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:16.045292 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:16.045292 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:35:16.045292 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:35:16.045292 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:35:16.045292 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:35:16.045292 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:35:16.045292 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:35:16.045292 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:35:16.045292 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:16.049566 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 245/491] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Sep 8 13:35:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:16.050637 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9ea9a-cc5d-4870-b7d3-fdcce44ed284 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:16.075910 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d09e2-dd4f-4279-bd7e-750f840bad42 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:16.131903 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe8a259-3fb1-4f5d-b96f-43e082ba4d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:16.132905 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8a259-3fb1-4f5d-b96f-43e082ba4d7f None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:16.133292 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8a259-3fb1-4f5d-b96f-43e082ba4d7f None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:16.134053 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8a259-3fb1-4f5d-b96f-43e082ba4d7f None admin] PATH_INFO: `/v3/users/nova` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:16.145803 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe8a259-3fb1-4f5d-b96f-43e082ba4d7f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:16.148444 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe8a259-3fb1-4f5d-b96f-43e082ba4d7f None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:16.166677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-6fe8a259-3fb1-4f5d-b96f-43e082ba4d7f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:35:16.166677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:16.166677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:16.166677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:16.166677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:16.166677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:16.166677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:16.166677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:16.166677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:16.166677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:16.166677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:16.166677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:16.166677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:35:16.166677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:35:16.166677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:35:16.166677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:35:16.168362 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:16.168362 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:16.168362 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:35:16.168362 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:35:16.168362 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:35:16.168362 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:35:16.168362 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:16.168362 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:16.168362 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:16.168362 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:16.168362 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:16.168362 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:16.168362 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:16.168362 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:16.168362 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:16.168362 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:16.168362 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:16.168362 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:16.170090 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:16.170090 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:16.170090 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:35:16.170090 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:35:16.170090 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:35:16.170090 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:35:16.170090 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:35:16.170090 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:35:16.170090 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:35:16.170090 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:16.170090 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 247/492] 10.222.0.69 () {56 vars in 1093 bytes} [Thu Sep 8 13:35:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:35:16.170090 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe8a259-3fb1-4f5d-b96f-43e082ba4d7f None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:16.224163 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9ea9a-cc5d-4870-b7d3-fdcce44ed284 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:16.285406 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026f65f-90a3-4514-b69e-188d11b20886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:16.285406 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026f65f-90a3-4514-b69e-188d11b20886 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:16.285406 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026f65f-90a3-4514-b69e-188d11b20886 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:16.285406 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026f65f-90a3-4514-b69e-188d11b20886 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:16.299692 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026f65f-90a3-4514-b69e-188d11b20886 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:35:16.307222 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-f026f65f-90a3-4514-b69e-188d11b20886 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:35:16.307222 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:16.307222 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:16.307222 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:16.307222 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:16.307222 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:16.307222 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:16.307222 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:16.307222 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:16.307222 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:16.307222 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:16.307222 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:16.307222 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:35:16.307222 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:35:16.307222 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:35:16.307222 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:35:16.308199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:35:16.308199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:35:16.308199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:35:16.308199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:35:16.308199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:16.308199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:16.308199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:16.308199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:16.308199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:16.308199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:16.308199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:16.308199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:16.308199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:16.308199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:16.308199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:16.308199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:16.309016 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:16.309016 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:16.309016 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:16.309016 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:16.309016 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:35:16.309016 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:35:16.309016 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:35:16.309016 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:35:16.309016 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:35:16.309016 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:35:16.309016 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:35:16.309016 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:16.309016 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 246/493] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Sep 8 13:35:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:16.313418 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026f65f-90a3-4514-b69e-188d11b20886 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:16.340968 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:16.348374 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:16.362786 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe8a259-3fb1-4f5d-b96f-43e082ba4d7f None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:16.408295 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb0e1f9-529b-466c-9f58-d7e973b865b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:16.408705 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0e1f9-529b-466c-9f58-d7e973b865b5 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:16.408983 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0e1f9-529b-466c-9f58-d7e973b865b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:16.409254 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0e1f9-529b-466c-9f58-d7e973b865b5 None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:16.409963 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb0e1f9-529b-466c-9f58-d7e973b865b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:16.410258 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb0e1f9-529b-466c-9f58-d7e973b865b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:16.411641 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb0e1f9-529b-466c-9f58-d7e973b865b5 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:16.422488 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 248/494] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Sep 8 13:35:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:16.427433 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb0e1f9-529b-466c-9f58-d7e973b865b5 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:16.444094 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026f65f-90a3-4514-b69e-188d11b20886 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:16.485531 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89790d-d832-4c34-9518-e6053217029f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:16.486156 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89790d-d832-4c34-9518-e6053217029f None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:16.486429 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89790d-d832-4c34-9518-e6053217029f None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:16.486700 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89790d-d832-4c34-9518-e6053217029f None admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:16.487445 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f89790d-d832-4c34-9518-e6053217029f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:16.487751 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f89790d-d832-4c34-9518-e6053217029f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:16.489215 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f89790d-d832-4c34-9518-e6053217029f None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:16.526985 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 247/495] 10.222.0.69 () {56 vars in 1133 bytes} [Thu Sep 8 13:35:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:16.528042 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e510f-e4c2-43dc-add3-2ab831344841 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:16.528321 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e510f-e4c2-43dc-add3-2ab831344841 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:16.528587 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e510f-e4c2-43dc-add3-2ab831344841 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:16.529972 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 248/496] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:35:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:35:16.530487 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e510f-e4c2-43dc-add3-2ab831344841 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:16.555323 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb0e1f9-529b-466c-9f58-d7e973b865b5 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:16.592624 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb87b4f1-909a-4de2-9777-dd8f2ed61deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:16.593255 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87b4f1-909a-4de2-9777-dd8f2ed61deb None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:16.593558 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87b4f1-909a-4de2-9777-dd8f2ed61deb None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:16.593831 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87b4f1-909a-4de2-9777-dd8f2ed61deb None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:16.594500 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb87b4f1-909a-4de2-9777-dd8f2ed61deb None admin] RBAC: Adding query filter params (name=service) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:16.594799 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb87b4f1-909a-4de2-9777-dd8f2ed61deb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:16.596169 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb87b4f1-909a-4de2-9777-dd8f2ed61deb None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:16.604834 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 249/497] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Sep 8 13:35:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:16.605687 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb87b4f1-909a-4de2-9777-dd8f2ed61deb None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:16.621225 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:16.628012 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:16.639845 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e510f-e4c2-43dc-add3-2ab831344841 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:16.675098 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d57a0-da1f-4d6f-91ca-7307f0758a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:16.675640 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d57a0-da1f-4d6f-91ca-7307f0758a66 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:16.675915 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d57a0-da1f-4d6f-91ca-7307f0758a66 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:16.676181 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d57a0-da1f-4d6f-91ca-7307f0758a66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:16.686475 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d57a0-da1f-4d6f-91ca-7307f0758a66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:16.687932 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d57a0-da1f-4d6f-91ca-7307f0758a66 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:16.702985 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-714d57a0-da1f-4d6f-91ca-7307f0758a66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:16.702985 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:16.702985 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:16.702985 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:16.702985 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:16.702985 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:16.702985 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:16.702985 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:16.702985 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:16.702985 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:16.702985 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:16.702985 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:16.702985 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:16.702985 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:16.702985 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:16.702985 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:16.703971 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:16.703971 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:16.703971 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:16.703971 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:16.703971 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:16.703971 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:16.703971 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:16.703971 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:16.703971 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:16.703971 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:16.703971 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:16.703971 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:16.703971 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:16.703971 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:16.703971 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:16.703971 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:16.703971 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:16.704825 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:16.704825 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:16.704825 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:16.704825 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 249/498] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:16.705557 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6936786-de1f-4cc8-ab89-643df8f262dd None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:16.705827 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6936786-de1f-4cc8-ab89-643df8f262dd None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:16.706092 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6936786-de1f-4cc8-ab89-643df8f262dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:16.716333 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb87b4f1-909a-4de2-9777-dd8f2ed61deb None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:16.724548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-a6936786-de1f-4cc8-ab89-643df8f262dd None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:35:16.725768 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-a6936786-de1f-4cc8-ab89-643df8f262dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:35:16.749893 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc9fa0-4518-4a44-a98a-1a13a123e313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:16.750498 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc9fa0-4518-4a44-a98a-1a13a123e313 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:16.750778 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc9fa0-4518-4a44-a98a-1a13a123e313 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:16.751050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc9fa0-4518-4a44-a98a-1a13a123e313 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:16.793057 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 250/499] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:35:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:35:16.794406 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a2d26-11ca-4d74-a435-9cc26847d552 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:16.794695 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a2d26-11ca-4d74-a435-9cc26847d552 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:16.794967 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a2d26-11ca-4d74-a435-9cc26847d552 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:16.796567 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 251/500] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:35:16.797058 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a2d26-11ca-4d74-a435-9cc26847d552 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:16.836603 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc9fa0-4518-4a44-a98a-1a13a123e313 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:16.838103 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc9fa0-4518-4a44-a98a-1a13a123e313 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:16.862318 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:16.870489 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:16.913012 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a2d26-11ca-4d74-a435-9cc26847d552 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:16.949812 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ee907-c078-4e2e-8a76-1814aa846948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:16.950989 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ee907-c078-4e2e-8a76-1814aa846948 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:16.951462 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ee907-c078-4e2e-8a76-1814aa846948 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:16.951924 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ee907-c078-4e2e-8a76-1814aa846948 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:16.959617 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 250/501] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:35:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:35:16.961345 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc9fa0-4518-4a44-a98a-1a13a123e313 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:16.971078 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880ee907-c078-4e2e-8a76-1814aa846948 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:16.973850 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880ee907-c078-4e2e-8a76-1814aa846948 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:17.003290 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-880ee907-c078-4e2e-8a76-1814aa846948 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:17.003290 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:17.003290 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:17.003290 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:17.003290 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:17.003290 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:17.003290 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:17.003290 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:17.003290 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:17.003290 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:17.003290 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:17.003290 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:17.003290 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:17.003290 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:17.003290 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:17.003290 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:17.005322 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:17.005322 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:17.005322 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:17.005322 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:17.005322 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:17.005322 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:17.005322 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:17.005322 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:17.005322 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:17.005322 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:17.005322 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:17.005322 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:17.005322 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:17.005322 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:17.005322 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:17.005322 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:17.005322 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:17.007158 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:17.007158 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:17.007158 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:17.007158 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 252/502] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:17.007598 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88fa81-5d97-453a-aab1-8710bde4be93 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:17.007725 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88fa81-5d97-453a-aab1-8710bde4be93 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:17.008197 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88fa81-5d97-453a-aab1-8710bde4be93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:17.040465 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-7a88fa81-5d97-453a-aab1-8710bde4be93 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:35:17.042398 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-7a88fa81-5d97-453a-aab1-8710bde4be93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:35:17.109751 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc9fa0-4518-4a44-a98a-1a13a123e313 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:17.120836 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 253/503] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:35:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:35:17.121813 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a88fa81-5d97-453a-aab1-8710bde4be93 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:17.128452 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:17.149432 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a5855-4042-4c5c-879b-fe0cc63cd930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:17.150060 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a5855-4042-4c5c-879b-fe0cc63cd930 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:17.150327 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a5855-4042-4c5c-879b-fe0cc63cd930 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:17.150627 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a5855-4042-4c5c-879b-fe0cc63cd930 None admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:17.151270 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a5855-4042-4c5c-879b-fe0cc63cd930 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:17.151571 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a5855-4042-4c5c-879b-fe0cc63cd930 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:17.152954 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a5855-4042-4c5c-879b-fe0cc63cd930 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:17.171788 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 251/504] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:17.171788 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a5855-4042-4c5c-879b-fe0cc63cd930 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:17.189256 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:17.241389 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a88fa81-5d97-453a-aab1-8710bde4be93 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:17.284311 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b8910-e3d4-4c01-9719-fb2db573618d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:17.285084 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b8910-e3d4-4c01-9719-fb2db573618d None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:17.285531 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b8910-e3d4-4c01-9719-fb2db573618d None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:17.286005 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b8910-e3d4-4c01-9719-fb2db573618d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:17.294046 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a5855-4042-4c5c-879b-fe0cc63cd930 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:17.297611 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b8910-e3d4-4c01-9719-fb2db573618d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:17.299078 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b8910-e3d4-4c01-9719-fb2db573618d None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:17.314422 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-cb3b8910-e3d4-4c01-9719-fb2db573618d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:17.314422 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:17.314422 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:17.314422 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:17.314422 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:17.314422 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:17.314422 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:17.314422 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:17.314422 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:17.314422 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:17.314422 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:17.314422 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:17.314422 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:17.314422 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:17.314422 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:17.314422 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:17.315406 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:17.315406 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:17.315406 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:17.315406 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:17.315406 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:17.315406 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:17.315406 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:17.315406 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:17.315406 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:17.315406 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:17.315406 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:17.315406 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:17.315406 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:17.315406 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:17.315406 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:17.315406 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:17.315406 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:17.316276 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:17.316276 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:17.316276 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:17.316276 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 254/505] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:17.316276 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b8910-e3d4-4c01-9719-fb2db573618d None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:17.337403 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a5d53-5e5a-456c-9cd2-c0d62ed94e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:17.338109 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a5d53-5e5a-456c-9cd2-c0d62ed94e87 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:17.338620 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a5d53-5e5a-456c-9cd2-c0d62ed94e87 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:17.338728 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a5d53-5e5a-456c-9cd2-c0d62ed94e87 None admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:17.339302 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a5d53-5e5a-456c-9cd2-c0d62ed94e87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:17.339606 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a5d53-5e5a-456c-9cd2-c0d62ed94e87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:17.340955 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a5d53-5e5a-456c-9cd2-c0d62ed94e87 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:17.360114 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 252/506] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:17.360114 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a5d53-5e5a-456c-9cd2-c0d62ed94e87 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:17.406651 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:17.423873 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b8910-e3d4-4c01-9719-fb2db573618d None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:17.425404 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:17.461923 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11c64e-f6c4-4caa-a762-035daa6f8a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:17.462542 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11c64e-f6c4-4caa-a762-035daa6f8a42 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:17.462822 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11c64e-f6c4-4caa-a762-035daa6f8a42 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:17.463085 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11c64e-f6c4-4caa-a762-035daa6f8a42 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:17.472458 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a5d53-5e5a-456c-9cd2-c0d62ed94e87 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:17.472959 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa11c64e-f6c4-4caa-a762-035daa6f8a42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:35:17.478561 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-fa11c64e-f6c4-4caa-a762-035daa6f8a42 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:35:17.478561 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:17.478561 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:17.478561 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:17.478561 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:17.478561 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:17.478561 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:17.478561 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:17.478561 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:17.478561 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:17.478561 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:17.478561 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:17.478561 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:35:17.478561 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:35:17.478561 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:35:17.478561 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:35:17.479662 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:35:17.479662 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:35:17.479662 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:35:17.479662 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:35:17.479662 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:17.479662 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:17.479662 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:17.479662 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:17.479662 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:17.479662 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:17.479662 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:17.479662 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:17.479662 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:17.479662 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:17.479662 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:17.479662 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:17.480544 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:17.480544 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:17.480544 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:17.480544 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:17.480544 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:35:17.480544 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:35:17.480544 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:35:17.480544 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:35:17.480544 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:35:17.480544 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:35:17.480544 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:35:17.480544 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:17.480544 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 255/507] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Sep 8 13:35:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:17.481247 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11c64e-f6c4-4caa-a762-035daa6f8a42 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:17.510119 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e2a78-7b89-4e73-a146-863b19d3399d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:17.510666 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e2a78-7b89-4e73-a146-863b19d3399d None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:17.510942 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e2a78-7b89-4e73-a146-863b19d3399d None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:17.511213 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e2a78-7b89-4e73-a146-863b19d3399d None admin] PATH_INFO: `/v3/users/glance` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:17.518420 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e2a78-7b89-4e73-a146-863b19d3399d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:17.519854 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e2a78-7b89-4e73-a146-863b19d3399d None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:17.532787 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-dc0e2a78-7b89-4e73-a146-863b19d3399d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 08 13:35:17.532787 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:17.532787 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:17.532787 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:17.532787 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:17.532787 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:17.532787 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:17.532787 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:17.532787 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:17.532787 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:17.532787 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:17.532787 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:17.532787 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:35:17.532787 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:35:17.532787 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:35:17.532787 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:35:17.533754 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:17.533754 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:17.533754 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:35:17.533754 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:35:17.533754 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:35:17.533754 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:35:17.533754 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:17.533754 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:17.533754 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:17.533754 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:17.533754 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:17.533754 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:17.533754 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:17.533754 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:17.533754 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:17.533754 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:17.533754 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:17.533754 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:17.534651 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:17.534651 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:17.534651 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:35:17.534651 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:35:17.534651 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:35:17.534651 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:35:17.534651 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:35:17.534651 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:35:17.534651 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 08 13:35:17.534651 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:17.537520 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 253/508] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:35:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:17.538549 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e2a78-7b89-4e73-a146-863b19d3399d None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:17.585624 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11c64e-f6c4-4caa-a762-035daa6f8a42 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:17.618917 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd203948-e448-47c9-a874-3ae44e20133e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:17.619545 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd203948-e448-47c9-a874-3ae44e20133e None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:17.619800 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd203948-e448-47c9-a874-3ae44e20133e None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:17.620071 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd203948-e448-47c9-a874-3ae44e20133e None admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:17.620718 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd203948-e448-47c9-a874-3ae44e20133e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:17.621019 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd203948-e448-47c9-a874-3ae44e20133e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:17.622411 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd203948-e448-47c9-a874-3ae44e20133e None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:17.635050 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 256/509] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:17.636392 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd203948-e448-47c9-a874-3ae44e20133e None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:17.645156 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:17.650540 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e2a78-7b89-4e73-a146-863b19d3399d None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:17.665283 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:17.685786 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac9210-1da8-4c6b-8c15-becf588113b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:17.686413 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac9210-1da8-4c6b-8c15-becf588113b5 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:17.686693 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac9210-1da8-4c6b-8c15-becf588113b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:17.686968 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac9210-1da8-4c6b-8c15-becf588113b5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:17.695569 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac9210-1da8-4c6b-8c15-becf588113b5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:17.697030 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac9210-1da8-4c6b-8c15-becf588113b5 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:17.708228 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-e4ac9210-1da8-4c6b-8c15-becf588113b5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 08 13:35:17.708228 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:17.708228 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:17.708228 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:17.708228 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:17.708228 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:17.708228 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:17.708228 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:17.708228 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:17.708228 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:17.708228 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:17.708228 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:17.708228 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:35:17.708228 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:35:17.708228 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:35:17.708228 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:35:17.709238 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:17.709238 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:17.709238 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:35:17.709238 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:35:17.709238 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:35:17.709238 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:35:17.709238 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:17.709238 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:17.709238 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:17.709238 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:17.709238 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:17.709238 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:17.709238 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:17.709238 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:17.709238 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:17.709238 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:17.709238 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:17.709238 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:17.710174 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:17.710174 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:17.710174 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:35:17.710174 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:35:17.710174 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:35:17.710174 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:35:17.710174 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:35:17.710174 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:35:17.710174 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 08 13:35:17.710174 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:17.710174 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 254/510] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:35:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:17.710761 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac9210-1da8-4c6b-8c15-becf588113b5 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:17.744478 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd203948-e448-47c9-a874-3ae44e20133e None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:17.779025 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3364cc10-3384-46ca-bb96-cb7532f6175c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:17.779563 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364cc10-3384-46ca-bb96-cb7532f6175c None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:17.779846 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364cc10-3384-46ca-bb96-cb7532f6175c None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:17.780112 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364cc10-3384-46ca-bb96-cb7532f6175c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:17.791424 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3364cc10-3384-46ca-bb96-cb7532f6175c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:17.792888 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3364cc10-3384-46ca-bb96-cb7532f6175c None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:17.807975 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-3364cc10-3384-46ca-bb96-cb7532f6175c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:17.807975 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:17.807975 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:17.807975 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:17.807975 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:17.807975 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:17.807975 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:17.807975 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:17.807975 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:17.807975 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:17.807975 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:17.807975 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:17.807975 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:17.807975 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:17.807975 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:17.807975 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:17.808931 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:17.808931 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:17.808931 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:17.808931 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:17.808931 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:17.808931 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:17.808931 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:17.808931 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:17.808931 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:17.808931 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:17.808931 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:17.808931 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:17.808931 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:17.808931 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:17.808931 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:17.808931 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:17.808931 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:17.809987 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:17.809987 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:17.809987 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:17.809987 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 257/511] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:17.810551 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3364cc10-3384-46ca-bb96-cb7532f6175c None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:17.819073 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac9210-1da8-4c6b-8c15-becf588113b5 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:17.853556 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d19853-c393-48b4-b10e-ba51193f4529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:17.854149 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d19853-c393-48b4-b10e-ba51193f4529 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:17.854431 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d19853-c393-48b4-b10e-ba51193f4529 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:17.854690 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d19853-c393-48b4-b10e-ba51193f4529 None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:17.855339 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d19853-c393-48b4-b10e-ba51193f4529 None admin] RBAC: Adding query filter params (name=service) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:17.855639 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d19853-c393-48b4-b10e-ba51193f4529 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:17.857010 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d19853-c393-48b4-b10e-ba51193f4529 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:17.865549 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 255/512] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Sep 8 13:35:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:17.866542 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d19853-c393-48b4-b10e-ba51193f4529 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:17.893469 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:17.896672 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:17.920068 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3364cc10-3384-46ca-bb96-cb7532f6175c None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:17.957515 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d840b7ab-47c7-4e05-883c-4ee60784850f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:17.958142 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840b7ab-47c7-4e05-883c-4ee60784850f None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:17.958403 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840b7ab-47c7-4e05-883c-4ee60784850f None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:17.958704 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840b7ab-47c7-4e05-883c-4ee60784850f None admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:17.959857 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d840b7ab-47c7-4e05-883c-4ee60784850f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:17.960162 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d840b7ab-47c7-4e05-883c-4ee60784850f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:17.961628 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d840b7ab-47c7-4e05-883c-4ee60784850f None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:17.981179 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 258/513] 10.222.0.69 () {56 vars in 1137 bytes} [Thu Sep 8 13:35:17 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:17.986124 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d840b7ab-47c7-4e05-883c-4ee60784850f None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:17.987363 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d19853-c393-48b4-b10e-ba51193f4529 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:18.029874 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26733f9c-5a1f-4bdb-9436-1d67e2ac1075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:18.030757 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26733f9c-5a1f-4bdb-9436-1d67e2ac1075 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:18.031220 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26733f9c-5a1f-4bdb-9436-1d67e2ac1075 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:18.031649 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26733f9c-5a1f-4bdb-9436-1d67e2ac1075 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:18.042575 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26733f9c-5a1f-4bdb-9436-1d67e2ac1075 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:18.044243 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26733f9c-5a1f-4bdb-9436-1d67e2ac1075 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:18.057093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-26733f9c-5a1f-4bdb-9436-1d67e2ac1075 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:35:18.057093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:18.057093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:18.057093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:18.057093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:18.057093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:18.057093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:18.057093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:18.057093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:18.057093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:18.057093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:18.057093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:18.057093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:35:18.057093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:35:18.057093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:35:18.058253 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:35:18.058253 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:18.058253 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:18.058253 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:18.058253 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:18.058253 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:18.058253 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:18.058253 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:18.058253 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:18.058253 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:18.058253 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:18.058253 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:18.058253 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:18.058253 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:18.058253 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:18.058253 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:18.058253 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:18.059194 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:35:18.059194 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:35:18.059194 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:35:18.059194 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:35:18.059194 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:35:18.059194 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:35:18.059194 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:35:18.059194 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:18.059194 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 256/514] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:35:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:18.059194 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26733f9c-5a1f-4bdb-9436-1d67e2ac1075 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:18.108079 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d840b7ab-47c7-4e05-883c-4ee60784850f None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:18.139692 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:18.146165 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc5645-261d-484d-804c-57d096b5da54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:18.147020 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc5645-261d-484d-804c-57d096b5da54 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:18.147326 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc5645-261d-484d-804c-57d096b5da54 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:18.147580 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc5645-261d-484d-804c-57d096b5da54 None admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:18.148306 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc5645-261d-484d-804c-57d096b5da54 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:18.148612 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc5645-261d-484d-804c-57d096b5da54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:18.151222 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc5645-261d-484d-804c-57d096b5da54 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:18.152196 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:18.172010 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 259/515] 10.222.0.69 () {56 vars in 1137 bytes} [Thu Sep 8 13:35:17 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:18.173156 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc5645-261d-484d-804c-57d096b5da54 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:18.173414 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26733f9c-5a1f-4bdb-9436-1d67e2ac1075 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:18.225637 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b18701-fc1a-4b74-8580-dbf08646dffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:18.226258 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b18701-fc1a-4b74-8580-dbf08646dffc None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:18.226534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b18701-fc1a-4b74-8580-dbf08646dffc None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:18.226812 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b18701-fc1a-4b74-8580-dbf08646dffc None admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:18.227462 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b18701-fc1a-4b74-8580-dbf08646dffc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:18.227769 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b18701-fc1a-4b74-8580-dbf08646dffc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:18.229180 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b18701-fc1a-4b74-8580-dbf08646dffc None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:18.249438 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 257/516] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:18.250386 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b18701-fc1a-4b74-8580-dbf08646dffc None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:18.290568 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc5645-261d-484d-804c-57d096b5da54 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:18.326336 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5447039-024a-476f-83d2-2ff0e50af002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:18.326966 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5447039-024a-476f-83d2-2ff0e50af002 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:18.327253 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5447039-024a-476f-83d2-2ff0e50af002 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:18.327524 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5447039-024a-476f-83d2-2ff0e50af002 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:18.338362 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5447039-024a-476f-83d2-2ff0e50af002 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:18.339895 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5447039-024a-476f-83d2-2ff0e50af002 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:18.355764 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-d5447039-024a-476f-83d2-2ff0e50af002 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:18.355764 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:18.355764 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:18.355764 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:18.355764 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:18.355764 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:18.355764 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:18.355764 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:18.355764 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:18.355764 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:18.355764 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:18.355764 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:18.355764 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:18.355764 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:18.355764 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:18.355764 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:18.356787 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:18.356787 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:18.356787 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:18.356787 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:18.356787 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:18.356787 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:18.356787 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:18.356787 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:18.356787 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:18.356787 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:18.356787 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:18.356787 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:18.356787 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:18.356787 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:18.356787 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:18.356787 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:18.356787 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:18.357680 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:18.357680 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:18.357680 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:18.357680 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 260/517] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:18.358026 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5447039-024a-476f-83d2-2ff0e50af002 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:18.364423 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b18701-fc1a-4b74-8580-dbf08646dffc None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:18.401257 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7074d3-1df2-435f-b73f-20175c4c5170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:18.401913 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7074d3-1df2-435f-b73f-20175c4c5170 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:18.402183 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7074d3-1df2-435f-b73f-20175c4c5170 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:18.402453 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7074d3-1df2-435f-b73f-20175c4c5170 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:18.413665 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:18.415339 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:18.474353 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7074d3-1df2-435f-b73f-20175c4c5170 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:18.476009 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7074d3-1df2-435f-b73f-20175c4c5170 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:18.480264 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5447039-024a-476f-83d2-2ff0e50af002 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:18.514502 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc7be7-8cb7-4aee-8731-236b4855795e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:18.515136 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc7be7-8cb7-4aee-8731-236b4855795e None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:18.515416 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc7be7-8cb7-4aee-8731-236b4855795e None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:18.515692 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc7be7-8cb7-4aee-8731-236b4855795e None admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:18.516385 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc7be7-8cb7-4aee-8731-236b4855795e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:18.516692 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc7be7-8cb7-4aee-8731-236b4855795e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:18.518183 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc7be7-8cb7-4aee-8731-236b4855795e None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:18.536632 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 261/518] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 8 13:35:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:18.537884 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc7be7-8cb7-4aee-8731-236b4855795e None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:18.586776 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 258/519] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:35:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:35:18.587530 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7074d3-1df2-435f-b73f-20175c4c5170 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:18.634884 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:18.649131 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc7be7-8cb7-4aee-8731-236b4855795e None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:18.650736 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:18.686525 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae38203-0ba4-4f32-b3d7-3f13c8a82aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:18.687122 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae38203-0ba4-4f32-b3d7-3f13c8a82aec None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:18.687407 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae38203-0ba4-4f32-b3d7-3f13c8a82aec None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:18.687663 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae38203-0ba4-4f32-b3d7-3f13c8a82aec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:18.699368 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7074d3-1df2-435f-b73f-20175c4c5170 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:18.736857 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e19043-d9c3-458e-9526-4dfe8a4a3ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:18.737522 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e19043-d9c3-458e-9526-4dfe8a4a3ae8 None admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:18.737798 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e19043-d9c3-458e-9526-4dfe8a4a3ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:18.738075 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e19043-d9c3-458e-9526-4dfe8a4a3ae8 None admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:18.738728 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e19043-d9c3-458e-9526-4dfe8a4a3ae8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:18.740367 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e19043-d9c3-458e-9526-4dfe8a4a3ae8 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:18.759921 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae38203-0ba4-4f32-b3d7-3f13c8a82aec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:18.761403 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae38203-0ba4-4f32-b3d7-3f13c8a82aec None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:18.763142 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 259/520] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Sep 8 13:35:18 2022] POST /identity/v3/users => generated 247 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:35:18.763972 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e19043-d9c3-458e-9526-4dfe8a4a3ae8 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:18.888743 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:18.897794 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 262/521] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:35:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:35:18.898133 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e19043-d9c3-458e-9526-4dfe8a4a3ae8 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:18.899099 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae38203-0ba4-4f32-b3d7-3f13c8a82aec None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:18.903601 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:18.946381 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2d838-e50c-44b6-9645-10344308c1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:18.947179 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2d838-e50c-44b6-9645-10344308c1d3 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:18.948124 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2d838-e50c-44b6-9645-10344308c1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:18.948124 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2d838-e50c-44b6-9645-10344308c1d3 None admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:18.948365 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e2d838-e50c-44b6-9645-10344308c1d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:18.949033 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e2d838-e50c-44b6-9645-10344308c1d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:18.950088 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e2d838-e50c-44b6-9645-10344308c1d3 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:18.967226 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 260/522] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:18.968169 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2d838-e50c-44b6-9645-10344308c1d3 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:19.040376 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae38203-0ba4-4f32-b3d7-3f13c8a82aec None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:19.079447 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a281f7af-6c92-4566-b217-4b00393ddc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:19.080088 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281f7af-6c92-4566-b217-4b00393ddc70 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:19.080374 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281f7af-6c92-4566-b217-4b00393ddc70 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:19.080673 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281f7af-6c92-4566-b217-4b00393ddc70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:19.081473 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a281f7af-6c92-4566-b217-4b00393ddc70 None admin] RBAC: Adding query filter params (role.id=e5f27e532c9d4bc7a57e31856ecee597, scope.project.id=88de9f1470c6415b97866ad5a3256ef2, user.id=c95448c1b8b1466cae37fda5c713d53f) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:19.081788 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a281f7af-6c92-4566-b217-4b00393ddc70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:19.083469 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a281f7af-6c92-4566-b217-4b00393ddc70 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:19.090903 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 263/523] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 8 13:35:18 2022] GET /identity/v3/role_assignments?user.id=c95448c1b8b1466cae37fda5c713d53f&scope.project.id=88de9f1470c6415b97866ad5a3256ef2&role.id=e5f27e532c9d4bc7a57e31856ecee597 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:19.091792 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a281f7af-6c92-4566-b217-4b00393ddc70 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:19.105298 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e2d838-e50c-44b6-9645-10344308c1d3 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:19.164958 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f058c5c7-a00c-47f2-ac2c-8a23c9350418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:19.165629 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058c5c7-a00c-47f2-ac2c-8a23c9350418 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:19.165918 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058c5c7-a00c-47f2-ac2c-8a23c9350418 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:19.166241 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f058c5c7-a00c-47f2-ac2c-8a23c9350418 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:19.182351 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f058c5c7-a00c-47f2-ac2c-8a23c9350418 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:19.183866 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f058c5c7-a00c-47f2-ac2c-8a23c9350418 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:19.203033 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-f058c5c7-a00c-47f2-ac2c-8a23c9350418 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:19.203033 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:19.203033 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:19.203033 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:19.203033 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:19.203033 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:19.203033 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:19.203033 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:19.203033 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:19.203033 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:19.203033 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:19.203033 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:19.203033 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:19.203033 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:19.203033 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:19.203033 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:19.204665 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:19.204665 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:19.204665 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:19.204665 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:19.204665 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:19.204665 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:19.204665 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:19.204665 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:19.204665 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:19.204665 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:19.204665 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:19.204665 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:19.204665 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:19.204665 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:19.204665 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:19.204665 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:19.204665 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:19.206855 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:19.206855 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:19.206855 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:19.209545 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:19.210343 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 261/524] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:19.211389 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f058c5c7-a00c-47f2-ac2c-8a23c9350418 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:19.227508 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:19.276578 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a281f7af-6c92-4566-b217-4b00393ddc70 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:19.344092 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920ba80-c83a-48c0-a706-f13e176c2933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:19.345108 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920ba80-c83a-48c0-a706-f13e176c2933 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:19.345608 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920ba80-c83a-48c0-a706-f13e176c2933 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:19.346077 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920ba80-c83a-48c0-a706-f13e176c2933 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:19.361781 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f920ba80-c83a-48c0-a706-f13e176c2933 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:19.363590 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f920ba80-c83a-48c0-a706-f13e176c2933 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:19.380149 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f058c5c7-a00c-47f2-ac2c-8a23c9350418 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:19.382599 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-f920ba80-c83a-48c0-a706-f13e176c2933 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:19.382599 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:19.382599 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:19.382599 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:19.382599 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:19.382599 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:19.382599 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:19.382599 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:19.382599 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:19.382599 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:19.382599 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:19.382599 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:19.382599 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:19.382599 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:19.382599 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:19.382599 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:19.384622 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:19.384622 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:19.384622 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:19.384622 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:19.384622 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:19.384622 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:19.384622 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:19.384622 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:19.384622 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:19.384622 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:19.384622 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:19.384622 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:19.384622 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:19.384622 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:19.384622 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:19.384622 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:19.384622 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:19.385789 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:19.385789 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:19.385789 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:19.385789 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 264/525] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:19.391200 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920ba80-c83a-48c0-a706-f13e176c2933 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:19.430498 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c3bf5-3700-443c-890c-bce19e7f51f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:19.431064 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c3bf5-3700-443c-890c-bce19e7f51f7 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:19.431346 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c3bf5-3700-443c-890c-bce19e7f51f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:19.431618 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c3bf5-3700-443c-890c-bce19e7f51f7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:19.441271 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c3bf5-3700-443c-890c-bce19e7f51f7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:19.442779 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c3bf5-3700-443c-890c-bce19e7f51f7 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:19.458401 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-077c3bf5-3700-443c-890c-bce19e7f51f7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 08 13:35:19.458401 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:19.458401 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:19.458401 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:19.458401 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:19.458401 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:19.458401 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:19.458401 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:19.458401 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:19.458401 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:19.458401 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:19.458401 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:19.458401 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:35:19.458401 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:35:19.458401 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:35:19.458401 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:35:19.460189 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:19.460189 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:19.460189 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:35:19.460189 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:35:19.460189 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:35:19.460189 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:35:19.460189 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:19.460189 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:19.460189 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:19.460189 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:19.460189 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:19.460189 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:19.460189 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:19.460189 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:19.460189 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:19.460189 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:19.460189 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:19.460189 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:19.461801 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:19.461801 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:19.461801 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:35:19.461801 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:35:19.461801 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:35:19.461801 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:35:19.461801 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:35:19.461801 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:35:19.461801 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 08 13:35:19.461801 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:19.461801 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 262/526] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Sep 8 13:35:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:19.461801 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c3bf5-3700-443c-890c-bce19e7f51f7 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:19.531025 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920ba80-c83a-48c0-a706-f13e176c2933 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:19.554747 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:19.555275 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:19.578444 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e47f3-0184-410e-9bad-15e813f43748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:19.579450 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e47f3-0184-410e-9bad-15e813f43748 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:19.579741 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e47f3-0184-410e-9bad-15e813f43748 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:19.580015 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e47f3-0184-410e-9bad-15e813f43748 None admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:19.580669 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e47f3-0184-410e-9bad-15e813f43748 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:19.580985 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e47f3-0184-410e-9bad-15e813f43748 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:19.582951 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e47f3-0184-410e-9bad-15e813f43748 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:19.602224 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 265/527] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:19.603365 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e47f3-0184-410e-9bad-15e813f43748 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:19.605180 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c3bf5-3700-443c-890c-bce19e7f51f7 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:19.653943 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf8a09-d757-4f49-bd68-87641add96d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:19.654560 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf8a09-d757-4f49-bd68-87641add96d8 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:19.654841 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf8a09-d757-4f49-bd68-87641add96d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:19.655118 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cf8a09-d757-4f49-bd68-87641add96d8 None admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:19.656106 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf8a09-d757-4f49-bd68-87641add96d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:19.656553 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf8a09-d757-4f49-bd68-87641add96d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:19.658296 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cf8a09-d757-4f49-bd68-87641add96d8 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:19.675978 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 263/528] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:19.676858 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf8a09-d757-4f49-bd68-87641add96d8 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:19.722815 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e47f3-0184-410e-9bad-15e813f43748 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:19.765230 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba2097-31cb-477b-aa38-4ab13fbfb5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:19.766083 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba2097-31cb-477b-aa38-4ab13fbfb5a7 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:19.766476 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba2097-31cb-477b-aa38-4ab13fbfb5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:19.766873 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba2097-31cb-477b-aa38-4ab13fbfb5a7 None admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:19.768234 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba2097-31cb-477b-aa38-4ab13fbfb5a7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:19.768543 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba2097-31cb-477b-aa38-4ab13fbfb5a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:19.770726 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba2097-31cb-477b-aa38-4ab13fbfb5a7 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:19.794094 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 266/529] 10.222.0.69 () {56 vars in 1139 bytes} [Thu Sep 8 13:35:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:19.795156 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba2097-31cb-477b-aa38-4ab13fbfb5a7 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:19.820146 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cf8a09-d757-4f49-bd68-87641add96d8 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:19.841064 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:19.855489 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:19.868171 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318881e-174a-41aa-81b3-ea808917bac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:19.869120 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318881e-174a-41aa-81b3-ea808917bac6 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:19.870065 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318881e-174a-41aa-81b3-ea808917bac6 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:19.870490 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318881e-174a-41aa-81b3-ea808917bac6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:19.881416 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a318881e-174a-41aa-81b3-ea808917bac6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:19.883555 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a318881e-174a-41aa-81b3-ea808917bac6 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:19.900334 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-a318881e-174a-41aa-81b3-ea808917bac6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:35:19.900334 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:19.900334 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:19.900334 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:19.900334 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:19.900334 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:19.900334 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:19.900334 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:19.900334 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:19.900334 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:19.900334 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:19.900334 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:19.900334 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:35:19.900334 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:35:19.900334 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:35:19.901517 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:35:19.901517 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:19.901517 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:19.901517 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:19.901517 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:19.901517 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:19.901517 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:19.901517 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:19.901517 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:19.901517 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:19.901517 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:19.901517 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:19.901517 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:19.901517 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:19.901517 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:19.901517 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:19.901517 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:19.902587 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:35:19.902587 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:35:19.902587 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:35:19.902587 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:35:19.902587 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:35:19.902587 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:35:19.902587 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:35:19.902587 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:19.905112 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 264/530] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:35:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:19.906568 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318881e-174a-41aa-81b3-ea808917bac6 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:19.926618 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba2097-31cb-477b-aa38-4ab13fbfb5a7 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:19.981671 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d212e85-1b89-4d0f-b969-46169555f538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:19.983199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d212e85-1b89-4d0f-b969-46169555f538 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:19.983660 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d212e85-1b89-4d0f-b969-46169555f538 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:19.984084 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d212e85-1b89-4d0f-b969-46169555f538 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:19.995836 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d212e85-1b89-4d0f-b969-46169555f538 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:19.998470 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d212e85-1b89-4d0f-b969-46169555f538 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:20.017193 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-6d212e85-1b89-4d0f-b969-46169555f538 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:35:20.017193 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:20.017193 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:20.017193 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:20.017193 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:20.017193 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:20.017193 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:20.017193 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:20.017193 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:20.017193 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:20.017193 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:20.017193 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:20.017193 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:35:20.017193 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:35:20.017193 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:35:20.018193 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:35:20.018193 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:20.018193 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:20.018193 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:20.018193 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:20.018193 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:20.018193 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:20.018193 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:20.018193 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:20.018193 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:20.018193 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:20.018193 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:20.018193 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:20.018193 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:20.018193 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:20.018193 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:20.018193 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:20.019049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:35:20.019049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:35:20.019049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:35:20.019049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:35:20.019049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:35:20.019049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:35:20.019049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:35:20.019049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:20.021268 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 267/531] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:35:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:20.022841 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d212e85-1b89-4d0f-b969-46169555f538 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:20.072655 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318881e-174a-41aa-81b3-ea808917bac6 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:20.136480 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc44fda-6ccb-48eb-84b2-3a46f0f38306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:20.138001 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc44fda-6ccb-48eb-84b2-3a46f0f38306 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:20.138130 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc44fda-6ccb-48eb-84b2-3a46f0f38306 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:20.138494 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc44fda-6ccb-48eb-84b2-3a46f0f38306 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:20.160634 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:20.170615 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d212e85-1b89-4d0f-b969-46169555f538 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:20.218243 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:20.235762 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc44fda-6ccb-48eb-84b2-3a46f0f38306 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:20.235932 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0748f3a4-fd25-4e9c-a766-5fddcea79f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:20.236939 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0748f3a4-fd25-4e9c-a766-5fddcea79f3b None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:20.237467 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0748f3a4-fd25-4e9c-a766-5fddcea79f3b None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:20.237946 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0748f3a4-fd25-4e9c-a766-5fddcea79f3b None admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:20.238417 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc44fda-6ccb-48eb-84b2-3a46f0f38306 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:20.239133 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0748f3a4-fd25-4e9c-a766-5fddcea79f3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:20.239627 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0748f3a4-fd25-4e9c-a766-5fddcea79f3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:20.242483 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0748f3a4-fd25-4e9c-a766-5fddcea79f3b None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:20.268863 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 268/532] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 8 13:35:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:20.270459 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0748f3a4-fd25-4e9c-a766-5fddcea79f3b None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:20.389618 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 265/533] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:35:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:35:20.391443 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc44fda-6ccb-48eb-84b2-3a46f0f38306 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:20.442892 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0748f3a4-fd25-4e9c-a766-5fddcea79f3b None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:20.501577 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22feb840-fe76-4473-95cc-2eeb827e2171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:20.502498 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22feb840-fe76-4473-95cc-2eeb827e2171 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:20.503453 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22feb840-fe76-4473-95cc-2eeb827e2171 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:20.503453 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22feb840-fe76-4473-95cc-2eeb827e2171 None admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:20.504671 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22feb840-fe76-4473-95cc-2eeb827e2171 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:20.505210 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22feb840-fe76-4473-95cc-2eeb827e2171 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:20.508406 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22feb840-fe76-4473-95cc-2eeb827e2171 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:20.531991 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:20.537607 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 269/534] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 8 13:35:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:20.539839 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22feb840-fe76-4473-95cc-2eeb827e2171 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:20.549310 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc44fda-6ccb-48eb-84b2-3a46f0f38306 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:20.575675 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:20.604664 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d0c3c-c570-4d9f-b5b5-61da26d31530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:20.605719 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d0c3c-c570-4d9f-b5b5-61da26d31530 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:20.606206 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d0c3c-c570-4d9f-b5b5-61da26d31530 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:20.606681 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d0c3c-c570-4d9f-b5b5-61da26d31530 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:20.608245 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702d0c3c-c570-4d9f-b5b5-61da26d31530 None admin] RBAC: Adding query filter params (role.id=e5f27e532c9d4bc7a57e31856ecee597, scope.project.id=88de9f1470c6415b97866ad5a3256ef2, user.id=6677b4518c094636bc8ed7b588103390) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:20.608773 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702d0c3c-c570-4d9f-b5b5-61da26d31530 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:20.611194 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702d0c3c-c570-4d9f-b5b5-61da26d31530 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:20.619323 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 266/535] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 8 13:35:20 2022] GET /identity/v3/role_assignments?user.id=6677b4518c094636bc8ed7b588103390&scope.project.id=88de9f1470c6415b97866ad5a3256ef2&role.id=e5f27e532c9d4bc7a57e31856ecee597 => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:20.620308 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d0c3c-c570-4d9f-b5b5-61da26d31530 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:20.698085 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22feb840-fe76-4473-95cc-2eeb827e2171 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:20.737620 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d0c3c-c570-4d9f-b5b5-61da26d31530 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:20.741301 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f6865-f949-48d1-8fdc-292188d5d53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:20.742609 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f6865-f949-48d1-8fdc-292188d5d53c None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:20.743095 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f6865-f949-48d1-8fdc-292188d5d53c None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:20.743588 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f6865-f949-48d1-8fdc-292188d5d53c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:20.756772 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f6865-f949-48d1-8fdc-292188d5d53c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:20.758825 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f6865-f949-48d1-8fdc-292188d5d53c None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:20.776352 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-1c8f6865-f949-48d1-8fdc-292188d5d53c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:20.776352 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:20.776352 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:20.776352 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:20.776352 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:20.776352 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:20.776352 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:20.776352 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:20.776352 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:20.776352 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:20.776352 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:20.776352 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:20.776352 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:20.776352 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:20.776352 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:20.776352 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:20.777485 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:20.777485 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:20.777485 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:20.777485 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:20.777485 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:20.777485 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:20.777485 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:20.777485 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:20.777485 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:20.777485 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:20.777485 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:20.777485 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:20.777485 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:20.777485 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:20.777485 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:20.777485 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:20.777485 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:20.778436 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:20.778436 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:20.778436 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:20.778611 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8029685-2e8c-4076-ad41-412c604f6544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:20.778611 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8029685-2e8c-4076-ad41-412c604f6544 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:20.778611 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8029685-2e8c-4076-ad41-412c604f6544 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:20.778611 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8029685-2e8c-4076-ad41-412c604f6544 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:20.779405 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8029685-2e8c-4076-ad41-412c604f6544 None admin] RBAC: Adding query filter params (role.id=e5f27e532c9d4bc7a57e31856ecee597, scope.project.id=88de9f1470c6415b97866ad5a3256ef2, user.id=d311099f51484141bd8504184b818ee8) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:20.779789 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8029685-2e8c-4076-ad41-412c604f6544 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:20.781199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 270/536] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:20.781500 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8029685-2e8c-4076-ad41-412c604f6544 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:20.792845 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 267/537] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 8 13:35:20 2022] GET /identity/v3/role_assignments?user.id=d311099f51484141bd8504184b818ee8&scope.project.id=88de9f1470c6415b97866ad5a3256ef2&role.id=e5f27e532c9d4bc7a57e31856ecee597 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:20.794634 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f6865-f949-48d1-8fdc-292188d5d53c None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:20.895342 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:20.954860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f6865-f949-48d1-8fdc-292188d5d53c None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:21.006747 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259c7a2-6c61-4bbf-8639-59683a94e874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:21.007098 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259c7a2-6c61-4bbf-8639-59683a94e874 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:21.007274 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259c7a2-6c61-4bbf-8639-59683a94e874 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:21.007512 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259c7a2-6c61-4bbf-8639-59683a94e874 None admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:21.008177 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5259c7a2-6c61-4bbf-8639-59683a94e874 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:21.008480 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5259c7a2-6c61-4bbf-8639-59683a94e874 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:21.010011 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5259c7a2-6c61-4bbf-8639-59683a94e874 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:21.025299 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 271/538] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:21.031060 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8029685-2e8c-4076-ad41-412c604f6544 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:21.059226 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:21.155268 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8029685-2e8c-4076-ad41-412c604f6544 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:21.192536 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd09e07-afd5-4c97-9091-5155a1610b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:21.194011 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd09e07-afd5-4c97-9091-5155a1610b65 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:21.194366 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd09e07-afd5-4c97-9091-5155a1610b65 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:21.194666 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd09e07-afd5-4c97-9091-5155a1610b65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:21.203352 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd09e07-afd5-4c97-9091-5155a1610b65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:21.204859 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd09e07-afd5-4c97-9091-5155a1610b65 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:21.217927 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-3bd09e07-afd5-4c97-9091-5155a1610b65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:35:21.217927 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:21.217927 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:21.217927 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:21.217927 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:21.217927 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:21.217927 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:21.217927 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:21.217927 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:21.217927 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:21.217927 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:21.217927 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:21.217927 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:35:21.217927 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:35:21.217927 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:35:21.218901 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:35:21.218901 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:21.218901 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:21.218901 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:21.218901 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:21.218901 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:21.218901 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:21.218901 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:21.218901 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:21.218901 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:21.218901 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:21.218901 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:21.218901 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:21.218901 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:21.218901 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:21.218901 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:21.218901 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:21.219810 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:35:21.219810 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:35:21.219810 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:35:21.219810 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:35:21.219810 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:35:21.219810 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:35:21.219810 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:35:21.219810 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:21.219810 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 268/539] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:35:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:21.230546 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259c7a2-6c61-4bbf-8639-59683a94e874 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:21.249029 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99878bed-bb8b-4831-857c-5da21aef6cff None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:21.249544 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99878bed-bb8b-4831-857c-5da21aef6cff None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:21.250045 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99878bed-bb8b-4831-857c-5da21aef6cff None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:21.254385 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 269/540] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:35:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:35:21.266277 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b14b3-fe36-4d18-a39c-9ce90f3238a4 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:21.266449 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b14b3-fe36-4d18-a39c-9ce90f3238a4 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:21.266728 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b14b3-fe36-4d18-a39c-9ce90f3238a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:21.309492 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-638b14b3-fe36-4d18-a39c-9ce90f3238a4 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:35:21.310965 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-638b14b3-fe36-4d18-a39c-9ce90f3238a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:35:21.405583 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 270/541] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:35:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:35:21.476758 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259c7a2-6c61-4bbf-8639-59683a94e874 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:21.517378 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:21.525845 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aabe13-30cb-4fda-aa63-496b7b670191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:21.526474 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aabe13-30cb-4fda-aa63-496b7b670191 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:21.526922 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aabe13-30cb-4fda-aa63-496b7b670191 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:21.527379 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aabe13-30cb-4fda-aa63-496b7b670191 None admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:21.528127 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aabe13-30cb-4fda-aa63-496b7b670191 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:21.528476 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aabe13-30cb-4fda-aa63-496b7b670191 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:21.530545 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aabe13-30cb-4fda-aa63-496b7b670191 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:21.553352 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 272/542] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 8 13:35:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:21.560141 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b14b3-fe36-4d18-a39c-9ce90f3238a4 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:21.582364 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:21.745652 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b14b3-fe36-4d18-a39c-9ce90f3238a4 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:21.796862 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea699550-4733-4afa-b839-0e7e7a8b2d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:21.797414 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea699550-4733-4afa-b839-0e7e7a8b2d46 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:21.797699 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea699550-4733-4afa-b839-0e7e7a8b2d46 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:21.797980 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea699550-4733-4afa-b839-0e7e7a8b2d46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:21.798764 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea699550-4733-4afa-b839-0e7e7a8b2d46 None admin] RBAC: Adding query filter params (role.id=e5f27e532c9d4bc7a57e31856ecee597, scope.project.id=88de9f1470c6415b97866ad5a3256ef2, user.id=db898158553743d3a28f3d6237e91a8b) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:21.799140 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea699550-4733-4afa-b839-0e7e7a8b2d46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:21.800763 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea699550-4733-4afa-b839-0e7e7a8b2d46 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:21.808245 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 271/543] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 8 13:35:21 2022] GET /identity/v3/role_assignments?user.id=db898158553743d3a28f3d6237e91a8b&scope.project.id=88de9f1470c6415b97866ad5a3256ef2&role.id=e5f27e532c9d4bc7a57e31856ecee597 => generated 259 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:21.818917 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aabe13-30cb-4fda-aa63-496b7b670191 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:21.852566 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939db29-9c41-4f86-926e-add7d2bb211e None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:21.853081 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939db29-9c41-4f86-926e-add7d2bb211e None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:21.853565 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939db29-9c41-4f86-926e-add7d2bb211e None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:21.855728 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 272/544] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:35:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:35:21.862567 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696313c-0a57-4d5e-852c-ea38292b4971 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:21.862889 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696313c-0a57-4d5e-852c-ea38292b4971 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:21.863318 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696313c-0a57-4d5e-852c-ea38292b4971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:21.884053 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-8696313c-0a57-4d5e-852c-ea38292b4971 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:35:21.885618 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-8696313c-0a57-4d5e-852c-ea38292b4971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:35:21.984291 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aabe13-30cb-4fda-aa63-496b7b670191 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:22.034246 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:22.044639 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 273/545] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:35:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:35:22.047164 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91011132-20c1-45a7-95fd-af7ade235b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:22.047878 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91011132-20c1-45a7-95fd-af7ade235b0a None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:22.048160 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91011132-20c1-45a7-95fd-af7ade235b0a None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:22.048437 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91011132-20c1-45a7-95fd-af7ade235b0a None admin] PATH_INFO: `/v3/roles/service` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:22.066910 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91011132-20c1-45a7-95fd-af7ade235b0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:35:22.075513 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-91011132-20c1-45a7-95fd-af7ade235b0a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:35:22.075513 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:22.075513 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:22.075513 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:22.075513 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:22.075513 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:22.075513 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:22.075513 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:22.075513 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:22.075513 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:22.075513 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:22.075513 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:22.075513 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:35:22.075513 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:35:22.075513 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:35:22.075513 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:35:22.076742 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:35:22.076742 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:35:22.076742 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:35:22.076742 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:35:22.076742 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:22.076742 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:22.076742 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:22.076742 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:22.076742 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:22.076742 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:22.076742 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:22.076742 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:22.076742 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:22.076742 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:22.076742 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:22.076742 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:22.077743 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:22.077743 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:22.077743 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:22.077743 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:22.077743 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:35:22.077743 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:35:22.077743 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:35:22.077743 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:35:22.077743 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:35:22.077743 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:35:22.077743 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:35:22.077743 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:22.081854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 273/546] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Sep 8 13:35:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:22.086365 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696313c-0a57-4d5e-852c-ea38292b4971 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:22.237977 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696313c-0a57-4d5e-852c-ea38292b4971 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:22.285650 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca0914-b844-4d54-bf6d-23d74d5a1582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:22.286445 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca0914-b844-4d54-bf6d-23d74d5a1582 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:22.287380 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca0914-b844-4d54-bf6d-23d74d5a1582 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:22.287875 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca0914-b844-4d54-bf6d-23d74d5a1582 None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:22.288584 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ca0914-b844-4d54-bf6d-23d74d5a1582 None admin] RBAC: Adding query filter params (name=service) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:22.288900 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ca0914-b844-4d54-bf6d-23d74d5a1582 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:22.290330 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ca0914-b844-4d54-bf6d-23d74d5a1582 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:22.300645 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 274/547] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Sep 8 13:35:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:22.307963 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91011132-20c1-45a7-95fd-af7ade235b0a None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:22.374586 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:22.434320 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91011132-20c1-45a7-95fd-af7ade235b0a None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:22.442382 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca0914-b844-4d54-bf6d-23d74d5a1582 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:22.478576 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85285626-994d-48fd-a332-c815020b6ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:22.479214 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85285626-994d-48fd-a332-c815020b6ada None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:22.479492 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85285626-994d-48fd-a332-c815020b6ada None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:22.479761 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85285626-994d-48fd-a332-c815020b6ada None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:22.498952 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85285626-994d-48fd-a332-c815020b6ada None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:22.501192 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85285626-994d-48fd-a332-c815020b6ada None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:22.541448 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-85285626-994d-48fd-a332-c815020b6ada None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:22.541448 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:22.541448 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:22.541448 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:22.541448 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:22.541448 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:22.541448 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:22.541448 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:22.541448 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:22.541448 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:22.541448 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:22.541448 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:22.541448 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:22.541448 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:22.541448 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:22.541448 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:22.542444 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:22.542444 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:22.542444 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:22.542444 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:22.542444 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:22.542444 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:22.542444 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:22.542444 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:22.542444 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:22.542444 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:22.542444 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:22.542444 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:22.542444 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:22.542444 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:22.542444 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:22.542444 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:22.542444 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:22.543373 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:22.543373 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:22.543373 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:22.543373 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 274/548] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:22.550850 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85285626-994d-48fd-a332-c815020b6ada None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:22.588281 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:22.694226 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:22.695538 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca0914-b844-4d54-bf6d-23d74d5a1582 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:22.698491 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85285626-994d-48fd-a332-c815020b6ada None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:22.736822 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfcc406-9931-4366-9cc7-a405faa36078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:22.737747 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfcc406-9931-4366-9cc7-a405faa36078 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:22.738189 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfcc406-9931-4366-9cc7-a405faa36078 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:22.738606 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfcc406-9931-4366-9cc7-a405faa36078 None admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:22.739452 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfcc406-9931-4366-9cc7-a405faa36078 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:22.740603 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfcc406-9931-4366-9cc7-a405faa36078 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:22.742371 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfcc406-9931-4366-9cc7-a405faa36078 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:22.756005 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 275/549] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:22.761987 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfcc406-9931-4366-9cc7-a405faa36078 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:22.807975 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7553fb-1954-44a9-94b0-f5d484acd8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:22.808529 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7553fb-1954-44a9-94b0-f5d484acd8f6 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:22.808808 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7553fb-1954-44a9-94b0-f5d484acd8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:22.809077 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7553fb-1954-44a9-94b0-f5d484acd8f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:22.842393 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7553fb-1954-44a9-94b0-f5d484acd8f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:35:22.848091 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-6a7553fb-1954-44a9-94b0-f5d484acd8f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:35:22.848091 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:22.848091 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:22.848091 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:22.848091 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:22.848091 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:22.848091 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:22.848091 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:22.848091 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:22.848091 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:22.848091 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:22.848091 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:22.848091 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:35:22.848091 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:35:22.848091 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:35:22.848091 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:35:22.849960 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:35:22.849960 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:35:22.849960 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:35:22.849960 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:35:22.849960 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:22.849960 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:22.849960 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:22.849960 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:22.849960 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:22.849960 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:22.849960 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:22.849960 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:22.849960 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:22.849960 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:22.849960 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:22.849960 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:22.850850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:22.850850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:22.850850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:22.850850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:22.850850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:35:22.850850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:35:22.850850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:35:22.850850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:35:22.850850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:35:22.850850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:35:22.850850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:35:22.850850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:22.853092 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 275/550] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Sep 8 13:35:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 411 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:35:22.858483 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7553fb-1954-44a9-94b0-f5d484acd8f6 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:22.880221 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfcc406-9931-4366-9cc7-a405faa36078 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:22.919551 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c41a8-3bc6-4b69-be98-e64391b84223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:22.920550 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c41a8-3bc6-4b69-be98-e64391b84223 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:22.921069 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c41a8-3bc6-4b69-be98-e64391b84223 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:22.921593 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c41a8-3bc6-4b69-be98-e64391b84223 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:22.930832 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c41a8-3bc6-4b69-be98-e64391b84223 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:22.932686 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c41a8-3bc6-4b69-be98-e64391b84223 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:22.948382 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-6b1c41a8-3bc6-4b69-be98-e64391b84223 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 08 13:35:22.948382 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:22.948382 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:22.948382 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:22.948382 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:22.948382 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:22.948382 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:22.948382 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:22.948382 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:22.948382 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:22.948382 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:22.948382 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:22.948382 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:35:22.948382 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:35:22.948382 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:35:22.948382 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:35:22.949573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:22.949573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:22.949573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:35:22.949573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:35:22.949573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:35:22.949573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:35:22.949573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:22.949573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:22.949573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:22.949573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:22.949573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:22.949573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:22.949573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:22.949573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:22.949573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:22.949573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:22.949573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:22.949573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:22.950507 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:22.950507 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:22.950507 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:35:22.950507 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:35:22.950507 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:35:22.950507 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:35:22.950507 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:35:22.950507 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:35:22.950507 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 08 13:35:22.950507 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:22.953106 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 276/551] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 8 13:35:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:35:22.963520 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c41a8-3bc6-4b69-be98-e64391b84223 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:22.995785 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:23.095577 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c41a8-3bc6-4b69-be98-e64391b84223 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:23.100416 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7553fb-1954-44a9-94b0-f5d484acd8f6 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:23.136471 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec3fb0-323d-467f-8542-a78cf2061105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:23.137532 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec3fb0-323d-467f-8542-a78cf2061105 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:23.138033 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec3fb0-323d-467f-8542-a78cf2061105 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:23.138537 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec3fb0-323d-467f-8542-a78cf2061105 None admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:23.139473 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec3fb0-323d-467f-8542-a78cf2061105 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:23.139998 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec3fb0-323d-467f-8542-a78cf2061105 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:23.141957 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec3fb0-323d-467f-8542-a78cf2061105 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:23.148207 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:23.168388 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 277/552] 10.222.0.69 () {56 vars in 1135 bytes} [Thu Sep 8 13:35:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:23.174565 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec3fb0-323d-467f-8542-a78cf2061105 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:23.190239 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205564e-b9d8-447f-9966-bf74f3a11b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:23.190759 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205564e-b9d8-447f-9966-bf74f3a11b83 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:23.191039 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205564e-b9d8-447f-9966-bf74f3a11b83 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:23.191314 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205564e-b9d8-447f-9966-bf74f3a11b83 None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:23.191998 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2205564e-b9d8-447f-9966-bf74f3a11b83 None admin] RBAC: Adding query filter params (name=service) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:23.192293 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2205564e-b9d8-447f-9966-bf74f3a11b83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:23.194045 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2205564e-b9d8-447f-9966-bf74f3a11b83 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:23.211527 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 276/553] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Sep 8 13:35:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:23.217262 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205564e-b9d8-447f-9966-bf74f3a11b83 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:23.275496 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:23.303228 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec3fb0-323d-467f-8542-a78cf2061105 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:23.342927 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa48874-7bae-48d2-8958-a031091e32af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:23.343970 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa48874-7bae-48d2-8958-a031091e32af None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:23.344456 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa48874-7bae-48d2-8958-a031091e32af None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:23.345114 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa48874-7bae-48d2-8958-a031091e32af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:23.428150 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa48874-7bae-48d2-8958-a031091e32af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:23.430515 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa48874-7bae-48d2-8958-a031091e32af None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:23.492938 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205564e-b9d8-447f-9966-bf74f3a11b83 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:23.531871 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:23.564849 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 278/554] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:35:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:35:23.572128 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa48874-7bae-48d2-8958-a031091e32af None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:23.594440 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fcb7d-5c43-4245-9612-69e57903b78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:23.595262 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fcb7d-5c43-4245-9612-69e57903b78c None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:23.595692 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fcb7d-5c43-4245-9612-69e57903b78c None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:23.596146 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fcb7d-5c43-4245-9612-69e57903b78c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:23.615457 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026fcb7d-5c43-4245-9612-69e57903b78c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:23.617711 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026fcb7d-5c43-4245-9612-69e57903b78c None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:23.663425 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-026fcb7d-5c43-4245-9612-69e57903b78c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:23.663425 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:23.663425 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:23.663425 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:23.663425 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:23.663425 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:23.663425 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:23.663425 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:23.663425 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:23.663425 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:23.663425 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:23.663425 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:23.663425 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:23.663425 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:23.663425 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:23.663425 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:23.664423 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:23.664423 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:23.664423 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:23.664423 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:23.664423 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:23.664423 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:23.664423 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:23.664423 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:23.664423 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:23.664423 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:23.664423 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:23.664423 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:23.664423 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:23.664423 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:23.664423 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:23.664423 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:23.664423 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:23.665303 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:23.665303 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:23.665303 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:23.665303 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 277/555] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 448 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:35:23.669948 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fcb7d-5c43-4245-9612-69e57903b78c None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:23.723993 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa48874-7bae-48d2-8958-a031091e32af None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:23.742085 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:23.797157 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2028a1d-d582-46f7-b9de-aaca31a72025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:23.798334 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2028a1d-d582-46f7-b9de-aaca31a72025 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:23.798820 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2028a1d-d582-46f7-b9de-aaca31a72025 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:23.799305 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2028a1d-d582-46f7-b9de-aaca31a72025 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:23.817678 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2028a1d-d582-46f7-b9de-aaca31a72025 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:23.821025 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2028a1d-d582-46f7-b9de-aaca31a72025 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:23.822270 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fcb7d-5c43-4245-9612-69e57903b78c None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:23.847875 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-e2028a1d-d582-46f7-b9de-aaca31a72025 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:23.847875 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:23.847875 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:23.847875 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:23.847875 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:23.847875 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:23.847875 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:23.847875 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:23.847875 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:23.847875 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:23.847875 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:23.847875 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:23.847875 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:23.847875 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:23.847875 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:23.847875 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:23.849854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:23.849854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:23.849854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:23.849854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:23.849854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:23.849854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:23.849854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:23.849854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:23.849854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:23.849854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:23.849854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:23.849854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:23.849854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:23.849854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:23.849854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:23.849854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:23.849854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:23.850908 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:23.850908 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:23.850908 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:23.850908 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 279/556] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:35:23.852732 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede632b-8bde-4efd-a14c-0816b5c86d6b None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:23.853217 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede632b-8bde-4efd-a14c-0816b5c86d6b None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:23.853726 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede632b-8bde-4efd-a14c-0816b5c86d6b None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:23.856210 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 280/557] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:35:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:35:23.858251 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a15b3e-6a46-428f-9e49-4e425873f722 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:23.858746 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a15b3e-6a46-428f-9e49-4e425873f722 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:23.859211 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a15b3e-6a46-428f-9e49-4e425873f722 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:23.865409 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 281/558] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:35:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:35:23.865409 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a15b3e-6a46-428f-9e49-4e425873f722 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:23.874476 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d871a-c0aa-44eb-84d3-2f34b0b30dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:23.875327 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d871a-c0aa-44eb-84d3-2f34b0b30dcb None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:23.875765 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d871a-c0aa-44eb-84d3-2f34b0b30dcb None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:23.876179 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d871a-c0aa-44eb-84d3-2f34b0b30dcb None admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:23.876960 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004d871a-c0aa-44eb-84d3-2f34b0b30dcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:23.877434 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004d871a-c0aa-44eb-84d3-2f34b0b30dcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:23.879483 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004d871a-c0aa-44eb-84d3-2f34b0b30dcb None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:23.898968 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 278/559] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:35:23.899726 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84e2e6-5f7e-41ff-ba46-a28fa75b00dd None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:23.900012 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84e2e6-5f7e-41ff-ba46-a28fa75b00dd None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:23.900342 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84e2e6-5f7e-41ff-ba46-a28fa75b00dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:23.911503 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:23.925061 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-7d84e2e6-5f7e-41ff-ba46-a28fa75b00dd None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:35:23.927750 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-7d84e2e6-5f7e-41ff-ba46-a28fa75b00dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:35:23.998343 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a15b3e-6a46-428f-9e49-4e425873f722 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:24.020019 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 279/560] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:35:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:35:24.021662 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf51bac-55e9-4dae-881b-07ec314ddfbb None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:24.022610 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf51bac-55e9-4dae-881b-07ec314ddfbb None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:24.023213 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf51bac-55e9-4dae-881b-07ec314ddfbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:24.043498 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-abf51bac-55e9-4dae-881b-07ec314ddfbb None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:35:24.044970 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ae6eb-470c-44b9-8d6d-da9de4d23bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:24.045566 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-abf51bac-55e9-4dae-881b-07ec314ddfbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:35:24.045718 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ae6eb-470c-44b9-8d6d-da9de4d23bd1 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:24.046057 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ae6eb-470c-44b9-8d6d-da9de4d23bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:24.046578 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ae6eb-470c-44b9-8d6d-da9de4d23bd1 None admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:24.047242 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6ae6eb-470c-44b9-8d6d-da9de4d23bd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:24.047600 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6ae6eb-470c-44b9-8d6d-da9de4d23bd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:24.049104 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6ae6eb-470c-44b9-8d6d-da9de4d23bd1 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:24.067361 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 282/561] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:24.067361 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ae6eb-470c-44b9-8d6d-da9de4d23bd1 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:24.078312 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:24.141299 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 280/562] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:35:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:35:24.142372 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf51bac-55e9-4dae-881b-07ec314ddfbb None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:24.183921 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:24.196513 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ae6eb-470c-44b9-8d6d-da9de4d23bd1 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:24.234610 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b41835-302d-4409-99e4-565bacef2afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:24.235606 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b41835-302d-4409-99e4-565bacef2afb None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:24.236109 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b41835-302d-4409-99e4-565bacef2afb None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:24.236596 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b41835-302d-4409-99e4-565bacef2afb None admin] PATH_INFO: `/v3/users/nova` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:24.245826 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b41835-302d-4409-99e4-565bacef2afb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:24.247786 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b41835-302d-4409-99e4-565bacef2afb None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:24.260886 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-27b41835-302d-4409-99e4-565bacef2afb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:35:24.260886 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:24.260886 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:24.260886 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:24.260886 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:24.260886 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:24.260886 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:24.260886 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:24.260886 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:24.260886 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:24.260886 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:24.260886 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:24.260886 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:35:24.260886 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:35:24.260886 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:35:24.260886 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:35:24.261919 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:24.261919 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:24.261919 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:35:24.261919 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:35:24.261919 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:35:24.261919 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:35:24.261919 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:24.261919 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:24.261919 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:24.261919 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:24.261919 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:24.261919 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:24.261919 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:24.261919 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:24.261919 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:24.261919 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:24.261919 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:24.261919 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:24.262983 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:24.262983 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:24.262983 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:35:24.262983 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:35:24.262983 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:35:24.262983 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:35:24.262983 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:35:24.262983 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:35:24.262983 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:35:24.262983 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:24.265662 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 283/563] 10.222.0.69 () {56 vars in 1093 bytes} [Thu Sep 8 13:35:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:24.269667 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf51bac-55e9-4dae-881b-07ec314ddfbb None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:24.271944 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b41835-302d-4409-99e4-565bacef2afb None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:24.318324 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf2ed6-8e74-4b11-b534-2f1d65a072b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:24.319014 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf2ed6-8e74-4b11-b534-2f1d65a072b8 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:24.319288 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf2ed6-8e74-4b11-b534-2f1d65a072b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:24.319555 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf2ed6-8e74-4b11-b534-2f1d65a072b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:24.327222 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbf2ed6-8e74-4b11-b534-2f1d65a072b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:24.329609 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbf2ed6-8e74-4b11-b534-2f1d65a072b8 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:24.342923 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-abbf2ed6-8e74-4b11-b534-2f1d65a072b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:35:24.342923 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:24.342923 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:24.342923 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:24.342923 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:24.342923 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:24.342923 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:24.342923 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:24.342923 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:24.342923 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:24.342923 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:24.342923 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:24.342923 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:35:24.342923 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:35:24.342923 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:35:24.343871 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:35:24.343871 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:24.343871 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:24.343871 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:24.343871 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:24.343871 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:24.343871 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:24.343871 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:24.343871 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:24.343871 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:24.343871 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:24.343871 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:24.343871 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:24.343871 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:24.343871 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:24.343871 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:24.343871 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:24.344763 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:35:24.344763 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:35:24.344763 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:35:24.344763 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:35:24.344763 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:35:24.344763 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:35:24.344763 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:35:24.344763 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:24.349597 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 281/564] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:35:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:24.351535 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf2ed6-8e74-4b11-b534-2f1d65a072b8 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:24.374961 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:24.411472 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b41835-302d-4409-99e4-565bacef2afb None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:24.476394 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e3c7f6-6c09-4727-b372-1234a7309765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:24.477009 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3c7f6-6c09-4727-b372-1234a7309765 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:24.477293 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3c7f6-6c09-4727-b372-1234a7309765 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:24.477597 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e3c7f6-6c09-4727-b372-1234a7309765 None admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:24.477841 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf2ed6-8e74-4b11-b534-2f1d65a072b8 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:24.478338 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e3c7f6-6c09-4727-b372-1234a7309765 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:24.478645 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e3c7f6-6c09-4727-b372-1234a7309765 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:24.480284 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e3c7f6-6c09-4727-b372-1234a7309765 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:24.503278 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 284/565] 10.222.0.69 () {56 vars in 1133 bytes} [Thu Sep 8 13:35:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:35:24.504342 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e3c7f6-6c09-4727-b372-1234a7309765 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:24.519151 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3b869-64a5-40b0-9994-ec42a69a09a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:24.519362 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:24.519686 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3b869-64a5-40b0-9994-ec42a69a09a7 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:24.519969 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3b869-64a5-40b0-9994-ec42a69a09a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:24.520698 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec3b869-64a5-40b0-9994-ec42a69a09a7 None admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:24.521632 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec3b869-64a5-40b0-9994-ec42a69a09a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:24.522548 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec3b869-64a5-40b0-9994-ec42a69a09a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:24.524359 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec3b869-64a5-40b0-9994-ec42a69a09a7 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:24.546159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 282/566] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 8 13:35:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:24.551768 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3b869-64a5-40b0-9994-ec42a69a09a7 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:24.636557 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e3c7f6-6c09-4727-b372-1234a7309765 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:24.644454 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:24.672091 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec3b869-64a5-40b0-9994-ec42a69a09a7 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:24.675273 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130f4e6-df7e-49ba-844d-b970a89baad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:24.675473 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130f4e6-df7e-49ba-844d-b970a89baad6 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:24.675721 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130f4e6-df7e-49ba-844d-b970a89baad6 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:24.675987 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130f4e6-df7e-49ba-844d-b970a89baad6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:24.687632 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130f4e6-df7e-49ba-844d-b970a89baad6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:35:24.692593 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-f130f4e6-df7e-49ba-844d-b970a89baad6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:35:24.692593 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:24.692593 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:24.692593 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:24.692593 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:24.692593 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:24.692593 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:24.692593 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:24.692593 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:24.692593 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:24.692593 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:24.692593 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:24.692593 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:35:24.692593 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:35:24.692593 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:35:24.692593 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:35:24.694291 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:35:24.694291 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:35:24.694291 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:35:24.694291 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:35:24.694291 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:24.694291 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:24.694291 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:24.694291 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:24.694291 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:24.694291 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:24.694291 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:24.694291 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:24.694291 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:24.694291 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:24.694291 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:24.694291 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:24.695354 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:24.695354 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:24.695354 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:24.695354 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:24.695354 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:35:24.695354 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:35:24.695354 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:35:24.695354 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:35:24.695354 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:35:24.695354 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:35:24.695354 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:35:24.695354 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:24.695354 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 285/567] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Sep 8 13:35:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:24.695354 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130f4e6-df7e-49ba-844d-b970a89baad6 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:24.712922 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fcf0cf-913b-4580-af49-59906aa75941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:24.713596 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcf0cf-913b-4580-af49-59906aa75941 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:24.713879 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcf0cf-913b-4580-af49-59906aa75941 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:24.714171 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fcf0cf-913b-4580-af49-59906aa75941 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:24.724579 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fcf0cf-913b-4580-af49-59906aa75941 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:24.726154 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fcf0cf-913b-4580-af49-59906aa75941 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:24.743383 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-87fcf0cf-913b-4580-af49-59906aa75941 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:24.743383 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:24.743383 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:24.743383 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:24.743383 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:24.743383 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:24.743383 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:24.743383 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:24.743383 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:24.743383 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:24.743383 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:24.743383 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:24.743383 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:24.743383 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:24.743383 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:24.743383 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:24.749003 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:24.749003 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:24.749003 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:24.749003 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:24.749003 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:24.749003 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:24.749003 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:24.749003 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:24.749003 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:24.749003 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:24.749003 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:24.749003 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:24.749003 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:24.749003 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:24.749003 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:24.749003 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:24.749003 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:24.750222 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:24.750222 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:24.750222 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:24.750222 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 283/568] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:24.750222 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fcf0cf-913b-4580-af49-59906aa75941 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:24.772849 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:24.809549 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130f4e6-df7e-49ba-844d-b970a89baad6 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:24.846522 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc97466-ca4e-442e-a846-e088f7c939cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:24.847159 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc97466-ca4e-442e-a846-e088f7c939cc None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:24.847437 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc97466-ca4e-442e-a846-e088f7c939cc None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:24.847709 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc97466-ca4e-442e-a846-e088f7c939cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:24.856274 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fcf0cf-913b-4580-af49-59906aa75941 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:24.859354 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc97466-ca4e-442e-a846-e088f7c939cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:35:24.864161 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-5dc97466-ca4e-442e-a846-e088f7c939cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:35:24.864161 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:24.864161 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:24.864161 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:24.864161 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:24.864161 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:24.864161 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:24.864161 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:24.864161 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:24.864161 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:24.864161 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:24.864161 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:24.864161 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:35:24.864161 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:35:24.864161 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:35:24.864161 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:35:24.865899 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:35:24.865899 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:35:24.865899 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:35:24.865899 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:35:24.865899 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:24.865899 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:24.865899 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:24.865899 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:24.865899 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:24.865899 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:24.865899 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:24.865899 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:24.865899 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:24.865899 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:24.865899 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:24.865899 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:24.866780 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:24.866780 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:24.866780 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:24.866780 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:24.866780 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:35:24.866780 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:35:24.866780 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:35:24.866780 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:35:24.866780 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:35:24.866780 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:35:24.866780 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:35:24.866780 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:24.866780 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 286/569] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Sep 8 13:35:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:24.867628 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042e7b9-ceb4-4915-92de-7c007fbbf9ed None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:24.867818 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042e7b9-ceb4-4915-92de-7c007fbbf9ed None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:24.868095 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042e7b9-ceb4-4915-92de-7c007fbbf9ed None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:24.869475 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 287/570] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:35:24.870173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d042e7b9-ceb4-4915-92de-7c007fbbf9ed None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:24.887849 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:24.898094 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0231ed2-4e01-42fd-b7d2-0fa601aee73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:24.898700 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0231ed2-4e01-42fd-b7d2-0fa601aee73f None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:24.898976 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0231ed2-4e01-42fd-b7d2-0fa601aee73f None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:24.899251 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0231ed2-4e01-42fd-b7d2-0fa601aee73f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:24.899979 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0231ed2-4e01-42fd-b7d2-0fa601aee73f None admin] RBAC: Adding query filter params (role.id=e5f27e532c9d4bc7a57e31856ecee597, scope.project.id=88de9f1470c6415b97866ad5a3256ef2, user.id=fa9b97592a6840c3865d7dcf886221e0) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:24.900287 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0231ed2-4e01-42fd-b7d2-0fa601aee73f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:24.901758 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0231ed2-4e01-42fd-b7d2-0fa601aee73f None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:24.907544 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 284/571] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 8 13:35:24 2022] GET /identity/v3/role_assignments?user.id=fa9b97592a6840c3865d7dcf886221e0&scope.project.id=88de9f1470c6415b97866ad5a3256ef2&role.id=e5f27e532c9d4bc7a57e31856ecee597 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:24.908337 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0231ed2-4e01-42fd-b7d2-0fa601aee73f None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:24.984961 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d042e7b9-ceb4-4915-92de-7c007fbbf9ed None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:25.021715 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:25.030740 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ecc77-cd13-403e-aac1-27fe20749dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:25.031273 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ecc77-cd13-403e-aac1-27fe20749dc4 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:25.031409 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0231ed2-4e01-42fd-b7d2-0fa601aee73f None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:25.031592 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ecc77-cd13-403e-aac1-27fe20749dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:25.031818 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ecc77-cd13-403e-aac1-27fe20749dc4 None admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:25.032497 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ecc77-cd13-403e-aac1-27fe20749dc4 None admin] RBAC: Adding query filter params (name=service) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:25.032983 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ecc77-cd13-403e-aac1-27fe20749dc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:25.035409 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ecc77-cd13-403e-aac1-27fe20749dc4 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:25.048934 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 288/572] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Sep 8 13:35:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:25.050272 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd3cf6d-860a-4eaa-b0a8-f89ed051c5b9 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:25.050560 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd3cf6d-860a-4eaa-b0a8-f89ed051c5b9 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:25.050836 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd3cf6d-860a-4eaa-b0a8-f89ed051c5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:25.071102 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-8cd3cf6d-860a-4eaa-b0a8-f89ed051c5b9 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:35:25.072334 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-8cd3cf6d-860a-4eaa-b0a8-f89ed051c5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:35:25.076123 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbeca69-2b30-4ac8-81c3-678d763c88b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:25.076862 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbeca69-2b30-4ac8-81c3-678d763c88b8 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:25.077146 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbeca69-2b30-4ac8-81c3-678d763c88b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:25.077468 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbeca69-2b30-4ac8-81c3-678d763c88b8 None admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:25.078133 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbeca69-2b30-4ac8-81c3-678d763c88b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:25.078441 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbeca69-2b30-4ac8-81c3-678d763c88b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:25.079827 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbeca69-2b30-4ac8-81c3-678d763c88b8 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:25.094727 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 285/573] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:25.095255 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbeca69-2b30-4ac8-81c3-678d763c88b8 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:25.156826 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:25.159001 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 289/574] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:35:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:35:25.159871 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd3cf6d-860a-4eaa-b0a8-f89ed051c5b9 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:25.228410 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbeca69-2b30-4ac8-81c3-678d763c88b8 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:25.274731 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01d0a5-2dd3-4e08-831f-a0a0d3f78e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:25.275681 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01d0a5-2dd3-4e08-831f-a0a0d3f78e43 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:25.275978 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01d0a5-2dd3-4e08-831f-a0a0d3f78e43 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:25.276256 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01d0a5-2dd3-4e08-831f-a0a0d3f78e43 None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:25.277031 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01d0a5-2dd3-4e08-831f-a0a0d3f78e43 None admin] RBAC: Adding query filter params (name=service) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:25.277344 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01d0a5-2dd3-4e08-831f-a0a0d3f78e43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:25.278940 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01d0a5-2dd3-4e08-831f-a0a0d3f78e43 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:25.289704 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 286/575] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Sep 8 13:35:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:25.290757 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01d0a5-2dd3-4e08-831f-a0a0d3f78e43 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:25.299455 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd3cf6d-860a-4eaa-b0a8-f89ed051c5b9 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:25.326759 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:25.347220 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7da2cf-802b-42a8-b13c-b3794ed54e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:25.348450 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7da2cf-802b-42a8-b13c-b3794ed54e61 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:25.350170 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7da2cf-802b-42a8-b13c-b3794ed54e61 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:25.350448 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7da2cf-802b-42a8-b13c-b3794ed54e61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:25.367689 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7da2cf-802b-42a8-b13c-b3794ed54e61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:25.369149 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7da2cf-802b-42a8-b13c-b3794ed54e61 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:25.390560 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-da7da2cf-802b-42a8-b13c-b3794ed54e61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:25.390560 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:25.390560 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:25.390560 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:25.390560 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:25.390560 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:25.390560 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:25.390560 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:25.390560 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:25.390560 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:25.390560 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:25.390560 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:25.390560 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:25.390560 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:25.390560 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:25.390560 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:25.391587 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:25.391587 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:25.391587 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:25.391587 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:25.391587 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:25.391587 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:25.391587 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:25.391587 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:25.391587 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:25.391587 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:25.391587 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:25.391587 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:25.391587 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:25.391587 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:25.391587 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:25.391587 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:25.391587 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:25.392531 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:25.392531 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:25.392531 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:25.394675 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 290/576] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:25.395865 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7da2cf-802b-42a8-b13c-b3794ed54e61 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:25.426690 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01d0a5-2dd3-4e08-831f-a0a0d3f78e43 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:25.448276 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:25.475816 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730138e3-9f1f-4e28-aa16-3bb2a93e4b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:25.476466 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730138e3-9f1f-4e28-aa16-3bb2a93e4b37 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:25.476754 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730138e3-9f1f-4e28-aa16-3bb2a93e4b37 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:25.477028 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730138e3-9f1f-4e28-aa16-3bb2a93e4b37 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:25.484372 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730138e3-9f1f-4e28-aa16-3bb2a93e4b37 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:25.486538 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730138e3-9f1f-4e28-aa16-3bb2a93e4b37 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:25.498572 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-730138e3-9f1f-4e28-aa16-3bb2a93e4b37 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:35:25.498572 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:25.498572 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:25.498572 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:25.498572 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:25.498572 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:25.498572 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:25.498572 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:25.498572 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:25.498572 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:25.498572 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:25.498572 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:25.498572 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:35:25.498572 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:35:25.498572 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:35:25.499679 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:35:25.499679 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:25.499679 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:25.499679 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:25.499679 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:25.499679 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:25.499679 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:25.499679 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:25.499679 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:25.499679 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:25.499679 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:25.499679 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:25.499679 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:25.499679 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:25.499679 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:25.499679 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:25.499679 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:25.500852 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:35:25.500852 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:35:25.500852 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:35:25.500852 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:35:25.500852 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:35:25.500852 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:35:25.500852 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:35:25.500852 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:25.504388 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 287/577] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:35:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:25.505123 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730138e3-9f1f-4e28-aa16-3bb2a93e4b37 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:25.522714 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7da2cf-802b-42a8-b13c-b3794ed54e61 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:25.567052 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f6f1e-3035-4464-8649-ffc83786e0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:25.568734 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f6f1e-3035-4464-8649-ffc83786e0ce None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:25.569221 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f6f1e-3035-4464-8649-ffc83786e0ce None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:25.570222 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f6f1e-3035-4464-8649-ffc83786e0ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:25.588444 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f6f1e-3035-4464-8649-ffc83786e0ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:25.589966 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f6f1e-3035-4464-8649-ffc83786e0ce None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:25.606132 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-fa7f6f1e-3035-4464-8649-ffc83786e0ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:25.606132 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:25.606132 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:25.606132 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:25.606132 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:25.606132 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:25.606132 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:25.606132 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:25.606132 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:25.606132 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:25.606132 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:25.606132 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:25.606132 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:25.606132 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:25.606132 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:25.606132 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:25.607302 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:25.607302 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:25.607302 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:25.607302 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:25.607302 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:25.607302 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:25.607302 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:25.607302 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:25.607302 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:25.607302 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:25.607302 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:25.607302 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:25.607302 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:25.607302 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:25.607302 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:25.607302 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:25.607302 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:25.608395 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:25.608395 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:25.608395 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:25.611949 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 291/578] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:25.612624 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f6f1e-3035-4464-8649-ffc83786e0ce None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:25.627125 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730138e3-9f1f-4e28-aa16-3bb2a93e4b37 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:25.643343 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:25.666773 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f2401-f1c8-4475-b541-94636424fe8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:25.667386 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f2401-f1c8-4475-b541-94636424fe8c None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:25.667664 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f2401-f1c8-4475-b541-94636424fe8c None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:25.667931 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f2401-f1c8-4475-b541-94636424fe8c None admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:25.668589 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f2401-f1c8-4475-b541-94636424fe8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:25.668890 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f2401-f1c8-4475-b541-94636424fe8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:25.670575 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f2401-f1c8-4475-b541-94636424fe8c None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:25.684111 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 288/579] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:25.684958 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f2401-f1c8-4475-b541-94636424fe8c None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:25.726110 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:25.737417 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f6f1e-3035-4464-8649-ffc83786e0ce None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:25.779929 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed8718-3a05-4297-a89b-96c33cbae05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:25.780560 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed8718-3a05-4297-a89b-96c33cbae05b None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:25.780839 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed8718-3a05-4297-a89b-96c33cbae05b None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:25.781117 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed8718-3a05-4297-a89b-96c33cbae05b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:25.792917 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed8718-3a05-4297-a89b-96c33cbae05b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:35:25.798189 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-a5ed8718-3a05-4297-a89b-96c33cbae05b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:35:25.798189 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:25.798189 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:25.798189 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:25.798189 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:25.798189 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:25.798189 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:25.798189 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:25.798189 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:25.798189 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:25.798189 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:25.798189 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:25.798189 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:35:25.798189 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:35:25.798189 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:35:25.798189 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:35:25.799173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:35:25.799173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:35:25.799173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:35:25.799173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:35:25.799173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:25.799173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:25.799173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:25.799173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:25.799173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:25.799173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:25.799173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:25.799173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:25.799173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:25.799173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:25.799173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:25.799173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:25.800022 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:25.800022 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:25.800022 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:25.800022 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:25.800022 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:35:25.800022 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:35:25.800022 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:35:25.800022 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:35:25.800022 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:35:25.800022 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:35:25.800022 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:35:25.800022 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:25.800022 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 292/580] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Sep 8 13:35:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:25.800850 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed8718-3a05-4297-a89b-96c33cbae05b None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:25.808698 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f2401-f1c8-4475-b541-94636424fe8c None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:25.853963 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc3b08-cbbf-46e0-a302-e9d71d67ee06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:25.854488 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc3b08-cbbf-46e0-a302-e9d71d67ee06 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:25.854767 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc3b08-cbbf-46e0-a302-e9d71d67ee06 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:25.855034 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc3b08-cbbf-46e0-a302-e9d71d67ee06 None admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:25.855736 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc3b08-cbbf-46e0-a302-e9d71d67ee06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:25.856040 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc3b08-cbbf-46e0-a302-e9d71d67ee06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:25.857796 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc3b08-cbbf-46e0-a302-e9d71d67ee06 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:25.870315 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 289/581] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 8 13:35:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:25.871167 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc3b08-cbbf-46e0-a302-e9d71d67ee06 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:25.907442 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:25.928039 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed8718-3a05-4297-a89b-96c33cbae05b None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:25.965547 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a3d0ab-5084-425f-836a-3c39190a4582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:25.966321 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3d0ab-5084-425f-836a-3c39190a4582 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:25.966679 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3d0ab-5084-425f-836a-3c39190a4582 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:25.966958 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3d0ab-5084-425f-836a-3c39190a4582 None admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:25.967605 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a3d0ab-5084-425f-836a-3c39190a4582 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:25.967911 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a3d0ab-5084-425f-836a-3c39190a4582 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:25.969294 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a3d0ab-5084-425f-836a-3c39190a4582 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:25.981995 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 293/582] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:25.982820 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a3d0ab-5084-425f-836a-3c39190a4582 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:25.991868 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:26.002214 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc3b08-cbbf-46e0-a302-e9d71d67ee06 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:26.054323 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8809421-5c40-4170-96c2-9fc36d2d31b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:26.054964 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8809421-5c40-4170-96c2-9fc36d2d31b1 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:26.055245 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8809421-5c40-4170-96c2-9fc36d2d31b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:26.055836 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8809421-5c40-4170-96c2-9fc36d2d31b1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:26.065085 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8809421-5c40-4170-96c2-9fc36d2d31b1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:26.067322 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8809421-5c40-4170-96c2-9fc36d2d31b1 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:26.084188 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-f8809421-5c40-4170-96c2-9fc36d2d31b1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 08 13:35:26.084188 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:26.084188 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:26.084188 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:26.084188 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:26.084188 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:26.084188 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:26.084188 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:26.084188 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:26.084188 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:26.084188 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:26.084188 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:26.084188 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:35:26.084188 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:35:26.084188 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:35:26.084188 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:35:26.085273 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:26.085273 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:26.085273 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:35:26.085273 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:35:26.085273 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:35:26.085273 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:35:26.085273 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:26.085273 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:26.085273 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:26.085273 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:26.085273 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:26.085273 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:26.085273 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:26.085273 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:26.085273 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:26.085273 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:26.085273 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:26.085273 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:26.086400 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:26.086400 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:26.086400 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:35:26.086400 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:35:26.086400 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:35:26.086400 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:35:26.086400 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:35:26.086400 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:35:26.086400 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 08 13:35:26.086400 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:26.086400 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 290/583] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:35:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:26.086990 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8809421-5c40-4170-96c2-9fc36d2d31b1 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:26.106227 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a3d0ab-5084-425f-836a-3c39190a4582 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:26.143963 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881c737-fab9-4660-a4e5-3295033def1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:26.144946 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881c737-fab9-4660-a4e5-3295033def1b None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:26.145239 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881c737-fab9-4660-a4e5-3295033def1b None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:26.145550 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881c737-fab9-4660-a4e5-3295033def1b None admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:26.147333 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881c737-fab9-4660-a4e5-3295033def1b None admin] RBAC: Adding query filter params (name=service) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:26.147722 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881c737-fab9-4660-a4e5-3295033def1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:26.149342 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881c737-fab9-4660-a4e5-3295033def1b None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:26.165193 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 294/584] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Sep 8 13:35:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:26.165193 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881c737-fab9-4660-a4e5-3295033def1b None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:26.175347 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:26.211432 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8809421-5c40-4170-96c2-9fc36d2d31b1 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:26.260616 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9db80-fb2d-477b-b7bd-8e48b75e5cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:26.261402 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9db80-fb2d-477b-b7bd-8e48b75e5cb1 None admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:26.261752 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9db80-fb2d-477b-b7bd-8e48b75e5cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:26.262097 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f9db80-fb2d-477b-b7bd-8e48b75e5cb1 None admin] PATH_INFO: `/v3/projects/88de9f1470c6415b97866ad5a3256ef2/users/c95448c1b8b1466cae37fda5c713d53f/roles/e5f27e532c9d4bc7a57e31856ecee597` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:26.283117 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9db80-fb2d-477b-b7bd-8e48b75e5cb1 None admin] RBAC: Authorizing `identity:create_grant(project_id=88de9f1470c6415b97866ad5a3256ef2, user_id=c95448c1b8b1466cae37fda5c713d53f, role_id=e5f27e532c9d4bc7a57e31856ecee597)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:26.285541 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f9db80-fb2d-477b-b7bd-8e48b75e5cb1 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:26.303493 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881c737-fab9-4660-a4e5-3295033def1b None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:26.305151 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 291/585] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Sep 8 13:35:26 2022] PUT /identity/v3/projects/88de9f1470c6415b97866ad5a3256ef2/users/c95448c1b8b1466cae37fda5c713d53f/roles/e5f27e532c9d4bc7a57e31856ecee597 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:35:26.306247 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9db80-fb2d-477b-b7bd-8e48b75e5cb1 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:26.313028 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:26.375297 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f5b53-7fdf-4449-b8a4-c7399663444d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:26.376355 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f5b53-7fdf-4449-b8a4-c7399663444d None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:26.376476 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f5b53-7fdf-4449-b8a4-c7399663444d None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:26.376826 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f5b53-7fdf-4449-b8a4-c7399663444d None admin] PATH_INFO: `/v3/users/glance` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:26.386868 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f5b53-7fdf-4449-b8a4-c7399663444d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:26.388908 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f5b53-7fdf-4449-b8a4-c7399663444d None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:26.404854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-ba1f5b53-7fdf-4449-b8a4-c7399663444d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 08 13:35:26.404854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:26.404854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:26.404854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:26.404854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:26.404854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:26.404854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:26.404854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:26.404854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:26.404854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:26.404854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:26.404854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:26.404854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:35:26.404854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:35:26.404854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:35:26.404854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:35:26.406149 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:26.406149 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:26.406149 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:35:26.406149 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:35:26.406149 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:35:26.406149 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:35:26.406149 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:26.406149 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:26.406149 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:26.406149 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:26.406149 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:26.406149 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:26.406149 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:26.406149 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:26.406149 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:26.406149 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:26.406149 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:26.406149 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:26.407321 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:26.407321 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:26.407321 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:35:26.407321 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:35:26.407321 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:35:26.407321 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:35:26.407321 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:35:26.407321 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:35:26.407321 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 08 13:35:26.407321 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:26.414030 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 295/586] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:35:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:26.414030 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f5b53-7fdf-4449-b8a4-c7399663444d None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:26.478434 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f9db80-fb2d-477b-b7bd-8e48b75e5cb1 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:26.524925 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:26.541639 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c01428-d288-461c-9b3f-e080bca28d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:26.542121 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c01428-d288-461c-9b3f-e080bca28d48 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:26.542480 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c01428-d288-461c-9b3f-e080bca28d48 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:26.542830 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c01428-d288-461c-9b3f-e080bca28d48 None admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:26.543678 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c01428-d288-461c-9b3f-e080bca28d48 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:26.544064 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c01428-d288-461c-9b3f-e080bca28d48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:26.546103 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c01428-d288-461c-9b3f-e080bca28d48 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:26.576015 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f5b53-7fdf-4449-b8a4-c7399663444d None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:26.596227 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 292/587] 10.222.0.69 () {56 vars in 1137 bytes} [Thu Sep 8 13:35:26 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:26.597108 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c01428-d288-461c-9b3f-e080bca28d48 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:26.623753 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257d445-cfd6-48c8-af8a-03713833c087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:26.624508 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257d445-cfd6-48c8-af8a-03713833c087 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:26.624939 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257d445-cfd6-48c8-af8a-03713833c087 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:26.625233 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257d445-cfd6-48c8-af8a-03713833c087 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:26.638556 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257d445-cfd6-48c8-af8a-03713833c087 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:26.639935 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257d445-cfd6-48c8-af8a-03713833c087 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:26.665940 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-2257d445-cfd6-48c8-af8a-03713833c087 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:26.665940 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:26.665940 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:26.665940 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:26.665940 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:26.665940 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:26.665940 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:26.665940 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:26.665940 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:26.665940 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:26.665940 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:26.665940 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:26.665940 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:26.665940 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:26.665940 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:26.665940 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:26.667199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:26.667199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:26.667199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:26.667199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:26.667199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:26.667199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:26.667199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:26.667199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:26.667199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:26.667199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:26.667199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:26.667199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:26.667199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:26.667199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:26.667199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:26.667199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:26.667199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:26.668356 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:26.668356 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:26.668356 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:26.670316 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 296/588] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:26.670316 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257d445-cfd6-48c8-af8a-03713833c087 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:26.685881 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:26.734170 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c01428-d288-461c-9b3f-e080bca28d48 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:26.774014 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d01cd5c-5608-4c79-a3da-e3cb9bc66a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:26.774792 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01cd5c-5608-4c79-a3da-e3cb9bc66a2b None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:26.775164 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01cd5c-5608-4c79-a3da-e3cb9bc66a2b None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:26.775593 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01cd5c-5608-4c79-a3da-e3cb9bc66a2b None admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:26.776438 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d01cd5c-5608-4c79-a3da-e3cb9bc66a2b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:26.776837 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d01cd5c-5608-4c79-a3da-e3cb9bc66a2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:26.778603 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d01cd5c-5608-4c79-a3da-e3cb9bc66a2b None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:26.803482 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 293/589] 10.222.0.69 () {56 vars in 1137 bytes} [Thu Sep 8 13:35:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:26.804603 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d01cd5c-5608-4c79-a3da-e3cb9bc66a2b None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:26.821393 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257d445-cfd6-48c8-af8a-03713833c087 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:26.843781 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:26.872003 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe0c1a-b240-4130-a932-b26ebe0e6cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:26.872767 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe0c1a-b240-4130-a932-b26ebe0e6cc5 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:26.872927 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe0c1a-b240-4130-a932-b26ebe0e6cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:26.873176 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe0c1a-b240-4130-a932-b26ebe0e6cc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:26.885616 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebe0c1a-b240-4130-a932-b26ebe0e6cc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:26.887798 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebe0c1a-b240-4130-a932-b26ebe0e6cc5 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:26.904136 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-eebe0c1a-b240-4130-a932-b26ebe0e6cc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:26.904136 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:26.904136 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:26.904136 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:26.904136 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:26.904136 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:26.904136 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:26.904136 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:26.904136 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:26.904136 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:26.904136 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:26.904136 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:26.904136 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:26.904136 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:26.904136 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:26.904136 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:26.905123 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:26.905123 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:26.905123 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:26.905123 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:26.905123 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:26.905123 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:26.905123 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:26.905123 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:26.905123 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:26.905123 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:26.905123 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:26.905123 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:26.905123 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:26.905123 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:26.905123 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:26.905123 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:26.905123 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:26.906040 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:26.906040 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:26.906040 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:26.908226 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 297/590] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:26.909233 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe0c1a-b240-4130-a932-b26ebe0e6cc5 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:26.941833 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d01cd5c-5608-4c79-a3da-e3cb9bc66a2b None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:26.968511 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:26.985916 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309724d-d032-4ed7-a0ab-2e48453b6d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:26.986523 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309724d-d032-4ed7-a0ab-2e48453b6d2e None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:26.986802 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309724d-d032-4ed7-a0ab-2e48453b6d2e None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:26.987077 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d309724d-d032-4ed7-a0ab-2e48453b6d2e None admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:26.987908 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d309724d-d032-4ed7-a0ab-2e48453b6d2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:26.988214 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d309724d-d032-4ed7-a0ab-2e48453b6d2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:26.990927 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d309724d-d032-4ed7-a0ab-2e48453b6d2e None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:27.011568 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 294/591] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:27.011568 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309724d-d032-4ed7-a0ab-2e48453b6d2e None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:27.071663 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebe0c1a-b240-4130-a932-b26ebe0e6cc5 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:27.122988 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1da43-b100-4ac9-98ab-7be643b09d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:27.123850 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1da43-b100-4ac9-98ab-7be643b09d2b None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:27.124233 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1da43-b100-4ac9-98ab-7be643b09d2b None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:27.124612 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1da43-b100-4ac9-98ab-7be643b09d2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:27.137937 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1da43-b100-4ac9-98ab-7be643b09d2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:27.139544 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1da43-b100-4ac9-98ab-7be643b09d2b None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:27.151836 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d309724d-d032-4ed7-a0ab-2e48453b6d2e None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:27.157648 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-a6c1da43-b100-4ac9-98ab-7be643b09d2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:27.157648 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:27.157648 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:27.157648 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:27.157648 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:27.157648 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:27.157648 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:27.157648 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:27.157648 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:27.157648 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:27.157648 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:27.157648 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:27.157648 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:27.157648 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:27.157648 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:27.157648 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:27.158810 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:27.158810 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:27.158810 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:27.158810 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:27.158810 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:27.158810 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:27.158810 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:27.158810 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:27.158810 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:27.158810 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:27.158810 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:27.158810 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:27.158810 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:27.158810 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:27.158810 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:27.158810 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:27.158810 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:27.159926 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:27.159926 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:27.159926 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:27.166033 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 298/592] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:27.166033 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1da43-b100-4ac9-98ab-7be643b09d2b None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:27.200410 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:27.208248 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3fe7c2-54da-4303-955c-335f181c56a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:27.209793 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fe7c2-54da-4303-955c-335f181c56a3 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:27.210117 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fe7c2-54da-4303-955c-335f181c56a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:27.210770 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3fe7c2-54da-4303-955c-335f181c56a3 None admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:27.211534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3fe7c2-54da-4303-955c-335f181c56a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:27.212070 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3fe7c2-54da-4303-955c-335f181c56a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:27.213424 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3fe7c2-54da-4303-955c-335f181c56a3 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:27.230426 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 295/593] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:27.231402 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3fe7c2-54da-4303-955c-335f181c56a3 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:27.278298 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:27.307378 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1da43-b100-4ac9-98ab-7be643b09d2b None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:27.344917 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c6b7a-5103-454c-8bb9-afdd574cdc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:27.345731 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c6b7a-5103-454c-8bb9-afdd574cdc50 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:27.346103 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c6b7a-5103-454c-8bb9-afdd574cdc50 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:27.346482 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c6b7a-5103-454c-8bb9-afdd574cdc50 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:27.352454 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3fe7c2-54da-4303-955c-335f181c56a3 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:27.355357 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c6b7a-5103-454c-8bb9-afdd574cdc50 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:27.356816 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c6b7a-5103-454c-8bb9-afdd574cdc50 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:27.368674 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-181c6b7a-5103-454c-8bb9-afdd574cdc50 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 08 13:35:27.368674 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:27.368674 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:27.368674 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:27.368674 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:27.368674 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:27.368674 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:27.368674 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:27.368674 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:27.368674 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:27.368674 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:27.368674 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:27.368674 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:35:27.368674 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:35:27.368674 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:35:27.368674 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:35:27.369870 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:27.369870 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:27.369870 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:35:27.369870 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:35:27.369870 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:35:27.369870 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:35:27.369870 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:27.369870 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:27.369870 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:27.369870 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:27.369870 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:27.369870 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:27.369870 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:27.369870 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:27.369870 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:27.369870 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:27.369870 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:27.369870 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:27.370920 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:27.370920 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:27.370920 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:35:27.370920 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:35:27.370920 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:35:27.370920 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:35:27.370920 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:35:27.370920 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:35:27.370920 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 08 13:35:27.370920 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:27.370920 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 299/594] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Sep 8 13:35:27 2022] GET /identity/v3/users/neutron => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:27.370920 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1fcc7-71a7-4327-80b0-cd54993c2de4 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:27.371581 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1fcc7-71a7-4327-80b0-cd54993c2de4 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:27.371581 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1fcc7-71a7-4327-80b0-cd54993c2de4 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:27.377093 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 300/595] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:35:27.377093 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1fcc7-71a7-4327-80b0-cd54993c2de4 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:27.399838 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aef5be-ca23-404e-991e-df4677449ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:27.400752 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aef5be-ca23-404e-991e-df4677449ca2 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:27.401184 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aef5be-ca23-404e-991e-df4677449ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:27.401671 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aef5be-ca23-404e-991e-df4677449ca2 None admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:27.402579 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aef5be-ca23-404e-991e-df4677449ca2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:27.403127 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aef5be-ca23-404e-991e-df4677449ca2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:27.404661 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aef5be-ca23-404e-991e-df4677449ca2 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:27.417599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 296/596] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:27.418350 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aef5be-ca23-404e-991e-df4677449ca2 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:27.466935 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:27.490842 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1fcc7-71a7-4327-80b0-cd54993c2de4 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:27.527870 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a53181-f7fa-43d8-a3d8-0ef68f45f84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:27.528712 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a53181-f7fa-43d8-a3d8-0ef68f45f84b None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:27.529508 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a53181-f7fa-43d8-a3d8-0ef68f45f84b None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:27.529964 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a53181-f7fa-43d8-a3d8-0ef68f45f84b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:27.536094 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:27.537756 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a53181-f7fa-43d8-a3d8-0ef68f45f84b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:27.538859 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a53181-f7fa-43d8-a3d8-0ef68f45f84b None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:27.539876 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aef5be-ca23-404e-991e-df4677449ca2 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:27.550691 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-75a53181-f7fa-43d8-a3d8-0ef68f45f84b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:35:27.550691 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:27.550691 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:27.550691 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:27.550691 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:27.550691 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:27.550691 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:27.550691 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:27.550691 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:27.550691 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:27.550691 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:27.550691 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:27.550691 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:35:27.550691 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:35:27.550691 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:35:27.551811 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:35:27.551811 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:27.551811 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:27.551811 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:27.551811 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:27.551811 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:27.551811 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:27.551811 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:27.551811 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:27.551811 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:27.551811 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:27.551811 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:27.551811 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:27.551811 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:27.551811 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:27.551811 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:27.551811 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:27.553623 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:35:27.553623 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:35:27.553623 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:35:27.553623 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:35:27.553623 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:35:27.553623 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:35:27.553623 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:35:27.553623 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:27.553623 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 301/597] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:35:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:27.554258 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7cb6f2-4555-4cf1-8854-21b7beb61fe4 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:27.554258 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7cb6f2-4555-4cf1-8854-21b7beb61fe4 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:27.554383 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7cb6f2-4555-4cf1-8854-21b7beb61fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:27.574123 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-fc7cb6f2-4555-4cf1-8854-21b7beb61fe4 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:35:27.575544 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-fc7cb6f2-4555-4cf1-8854-21b7beb61fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:35:27.585471 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94abd99-4544-482e-9416-e15b6f0f4ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:27.586199 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94abd99-4544-482e-9416-e15b6f0f4ea2 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:27.586479 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94abd99-4544-482e-9416-e15b6f0f4ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:27.586747 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94abd99-4544-482e-9416-e15b6f0f4ea2 None admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:27.587606 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94abd99-4544-482e-9416-e15b6f0f4ea2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:27.587915 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94abd99-4544-482e-9416-e15b6f0f4ea2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:27.589339 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94abd99-4544-482e-9416-e15b6f0f4ea2 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:27.611217 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 297/598] 10.222.0.69 () {56 vars in 1139 bytes} [Thu Sep 8 13:35:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:27.612072 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94abd99-4544-482e-9416-e15b6f0f4ea2 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:27.681666 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 302/599] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:35:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:35:27.682860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7cb6f2-4555-4cf1-8854-21b7beb61fe4 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:27.752549 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94abd99-4544-482e-9416-e15b6f0f4ea2 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:27.763535 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:27.800510 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e820d4d-9f0c-4f1b-b5a4-96c2ef842957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:27.801399 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e820d4d-9f0c-4f1b-b5a4-96c2ef842957 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:27.801865 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e820d4d-9f0c-4f1b-b5a4-96c2ef842957 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:27.802281 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e820d4d-9f0c-4f1b-b5a4-96c2ef842957 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:27.804492 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7cb6f2-4555-4cf1-8854-21b7beb61fe4 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:27.811001 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e820d4d-9f0c-4f1b-b5a4-96c2ef842957 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:27.812667 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e820d4d-9f0c-4f1b-b5a4-96c2ef842957 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:27.825787 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-8e820d4d-9f0c-4f1b-b5a4-96c2ef842957 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:35:27.825787 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:27.825787 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:27.825787 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:27.825787 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:27.825787 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:27.825787 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:27.825787 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:27.825787 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:27.825787 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:27.825787 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:27.825787 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:27.825787 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:35:27.825787 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:35:27.825787 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:35:27.826921 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:35:27.826921 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:27.826921 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:27.826921 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:27.826921 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:27.826921 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:27.826921 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:27.826921 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:27.826921 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:27.826921 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:27.826921 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:27.826921 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:27.826921 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:27.826921 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:27.826921 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:27.826921 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:27.826921 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:27.828070 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:35:27.828070 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:35:27.828070 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:35:27.828070 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:35:27.828070 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:35:27.828070 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:35:27.828070 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:35:27.828070 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:27.834875 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 298/600] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:35:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:27.835864 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e820d4d-9f0c-4f1b-b5a4-96c2ef842957 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:27.851811 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5988ed0-c738-4555-9a27-e119bb810312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:27.852578 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5988ed0-c738-4555-9a27-e119bb810312 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:27.852932 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5988ed0-c738-4555-9a27-e119bb810312 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:27.853300 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5988ed0-c738-4555-9a27-e119bb810312 None admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:27.854118 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5988ed0-c738-4555-9a27-e119bb810312 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:27.854543 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5988ed0-c738-4555-9a27-e119bb810312 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:27.856393 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5988ed0-c738-4555-9a27-e119bb810312 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:27.860878 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:27.870772 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 303/601] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 8 13:35:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:27.871844 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5988ed0-c738-4555-9a27-e119bb810312 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:27.976518 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e820d4d-9f0c-4f1b-b5a4-96c2ef842957 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:27.982168 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5988ed0-c738-4555-9a27-e119bb810312 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:28.015405 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:28.017290 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97195346-7281-486f-bde9-828399958147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:28.018083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97195346-7281-486f-bde9-828399958147 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:28.018365 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97195346-7281-486f-bde9-828399958147 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:28.018673 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97195346-7281-486f-bde9-828399958147 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:28.023811 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018d759-1518-48cd-9d66-32e4da647b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:28.024416 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018d759-1518-48cd-9d66-32e4da647b40 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:28.024693 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018d759-1518-48cd-9d66-32e4da647b40 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:28.024960 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018d759-1518-48cd-9d66-32e4da647b40 None admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:28.025791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3018d759-1518-48cd-9d66-32e4da647b40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:28.025999 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3018d759-1518-48cd-9d66-32e4da647b40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:28.027855 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3018d759-1518-48cd-9d66-32e4da647b40 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:28.032199 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97195346-7281-486f-bde9-828399958147 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:28.033668 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97195346-7281-486f-bde9-828399958147 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:28.040228 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 304/602] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 8 13:35:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:28.042985 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018d759-1518-48cd-9d66-32e4da647b40 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:28.052855 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-97195346-7281-486f-bde9-828399958147 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:28.052855 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:28.052855 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:28.052855 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:28.052855 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:28.052855 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:28.052855 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:28.052855 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:28.052855 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:28.052855 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:28.052855 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:28.052855 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:28.052855 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:28.052855 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:28.052855 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:28.052855 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:28.054120 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:28.054120 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:28.054120 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:28.054120 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:28.054120 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:28.054120 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:28.054120 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:28.054120 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:28.054120 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:28.054120 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:28.054120 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:28.054120 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:28.054120 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:28.054120 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:28.054120 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:28.054120 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:28.054120 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:28.055153 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:28.055153 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:28.055153 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:28.055153 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 299/603] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:28.056070 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97195346-7281-486f-bde9-828399958147 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:28.140110 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:28.171569 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018d759-1518-48cd-9d66-32e4da647b40 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:28.178034 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97195346-7281-486f-bde9-828399958147 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:28.212280 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4087cd1-05b4-4a4f-af70-99ba1565a984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:28.212947 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4087cd1-05b4-4a4f-af70-99ba1565a984 None admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:28.213223 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4087cd1-05b4-4a4f-af70-99ba1565a984 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:28.213520 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4087cd1-05b4-4a4f-af70-99ba1565a984 None admin] PATH_INFO: `/v3/projects/88de9f1470c6415b97866ad5a3256ef2/users/d311099f51484141bd8504184b818ee8/roles/e5f27e532c9d4bc7a57e31856ecee597` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:28.219679 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db49738-b310-4be7-99c1-7067e5bb69ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:28.220890 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db49738-b310-4be7-99c1-7067e5bb69ba None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:28.221320 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db49738-b310-4be7-99c1-7067e5bb69ba None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:28.221788 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db49738-b310-4be7-99c1-7067e5bb69ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:28.229929 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4087cd1-05b4-4a4f-af70-99ba1565a984 None admin] RBAC: Authorizing `identity:create_grant(project_id=88de9f1470c6415b97866ad5a3256ef2, user_id=d311099f51484141bd8504184b818ee8, role_id=e5f27e532c9d4bc7a57e31856ecee597)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:28.231314 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4087cd1-05b4-4a4f-af70-99ba1565a984 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:28.234801 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db49738-b310-4be7-99c1-7067e5bb69ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:35:28.241995 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-5db49738-b310-4be7-99c1-7067e5bb69ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:35:28.241995 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:28.241995 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:28.241995 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:28.241995 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:28.241995 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:28.241995 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:28.241995 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:28.241995 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:28.241995 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:28.241995 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:28.241995 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:28.241995 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:35:28.241995 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:35:28.241995 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:35:28.241995 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:35:28.243228 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:35:28.243228 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:35:28.243228 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:35:28.243228 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:35:28.243228 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:28.243228 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:28.243228 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:28.243228 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:28.243228 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:28.243228 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:28.243228 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:28.243228 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:28.243228 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:28.243228 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:28.243228 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:28.243228 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:28.244219 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:28.244219 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:28.244219 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:28.244219 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:28.244219 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:35:28.244219 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:35:28.244219 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:35:28.244219 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:35:28.244219 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:35:28.244219 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:35:28.244219 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:35:28.244219 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:28.248653 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 300/604] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Sep 8 13:35:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:28.249774 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db49738-b310-4be7-99c1-7067e5bb69ba None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:28.251179 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 305/605] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Sep 8 13:35:28 2022] PUT /identity/v3/projects/88de9f1470c6415b97866ad5a3256ef2/users/d311099f51484141bd8504184b818ee8/roles/e5f27e532c9d4bc7a57e31856ecee597 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:35:28.251844 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4087cd1-05b4-4a4f-af70-99ba1565a984 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:28.330987 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:28.398513 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db49738-b310-4be7-99c1-7067e5bb69ba None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:28.425025 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4087cd1-05b4-4a4f-af70-99ba1565a984 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:28.437307 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:28.446754 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b9453-648e-405a-85ce-2ba596663571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:28.447431 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b9453-648e-405a-85ce-2ba596663571 None admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:28.447713 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b9453-648e-405a-85ce-2ba596663571 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:28.447996 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b9453-648e-405a-85ce-2ba596663571 None admin] PATH_INFO: `/v3/projects/88de9f1470c6415b97866ad5a3256ef2/users/6677b4518c094636bc8ed7b588103390/roles/e5f27e532c9d4bc7a57e31856ecee597` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:28.468045 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053b9453-648e-405a-85ce-2ba596663571 None admin] RBAC: Authorizing `identity:create_grant(project_id=88de9f1470c6415b97866ad5a3256ef2, user_id=6677b4518c094636bc8ed7b588103390, role_id=e5f27e532c9d4bc7a57e31856ecee597)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:28.471004 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053b9453-648e-405a-85ce-2ba596663571 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:28.486315 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87320b1d-970a-4dc8-a593-297eb508db9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:28.486962 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87320b1d-970a-4dc8-a593-297eb508db9f None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:28.487553 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87320b1d-970a-4dc8-a593-297eb508db9f None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:28.487916 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87320b1d-970a-4dc8-a593-297eb508db9f None admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:28.488628 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87320b1d-970a-4dc8-a593-297eb508db9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:28.488937 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87320b1d-970a-4dc8-a593-297eb508db9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:28.491591 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87320b1d-970a-4dc8-a593-297eb508db9f None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:28.497495 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 301/606] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Sep 8 13:35:28 2022] PUT /identity/v3/projects/88de9f1470c6415b97866ad5a3256ef2/users/6677b4518c094636bc8ed7b588103390/roles/e5f27e532c9d4bc7a57e31856ecee597 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:35:28.498298 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b9453-648e-405a-85ce-2ba596663571 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:28.507058 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 306/607] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:28.513192 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87320b1d-970a-4dc8-a593-297eb508db9f None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:28.645720 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b9453-648e-405a-85ce-2ba596663571 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:28.691277 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f111fc-7d1a-4a91-b46b-333d11248f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:28.692291 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f111fc-7d1a-4a91-b46b-333d11248f5a None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:28.692871 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f111fc-7d1a-4a91-b46b-333d11248f5a None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:28.693588 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f111fc-7d1a-4a91-b46b-333d11248f5a None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:28.695160 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f111fc-7d1a-4a91-b46b-333d11248f5a None admin] RBAC: Adding query filter params (name=service) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:28.695712 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f111fc-7d1a-4a91-b46b-333d11248f5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:28.697635 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f111fc-7d1a-4a91-b46b-333d11248f5a None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:28.712463 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 302/608] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Sep 8 13:35:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:28.714957 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f111fc-7d1a-4a91-b46b-333d11248f5a None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:28.752031 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87320b1d-970a-4dc8-a593-297eb508db9f None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:28.753525 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:28.789804 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:28.793827 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12597caa-47bd-4918-a12f-469d0e1a4563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:28.794600 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12597caa-47bd-4918-a12f-469d0e1a4563 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:28.794776 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12597caa-47bd-4918-a12f-469d0e1a4563 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:28.795062 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12597caa-47bd-4918-a12f-469d0e1a4563 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:28.802547 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12597caa-47bd-4918-a12f-469d0e1a4563 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:28.804012 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12597caa-47bd-4918-a12f-469d0e1a4563 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:28.816553 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-12597caa-47bd-4918-a12f-469d0e1a4563 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:35:28.816553 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:28.816553 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:28.816553 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:28.816553 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:28.816553 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:28.816553 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:28.816553 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:28.816553 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:28.816553 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:28.816553 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:28.816553 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:28.816553 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:35:28.816553 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:35:28.816553 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:35:28.817573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:35:28.817573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:28.817573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:28.817573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:28.817573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:28.817573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:28.817573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:28.817573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:28.817573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:28.817573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:28.817573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:28.817573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:28.817573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:28.817573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:28.817573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:28.817573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:28.817573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:28.819335 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:35:28.819335 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:35:28.819335 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:35:28.819335 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:35:28.819335 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:35:28.819335 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:35:28.819335 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:35:28.819335 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:28.819335 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 307/609] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:35:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:35:28.820353 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87a1fb-714c-4d6f-b61a-81b718da2b5b None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:28.820353 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87a1fb-714c-4d6f-b61a-81b718da2b5b None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:28.820506 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87a1fb-714c-4d6f-b61a-81b718da2b5b None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:28.825289 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 308/610] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:35:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:35:28.827128 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da87a1fb-714c-4d6f-b61a-81b718da2b5b None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:28.859947 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f111fc-7d1a-4a91-b46b-333d11248f5a None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:28.904512 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b1ef1-7d74-47ed-91d6-f44ec35f1062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:28.906035 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b1ef1-7d74-47ed-91d6-f44ec35f1062 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:28.906320 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b1ef1-7d74-47ed-91d6-f44ec35f1062 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:28.906590 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b1ef1-7d74-47ed-91d6-f44ec35f1062 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:28.919944 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b1ef1-7d74-47ed-91d6-f44ec35f1062 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:28.921424 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b1ef1-7d74-47ed-91d6-f44ec35f1062 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:28.938681 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-672b1ef1-7d74-47ed-91d6-f44ec35f1062 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:28.938681 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:28.938681 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:28.938681 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:28.938681 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:28.938681 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:28.938681 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:28.938681 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:28.938681 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:28.938681 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:28.938681 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:28.938681 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:28.938681 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:28.938681 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:28.938681 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:28.938681 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:28.939710 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:28.939710 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:28.939710 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:28.939710 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:28.939710 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:28.939710 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:28.939710 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:28.939710 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:28.939710 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:28.939710 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:28.939710 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:28.939710 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:28.939710 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:28.939710 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:28.939710 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:28.939710 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:28.939710 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:28.940600 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:28.940600 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:28.940600 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:28.940600 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 303/611] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:35:28.944891 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6a920-c328-4a7f-8d76-7fa25706dc93 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:28.944891 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6a920-c328-4a7f-8d76-7fa25706dc93 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:28.944891 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6a920-c328-4a7f-8d76-7fa25706dc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:28.953677 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da87a1fb-714c-4d6f-b61a-81b718da2b5b None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:28.967708 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-7cf6a920-c328-4a7f-8d76-7fa25706dc93 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:35:28.970189 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-7cf6a920-c328-4a7f-8d76-7fa25706dc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:35:28.994927 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d97453-5cf2-4733-aad5-9b588aa780ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:28.995571 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d97453-5cf2-4733-aad5-9b588aa780ad None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:28.995852 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d97453-5cf2-4733-aad5-9b588aa780ad None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:28.996098 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d97453-5cf2-4733-aad5-9b588aa780ad None admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:28.996794 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d97453-5cf2-4733-aad5-9b588aa780ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:28.997093 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d97453-5cf2-4733-aad5-9b588aa780ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:28.998690 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d97453-5cf2-4733-aad5-9b588aa780ad None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:29.016827 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 309/612] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 8 13:35:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:29.017698 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d97453-5cf2-4733-aad5-9b588aa780ad None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:29.059646 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:29.085952 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 304/613] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:35:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:35:29.094638 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6a920-c328-4a7f-8d76-7fa25706dc93 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:29.170564 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:29.245761 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d97453-5cf2-4733-aad5-9b588aa780ad None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:29.336309 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00896903-db45-4693-b1b2-559268a71103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:29.337846 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00896903-db45-4693-b1b2-559268a71103 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:29.338596 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00896903-db45-4693-b1b2-559268a71103 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:29.339340 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00896903-db45-4693-b1b2-559268a71103 None admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:29.340812 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00896903-db45-4693-b1b2-559268a71103 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:29.342938 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00896903-db45-4693-b1b2-559268a71103 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:29.345814 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00896903-db45-4693-b1b2-559268a71103 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:29.389443 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 310/614] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:29.394584 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00896903-db45-4693-b1b2-559268a71103 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:29.412319 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6a920-c328-4a7f-8d76-7fa25706dc93 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:29.468409 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871c941-1cf3-4809-9988-487a518eb683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:29.469312 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871c941-1cf3-4809-9988-487a518eb683 None admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:29.469991 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871c941-1cf3-4809-9988-487a518eb683 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:29.470263 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871c941-1cf3-4809-9988-487a518eb683 None admin] PATH_INFO: `/v3/projects/88de9f1470c6415b97866ad5a3256ef2/users/db898158553743d3a28f3d6237e91a8b/roles/e5f27e532c9d4bc7a57e31856ecee597` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:29.492931 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871c941-1cf3-4809-9988-487a518eb683 None admin] RBAC: Authorizing `identity:create_grant(project_id=88de9f1470c6415b97866ad5a3256ef2, user_id=db898158553743d3a28f3d6237e91a8b, role_id=e5f27e532c9d4bc7a57e31856ecee597)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:29.495577 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871c941-1cf3-4809-9988-487a518eb683 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:29.510179 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:29.516829 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 305/615] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Sep 8 13:35:29 2022] PUT /identity/v3/projects/88de9f1470c6415b97866ad5a3256ef2/users/db898158553743d3a28f3d6237e91a8b/roles/e5f27e532c9d4bc7a57e31856ecee597 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:35:29.518032 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871c941-1cf3-4809-9988-487a518eb683 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:29.551831 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00896903-db45-4693-b1b2-559268a71103 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:29.604143 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b7958-5bf9-4463-894b-92054e88279c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:29.604780 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b7958-5bf9-4463-894b-92054e88279c None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:29.605059 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b7958-5bf9-4463-894b-92054e88279c None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:29.605327 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b7958-5bf9-4463-894b-92054e88279c None admin] PATH_INFO: `/v3/users/swift` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:29.615781 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b7958-5bf9-4463-894b-92054e88279c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:29.617405 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772b7958-5bf9-4463-894b-92054e88279c None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:29.623650 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:29.632585 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-772b7958-5bf9-4463-894b-92054e88279c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 08 13:35:29.632585 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:29.632585 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:29.632585 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:29.632585 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:29.632585 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:29.632585 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:29.632585 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:29.632585 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:29.632585 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:29.632585 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:29.632585 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:29.632585 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:35:29.632585 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:35:29.632585 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:35:29.632585 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:35:29.633778 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:29.633778 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:29.633778 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:35:29.633778 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:35:29.633778 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:35:29.633778 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:35:29.633778 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:29.633778 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:29.633778 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:29.633778 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:29.633778 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:29.633778 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:29.633778 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:29.633778 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:29.633778 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:29.633778 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:29.633778 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:29.633778 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:29.638379 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:29.638379 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:29.638379 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:35:29.638379 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:35:29.638379 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:35:29.638379 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:35:29.638379 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:35:29.638379 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:35:29.638379 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 08 13:35:29.638379 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:29.638379 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 311/616] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 8 13:35:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:29.642173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b7958-5bf9-4463-894b-92054e88279c None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:29.685796 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871c941-1cf3-4809-9988-487a518eb683 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:29.732217 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841fd009-00b2-4ffa-835a-3dabf4b443b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:29.734103 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fd009-00b2-4ffa-835a-3dabf4b443b0 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:29.735899 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fd009-00b2-4ffa-835a-3dabf4b443b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:29.741100 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fd009-00b2-4ffa-835a-3dabf4b443b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:29.768758 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841fd009-00b2-4ffa-835a-3dabf4b443b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:35:29.773843 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-841fd009-00b2-4ffa-835a-3dabf4b443b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:35:29.773843 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:29.773843 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:29.773843 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:29.773843 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:29.773843 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:29.773843 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:29.773843 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:29.773843 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:29.773843 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:29.773843 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:29.773843 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:29.773843 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:35:29.773843 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:35:29.773843 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:35:29.773843 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:35:29.774967 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:35:29.774967 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:35:29.774967 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:35:29.774967 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:35:29.774967 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:29.774967 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:29.774967 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:29.774967 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:29.774967 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:29.774967 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:29.774967 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:29.774967 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:29.774967 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:29.774967 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:29.774967 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:29.774967 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:29.775881 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:29.775881 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:29.775881 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:29.775881 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:29.775881 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:35:29.775881 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:35:29.775881 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:35:29.775881 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:35:29.775881 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:35:29.775881 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:35:29.775881 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:35:29.775881 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:29.780647 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 306/617] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Sep 8 13:35:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:29.781594 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841fd009-00b2-4ffa-835a-3dabf4b443b0 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:29.831101 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772b7958-5bf9-4463-894b-92054e88279c None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:29.871262 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99afbb-c2be-4f09-aed9-07496c848369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:29.872195 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99afbb-c2be-4f09-aed9-07496c848369 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:29.872713 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99afbb-c2be-4f09-aed9-07496c848369 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:29.873245 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99afbb-c2be-4f09-aed9-07496c848369 None admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:29.874213 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be99afbb-c2be-4f09-aed9-07496c848369 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:29.874660 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be99afbb-c2be-4f09-aed9-07496c848369 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:29.876342 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be99afbb-c2be-4f09-aed9-07496c848369 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:29.895265 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:29.897337 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841fd009-00b2-4ffa-835a-3dabf4b443b0 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:29.905174 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 312/618] 10.222.0.69 () {56 vars in 1135 bytes} [Thu Sep 8 13:35:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:29.906686 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99afbb-c2be-4f09-aed9-07496c848369 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:29.935566 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03826cc6-423e-4767-98ff-3883852d8448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:29.936022 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03826cc6-423e-4767-98ff-3883852d8448 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:29.936272 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03826cc6-423e-4767-98ff-3883852d8448 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:29.936548 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03826cc6-423e-4767-98ff-3883852d8448 None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:29.937278 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03826cc6-423e-4767-98ff-3883852d8448 None admin] RBAC: Adding query filter params (name=service) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:29.937778 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03826cc6-423e-4767-98ff-3883852d8448 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:29.939265 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03826cc6-423e-4767-98ff-3883852d8448 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:29.940941 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:29.951007 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 307/619] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Sep 8 13:35:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:29.956703 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03826cc6-423e-4767-98ff-3883852d8448 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:30.022259 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99afbb-c2be-4f09-aed9-07496c848369 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:30.063685 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20a207-2939-488f-b46b-0911e8af0c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:30.064823 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20a207-2939-488f-b46b-0911e8af0c36 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:30.066464 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20a207-2939-488f-b46b-0911e8af0c36 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:30.066934 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20a207-2939-488f-b46b-0911e8af0c36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:30.089594 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c20a207-2939-488f-b46b-0911e8af0c36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:30.091511 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c20a207-2939-488f-b46b-0911e8af0c36 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:30.117240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-3c20a207-2939-488f-b46b-0911e8af0c36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:30.117240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:30.117240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:30.117240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:30.117240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:30.117240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:30.117240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:30.117240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:30.117240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:30.117240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:30.117240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:30.117240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:30.117240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:30.117240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:30.117240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:30.117240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:30.118530 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:30.118530 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:30.118530 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:30.118530 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:30.118530 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:30.118530 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:30.118530 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:30.118530 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:30.118530 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:30.118530 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:30.118530 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:30.118530 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:30.118530 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:30.118530 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:30.118530 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:30.118530 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:30.118530 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:30.119448 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:30.119448 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:30.119448 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:30.119448 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 313/620] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:35:30.124514 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20a207-2939-488f-b46b-0911e8af0c36 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:30.154140 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03826cc6-423e-4767-98ff-3883852d8448 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:30.216981 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9d7b9-c559-47e0-9968-96a28ce89cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:30.217656 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9d7b9-c559-47e0-9968-96a28ce89cdb None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:30.217966 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9d7b9-c559-47e0-9968-96a28ce89cdb None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:30.218241 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9d7b9-c559-47e0-9968-96a28ce89cdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:30.228451 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:30.232710 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d9d7b9-c559-47e0-9968-96a28ce89cdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:30.234424 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d9d7b9-c559-47e0-9968-96a28ce89cdb None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:30.254596 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-95d9d7b9-c559-47e0-9968-96a28ce89cdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:30.254596 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:30.254596 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:30.254596 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:30.254596 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:30.254596 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:30.254596 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:30.254596 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:30.254596 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:30.254596 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:30.254596 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:30.254596 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:30.254596 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:30.254596 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:30.254596 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:30.254596 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:30.255666 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:30.255666 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:30.255666 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:30.255666 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:30.255666 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:30.255666 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:30.255666 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:30.255666 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:30.255666 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:30.255666 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:30.255666 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:30.255666 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:30.255666 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:30.255666 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:30.255666 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:30.255666 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:30.255666 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:30.257017 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:30.257017 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:30.257017 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:30.257017 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 308/621] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:35:30.261789 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9d7b9-c559-47e0-9968-96a28ce89cdb None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:30.332459 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20a207-2939-488f-b46b-0911e8af0c36 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:30.335556 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:30.402206 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88219732-7164-48e5-a72f-b732d6358b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:30.403180 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88219732-7164-48e5-a72f-b732d6358b7c None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:30.403842 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88219732-7164-48e5-a72f-b732d6358b7c None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:30.404317 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88219732-7164-48e5-a72f-b732d6358b7c None admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:30.405182 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88219732-7164-48e5-a72f-b732d6358b7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:30.405484 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9d7b9-c559-47e0-9968-96a28ce89cdb None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:30.405933 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88219732-7164-48e5-a72f-b732d6358b7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:30.407503 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88219732-7164-48e5-a72f-b732d6358b7c None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:30.421795 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 314/622] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:30.426953 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88219732-7164-48e5-a72f-b732d6358b7c None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:30.495510 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a61e8b-d68e-4ab2-a670-2c6447a70c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:30.496213 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a61e8b-d68e-4ab2-a670-2c6447a70c8f None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:30.496403 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a61e8b-d68e-4ab2-a670-2c6447a70c8f None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:30.496673 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a61e8b-d68e-4ab2-a670-2c6447a70c8f None admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:30.497324 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a61e8b-d68e-4ab2-a670-2c6447a70c8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:30.497660 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a61e8b-d68e-4ab2-a670-2c6447a70c8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:30.499066 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a61e8b-d68e-4ab2-a670-2c6447a70c8f None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:30.531262 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 309/623] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:35:30.536379 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a61e8b-d68e-4ab2-a670-2c6447a70c8f None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:30.537070 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88219732-7164-48e5-a72f-b732d6358b7c None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:30.553756 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:30.576926 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166c87a6-4ac2-4df6-9d19-6213c63f9b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:30.578400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c87a6-4ac2-4df6-9d19-6213c63f9b13 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:30.578880 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c87a6-4ac2-4df6-9d19-6213c63f9b13 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:30.579340 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c87a6-4ac2-4df6-9d19-6213c63f9b13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:30.587833 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166c87a6-4ac2-4df6-9d19-6213c63f9b13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:30.589977 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166c87a6-4ac2-4df6-9d19-6213c63f9b13 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:30.603688 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-166c87a6-4ac2-4df6-9d19-6213c63f9b13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:35:30.603688 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:30.603688 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:30.603688 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:30.603688 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:30.603688 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:30.603688 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:30.603688 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:30.603688 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:30.603688 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:30.603688 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:30.603688 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:30.603688 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:35:30.603688 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:35:30.603688 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:35:30.604650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:35:30.604650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:30.604650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:30.604650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:30.604650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:30.604650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:30.604650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:30.604650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:30.604650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:30.604650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:30.604650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:30.604650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:30.604650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:30.604650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:30.604650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:30.604650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:30.604650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:30.605580 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:35:30.605580 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:35:30.605580 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:35:30.605580 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:35:30.605580 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:35:30.605580 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:35:30.605580 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:35:30.605580 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:30.608293 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 315/624] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:35:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:35:30.613851 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166c87a6-4ac2-4df6-9d19-6213c63f9b13 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:30.768965 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a61e8b-d68e-4ab2-a670-2c6447a70c8f None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:30.772594 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166c87a6-4ac2-4df6-9d19-6213c63f9b13 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:30.792912 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:30.835559 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0b7a3-c249-44f9-b269-11ec9c6c754e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:30.836196 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0b7a3-c249-44f9-b269-11ec9c6c754e None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:30.836473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0b7a3-c249-44f9-b269-11ec9c6c754e None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:30.836741 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0b7a3-c249-44f9-b269-11ec9c6c754e None admin] PATH_INFO: `/v3/users/nova` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:30.847190 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2715d-1266-40d7-98a4-b1e01a39d428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:30.847804 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2715d-1266-40d7-98a4-b1e01a39d428 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:30.848079 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2715d-1266-40d7-98a4-b1e01a39d428 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:30.848345 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2715d-1266-40d7-98a4-b1e01a39d428 None admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:30.850129 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be2715d-1266-40d7-98a4-b1e01a39d428 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:30.850454 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be2715d-1266-40d7-98a4-b1e01a39d428 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:30.851912 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be2715d-1266-40d7-98a4-b1e01a39d428 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:30.854828 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb0b7a3-c249-44f9-b269-11ec9c6c754e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:30.856461 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb0b7a3-c249-44f9-b269-11ec9c6c754e None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:30.879102 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-3cb0b7a3-c249-44f9-b269-11ec9c6c754e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:35:30.879102 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:30.879102 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:30.879102 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:30.879102 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:30.879102 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:30.879102 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:30.879102 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:30.879102 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:30.879102 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:30.879102 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:30.879102 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:30.879102 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:35:30.879102 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:35:30.879102 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:35:30.879102 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:35:30.880654 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:30.880654 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:30.880654 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:35:30.880654 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:35:30.880654 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:35:30.880654 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:35:30.880654 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:30.880654 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:30.880654 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:30.880654 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:30.880654 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:30.880654 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:30.880654 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:30.880654 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:30.880654 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:30.880654 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:30.880654 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:30.880654 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:30.881813 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:30.881813 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:30.881813 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:35:30.881813 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:35:30.881813 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:35:30.881813 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:35:30.881813 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:35:30.881813 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:35:30.881813 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:35:30.881813 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:30.883404 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 316/625] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 8 13:35:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:30.883850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 310/626] 10.222.0.69 () {56 vars in 1093 bytes} [Thu Sep 8 13:35:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:30.888963 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2715d-1266-40d7-98a4-b1e01a39d428 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:30.893637 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0b7a3-c249-44f9-b269-11ec9c6c754e None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:30.954238 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:31.111617 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2715d-1266-40d7-98a4-b1e01a39d428 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:31.119738 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0b7a3-c249-44f9-b269-11ec9c6c754e None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:31.162914 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38cb8c7-bbbd-4082-ae18-ac7db03480dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:31.163132 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c614e5-e61c-42f3-923b-9b8a94a778ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:31.163528 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38cb8c7-bbbd-4082-ae18-ac7db03480dd None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:31.163772 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c614e5-e61c-42f3-923b-9b8a94a778ca None admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:31.163867 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38cb8c7-bbbd-4082-ae18-ac7db03480dd None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:31.164059 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c614e5-e61c-42f3-923b-9b8a94a778ca None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:31.164159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38cb8c7-bbbd-4082-ae18-ac7db03480dd None admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:31.164315 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c614e5-e61c-42f3-923b-9b8a94a778ca None admin] PATH_INFO: `/v3/projects/88de9f1470c6415b97866ad5a3256ef2/users/fa9b97592a6840c3865d7dcf886221e0/roles/e5f27e532c9d4bc7a57e31856ecee597` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:31.164836 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38cb8c7-bbbd-4082-ae18-ac7db03480dd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:31.165087 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38cb8c7-bbbd-4082-ae18-ac7db03480dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:31.166569 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38cb8c7-bbbd-4082-ae18-ac7db03480dd None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:31.183026 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c614e5-e61c-42f3-923b-9b8a94a778ca None admin] RBAC: Authorizing `identity:create_grant(project_id=88de9f1470c6415b97866ad5a3256ef2, user_id=fa9b97592a6840c3865d7dcf886221e0, role_id=e5f27e532c9d4bc7a57e31856ecee597)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:31.184505 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c614e5-e61c-42f3-923b-9b8a94a778ca None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:31.188027 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 311/627] 10.222.0.69 () {56 vars in 1133 bytes} [Thu Sep 8 13:35:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:31.194653 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a19535-3a68-48c6-a047-b7f5c610df1a None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:31.194958 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a19535-3a68-48c6-a047-b7f5c610df1a None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:31.195368 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a19535-3a68-48c6-a047-b7f5c610df1a None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:31.196816 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 312/628] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:35:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:35:31.202392 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 317/629] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Sep 8 13:35:30 2022] PUT /identity/v3/projects/88de9f1470c6415b97866ad5a3256ef2/users/fa9b97592a6840c3865d7dcf886221e0/roles/e5f27e532c9d4bc7a57e31856ecee597 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:35:31.202681 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b99d2-3d83-4670-9b16-eeb33739c847 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:31.202681 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b99d2-3d83-4670-9b16-eeb33739c847 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:31.202940 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b99d2-3d83-4670-9b16-eeb33739c847 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:31.203398 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c614e5-e61c-42f3-923b-9b8a94a778ca None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:31.204360 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 313/630] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:35:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:35:31.205423 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215b724-544b-4059-88d6-473128e14405 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:31.205834 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215b724-544b-4059-88d6-473128e14405 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:31.206028 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215b724-544b-4059-88d6-473128e14405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:31.238865 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-9215b724-544b-4059-88d6-473128e14405 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:35:31.240975 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-9215b724-544b-4059-88d6-473128e14405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:35:31.267187 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:31.353895 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 314/631] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:35:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:35:31.355449 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4570ae6-9edd-4c49-8887-4e95cec66a5c None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:31.355925 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4570ae6-9edd-4c49-8887-4e95cec66a5c None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:31.356208 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4570ae6-9edd-4c49-8887-4e95cec66a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:31.373436 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:31.399488 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-d4570ae6-9edd-4c49-8887-4e95cec66a5c None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:35:31.403154 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-d4570ae6-9edd-4c49-8887-4e95cec66a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:35:31.428718 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c614e5-e61c-42f3-923b-9b8a94a778ca None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:31.471636 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ddfa7f-7838-4a92-b73a-77dc7b6d6394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:31.472380 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddfa7f-7838-4a92-b73a-77dc7b6d6394 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:31.472629 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddfa7f-7838-4a92-b73a-77dc7b6d6394 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:31.472906 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddfa7f-7838-4a92-b73a-77dc7b6d6394 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:31.501584 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 315/632] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:35:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:35:31.577595 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ddfa7f-7838-4a92-b73a-77dc7b6d6394 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:31.579147 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ddfa7f-7838-4a92-b73a-77dc7b6d6394 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:31.683425 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4570ae6-9edd-4c49-8887-4e95cec66a5c None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:31.697081 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:31.721982 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 318/633] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:35:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:35:31.728164 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ddfa7f-7838-4a92-b73a-77dc7b6d6394 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:31.834345 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:31.852340 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4570ae6-9edd-4c49-8887-4e95cec66a5c None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:31.898265 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd268901-e7e7-4f77-b486-93963d6a1e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:31.899167 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd268901-e7e7-4f77-b486-93963d6a1e88 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:31.899302 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd268901-e7e7-4f77-b486-93963d6a1e88 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:31.899563 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd268901-e7e7-4f77-b486-93963d6a1e88 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:31.913248 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd268901-e7e7-4f77-b486-93963d6a1e88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:35:31.915315 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ddfa7f-7838-4a92-b73a-77dc7b6d6394 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:31.918893 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-bd268901-e7e7-4f77-b486-93963d6a1e88 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:35:31.918893 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:31.918893 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:31.918893 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:31.918893 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:31.918893 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:31.918893 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:31.918893 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:31.918893 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:31.918893 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:31.918893 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:31.918893 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:31.918893 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:35:31.918893 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:35:31.918893 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:35:31.918893 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:35:31.919860 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:35:31.919860 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:35:31.919860 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:35:31.919860 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:35:31.919860 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:31.919860 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:31.919860 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:31.919860 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:31.919860 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:31.919860 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:31.919860 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:31.919860 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:31.919860 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:31.919860 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:31.919860 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:31.919860 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:31.920699 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:31.920699 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:31.920699 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:31.920699 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:31.920699 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:35:31.920699 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:35:31.920699 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:35:31.920699 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:35:31.920699 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:35:31.920699 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:35:31.920699 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:35:31.920699 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:31.920699 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 316/634] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Sep 8 13:35:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:35:31.920699 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd268901-e7e7-4f77-b486-93963d6a1e88 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:31.967999 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420479f9-851e-449a-812b-81c1059355e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:31.969021 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420479f9-851e-449a-812b-81c1059355e7 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:31.969555 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420479f9-851e-449a-812b-81c1059355e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:31.970031 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420479f9-851e-449a-812b-81c1059355e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:31.986561 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420479f9-851e-449a-812b-81c1059355e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:31.988764 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420479f9-851e-449a-812b-81c1059355e7 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:32.011731 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-420479f9-851e-449a-812b-81c1059355e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:32.011731 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:32.011731 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:32.011731 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:32.011731 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:32.011731 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:32.011731 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:32.011731 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:32.011731 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:32.011731 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:32.011731 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:32.011731 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:32.011731 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:32.011731 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:32.011731 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:32.011731 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:32.012751 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:32.012751 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:32.012751 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:32.012751 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:32.012751 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:32.012751 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:32.012751 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:32.012751 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:32.012751 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:32.012751 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:32.012751 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:32.012751 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:32.012751 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:32.012751 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:32.012751 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:32.012751 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:32.012751 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:32.013719 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:32.013719 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:32.013719 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:32.016371 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 319/635] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:32.017881 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420479f9-851e-449a-812b-81c1059355e7 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:32.046801 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd268901-e7e7-4f77-b486-93963d6a1e88 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:32.071472 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:32.097403 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c50e6b-941c-4568-b154-8e2374f4b940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:32.098078 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c50e6b-941c-4568-b154-8e2374f4b940 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:32.098359 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c50e6b-941c-4568-b154-8e2374f4b940 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:32.099045 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c50e6b-941c-4568-b154-8e2374f4b940 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:32.115315 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c50e6b-941c-4568-b154-8e2374f4b940 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:35:32.122162 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-f3c50e6b-941c-4568-b154-8e2374f4b940 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:35:32.122162 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:32.122162 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:32.122162 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:32.122162 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:32.122162 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:32.122162 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:32.122162 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:32.122162 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:32.122162 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:32.122162 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:32.122162 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:32.122162 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:35:32.122162 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:35:32.122162 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:35:32.122162 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:35:32.123197 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:35:32.123197 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:35:32.123197 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:35:32.123197 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:35:32.123197 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:32.123197 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:32.123197 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:32.123197 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:32.123197 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:32.123197 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:32.123197 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:32.123197 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:32.123197 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:32.123197 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:32.123197 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:32.123197 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:32.124043 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:32.124043 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:32.124043 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:32.124043 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:32.124043 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:35:32.124043 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:35:32.124043 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:35:32.124043 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:35:32.124043 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:35:32.124043 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:35:32.124043 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:35:32.124043 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:32.128593 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 317/636] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Sep 8 13:35:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:32.129409 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c50e6b-941c-4568-b154-8e2374f4b940 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:32.141209 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:32.175813 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420479f9-851e-449a-812b-81c1059355e7 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:32.214362 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba71008-3e8a-411e-83ba-9b05c5b30c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:32.215055 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba71008-3e8a-411e-83ba-9b05c5b30c68 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:32.215259 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba71008-3e8a-411e-83ba-9b05c5b30c68 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:32.215510 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba71008-3e8a-411e-83ba-9b05c5b30c68 None admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:32.216176 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba71008-3e8a-411e-83ba-9b05c5b30c68 None admin] RBAC: Adding query filter params (name=service) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:32.216488 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba71008-3e8a-411e-83ba-9b05c5b30c68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:32.218069 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba71008-3e8a-411e-83ba-9b05c5b30c68 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:32.227350 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 320/637] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Sep 8 13:35:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:32.228187 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba71008-3e8a-411e-83ba-9b05c5b30c68 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:32.265922 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c50e6b-941c-4568-b154-8e2374f4b940 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:32.307767 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e6bb0-2279-47a6-baeb-d9918c72c566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:32.308462 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e6bb0-2279-47a6-baeb-d9918c72c566 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:32.308721 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e6bb0-2279-47a6-baeb-d9918c72c566 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:32.309043 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e6bb0-2279-47a6-baeb-d9918c72c566 None admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:32.310064 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e6bb0-2279-47a6-baeb-d9918c72c566 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:32.310370 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e6bb0-2279-47a6-baeb-d9918c72c566 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:32.311852 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e6bb0-2279-47a6-baeb-d9918c72c566 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:32.330031 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 318/638] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:32.330031 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae50f0-f9ba-4e2b-b09b-e48b5b5dea98 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:32.330031 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae50f0-f9ba-4e2b-b09b-e48b5b5dea98 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:32.330031 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae50f0-f9ba-4e2b-b09b-e48b5b5dea98 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:32.330031 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 319/639] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:35:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:35:32.330031 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae50f0-f9ba-4e2b-b09b-e48b5b5dea98 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:32.356708 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:32.363979 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba71008-3e8a-411e-83ba-9b05c5b30c68 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:32.403774 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70278768-646f-4ebb-a077-383234df5123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:32.404499 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70278768-646f-4ebb-a077-383234df5123 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:32.404678 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70278768-646f-4ebb-a077-383234df5123 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:32.404958 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70278768-646f-4ebb-a077-383234df5123 None admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:32.405719 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70278768-646f-4ebb-a077-383234df5123 None admin] RBAC: Adding query filter params (name=service) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:32.406019 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70278768-646f-4ebb-a077-383234df5123 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:32.407473 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70278768-646f-4ebb-a077-383234df5123 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:32.416675 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:32.421814 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 321/640] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Sep 8 13:35:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:32.422800 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70278768-646f-4ebb-a077-383234df5123 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:32.464950 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae50f0-f9ba-4e2b-b09b-e48b5b5dea98 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:32.505758 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38075b-4b34-4076-9134-1f8026dd2d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:32.506404 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38075b-4b34-4076-9134-1f8026dd2d03 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:32.506672 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38075b-4b34-4076-9134-1f8026dd2d03 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:32.506847 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38075b-4b34-4076-9134-1f8026dd2d03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:32.519331 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f38075b-4b34-4076-9134-1f8026dd2d03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:32.521346 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f38075b-4b34-4076-9134-1f8026dd2d03 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:32.538628 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-4f38075b-4b34-4076-9134-1f8026dd2d03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:32.538628 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:32.538628 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:32.538628 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:32.538628 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:32.538628 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:32.538628 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:32.538628 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:32.538628 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:32.538628 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:32.538628 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:32.538628 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:32.538628 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:32.538628 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:32.538628 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:32.538628 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:32.539828 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:32.539828 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:32.539828 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:32.539828 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:32.539828 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:32.539828 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:32.539828 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:32.539828 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:32.539828 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:32.539828 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:32.539828 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:32.539828 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:32.539828 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:32.539828 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:32.539828 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:32.539828 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:32.539828 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:32.540715 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:32.540715 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:32.540715 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:32.540715 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 320/641] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:32.541262 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c2cbb-5902-4ed2-ad59-dcd40d4e5e94 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:32.541558 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c2cbb-5902-4ed2-ad59-dcd40d4e5e94 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:32.541831 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c2cbb-5902-4ed2-ad59-dcd40d4e5e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:32.550009 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70278768-646f-4ebb-a077-383234df5123 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:32.572045 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-174c2cbb-5902-4ed2-ad59-dcd40d4e5e94 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:35:32.573265 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-174c2cbb-5902-4ed2-ad59-dcd40d4e5e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:35:32.589653 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d23e6-5a93-4b0f-8fc4-d0ced10e9aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:32.590601 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d23e6-5a93-4b0f-8fc4-d0ced10e9aa0 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:32.590879 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d23e6-5a93-4b0f-8fc4-d0ced10e9aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:32.591264 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d23e6-5a93-4b0f-8fc4-d0ced10e9aa0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:32.599641 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d23e6-5a93-4b0f-8fc4-d0ced10e9aa0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:32.601095 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d23e6-5a93-4b0f-8fc4-d0ced10e9aa0 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:32.617945 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-b58d23e6-5a93-4b0f-8fc4-d0ced10e9aa0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:35:32.617945 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:32.617945 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:32.617945 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:32.617945 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:32.617945 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:32.617945 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:32.617945 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:32.617945 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:32.617945 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:32.617945 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:32.617945 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:32.617945 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:35:32.617945 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:35:32.617945 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:35:32.619131 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:35:32.619131 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:32.619131 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:32.619131 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:32.619131 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:32.619131 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:32.619131 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:32.619131 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:32.619131 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:32.619131 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:32.619131 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:32.619131 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:32.619131 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:32.619131 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:32.619131 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:32.619131 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:32.619131 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:32.620973 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:35:32.620973 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:35:32.620973 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:35:32.620973 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:35:32.620973 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:35:32.620973 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:35:32.620973 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:35:32.620973 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:32.624471 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 322/642] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:35:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:32.625380 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d23e6-5a93-4b0f-8fc4-d0ced10e9aa0 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:32.647704 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:32.667369 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 321/643] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:35:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:35:32.668525 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c2cbb-5902-4ed2-ad59-dcd40d4e5e94 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:32.742611 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:32.779238 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d23e6-5a93-4b0f-8fc4-d0ced10e9aa0 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:32.804460 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c2cbb-5902-4ed2-ad59-dcd40d4e5e94 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:32.831299 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621274f-130b-4fce-a715-16f0badbffb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:32.832070 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621274f-130b-4fce-a715-16f0badbffb1 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:32.832409 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621274f-130b-4fce-a715-16f0badbffb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:32.832744 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0621274f-130b-4fce-a715-16f0badbffb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:32.850324 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0621274f-130b-4fce-a715-16f0badbffb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:32.851888 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0621274f-130b-4fce-a715-16f0badbffb1 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:32.853219 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86740894-7aa9-4833-84b8-1a4b9b6f6dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:32.854097 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86740894-7aa9-4833-84b8-1a4b9b6f6dd0 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:32.854561 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86740894-7aa9-4833-84b8-1a4b9b6f6dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:32.855022 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86740894-7aa9-4833-84b8-1a4b9b6f6dd0 None admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:32.855883 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86740894-7aa9-4833-84b8-1a4b9b6f6dd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:32.856447 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86740894-7aa9-4833-84b8-1a4b9b6f6dd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:32.858230 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86740894-7aa9-4833-84b8-1a4b9b6f6dd0 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:32.870198 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-0621274f-130b-4fce-a715-16f0badbffb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:32.870198 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:32.870198 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:32.870198 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:32.870198 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:32.870198 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:32.870198 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:32.870198 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:32.870198 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:32.870198 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:32.870198 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:32.870198 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:32.870198 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:32.870198 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:32.870198 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:32.870198 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:32.871240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:32.871240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:32.871240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:32.871240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:32.871240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:32.871240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:32.871240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:32.871240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:32.871240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:32.871240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:32.871240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:32.871240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:32.871240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:32.871240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:32.871240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:32.871240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:32.871240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:32.872869 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:32.872869 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:32.872869 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:32.872869 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 323/644] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:32.872869 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621274f-130b-4fce-a715-16f0badbffb1 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:32.879176 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 322/645] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:32.880645 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86740894-7aa9-4833-84b8-1a4b9b6f6dd0 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:32.965552 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:32.995625 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86740894-7aa9-4833-84b8-1a4b9b6f6dd0 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:33.003372 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0621274f-130b-4fce-a715-16f0badbffb1 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:33.009314 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:33.043531 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc91a4-9aa6-4b88-9dc3-9102de2d78f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:33.044058 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc91a4-9aa6-4b88-9dc3-9102de2d78f5 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:33.044340 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc91a4-9aa6-4b88-9dc3-9102de2d78f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:33.044614 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc91a4-9aa6-4b88-9dc3-9102de2d78f5 None admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:33.045264 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc91a4-9aa6-4b88-9dc3-9102de2d78f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:33.045631 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc91a4-9aa6-4b88-9dc3-9102de2d78f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:33.046994 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc91a4-9aa6-4b88-9dc3-9102de2d78f5 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:33.060999 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30936834-cee8-4475-b670-0936e89bff93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:33.061644 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30936834-cee8-4475-b670-0936e89bff93 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:33.061918 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30936834-cee8-4475-b670-0936e89bff93 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:33.069577 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30936834-cee8-4475-b670-0936e89bff93 None admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:33.069865 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 323/646] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:33.070048 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30936834-cee8-4475-b670-0936e89bff93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:33.070048 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30936834-cee8-4475-b670-0936e89bff93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:33.070332 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc91a4-9aa6-4b88-9dc3-9102de2d78f5 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:33.070483 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30936834-cee8-4475-b670-0936e89bff93 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:33.085059 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 324/647] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 8 13:35:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:33.085834 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30936834-cee8-4475-b670-0936e89bff93 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:33.190761 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc91a4-9aa6-4b88-9dc3-9102de2d78f5 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:33.197173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30936834-cee8-4475-b670-0936e89bff93 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:33.230318 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:33.230675 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b4275-7709-4bf6-9eda-6cdcb7dee70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:33.231312 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b4275-7709-4bf6-9eda-6cdcb7dee70e None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:33.231585 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b4275-7709-4bf6-9eda-6cdcb7dee70e None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:33.231852 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b4275-7709-4bf6-9eda-6cdcb7dee70e None admin] PATH_INFO: `/v3/users/glance` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:33.238499 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c25bd-b9a2-4a23-8053-849fa0597b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:33.239452 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c25bd-b9a2-4a23-8053-849fa0597b24 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:33.240083 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c25bd-b9a2-4a23-8053-849fa0597b24 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:33.240538 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c25bd-b9a2-4a23-8053-849fa0597b24 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:33.242382 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57b4275-7709-4bf6-9eda-6cdcb7dee70e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:33.243839 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57b4275-7709-4bf6-9eda-6cdcb7dee70e None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:33.252893 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001c25bd-b9a2-4a23-8053-849fa0597b24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:35:33.258650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-001c25bd-b9a2-4a23-8053-849fa0597b24 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:35:33.258650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:33.258650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:33.258650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:33.258650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:33.258650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:33.258650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:33.258650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:33.258650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:33.258650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:33.258650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:33.258650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:33.258650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:35:33.258650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:35:33.258650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:35:33.258650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:35:33.259629 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:35:33.259629 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:35:33.259629 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:35:33.259629 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:35:33.259629 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:33.259629 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:33.259629 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:33.259629 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:33.259629 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:33.259629 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:33.259629 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:33.259629 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:33.259629 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:33.259629 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:33.259629 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:33.259629 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:33.262526 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:33.262526 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:33.262526 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:33.262526 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:33.262526 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:35:33.262526 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:35:33.262526 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:35:33.262526 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:35:33.262526 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:35:33.262526 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:35:33.262526 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:35:33.262526 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:33.262526 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 325/648] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Sep 8 13:35:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:33.262526 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c25bd-b9a2-4a23-8053-849fa0597b24 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:33.263356 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-f57b4275-7709-4bf6-9eda-6cdcb7dee70e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 08 13:35:33.263356 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:33.263356 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:33.263356 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:33.263356 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:33.263356 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:33.263356 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:33.263356 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:33.263356 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:33.263356 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:33.263356 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:33.263356 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:33.263356 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:35:33.263356 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:35:33.263356 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:35:33.263356 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:35:33.264308 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:33.264308 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:33.264308 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:35:33.264308 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:35:33.264308 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:35:33.264308 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:35:33.264308 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:33.264308 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:33.264308 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:33.264308 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:33.264308 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:33.264308 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:33.264308 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:33.264308 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:33.264308 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:33.264308 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:33.264308 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:33.264308 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:33.265704 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:33.265704 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:33.265704 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:35:33.265704 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:35:33.265704 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:35:33.265704 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:35:33.265704 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:35:33.265704 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:35:33.265704 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 08 13:35:33.265704 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:33.267379 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 324/649] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:35:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:33.268114 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b4275-7709-4bf6-9eda-6cdcb7dee70e None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:33.301898 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:33.391278 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c25bd-b9a2-4a23-8053-849fa0597b24 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:33.398526 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b4275-7709-4bf6-9eda-6cdcb7dee70e None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:33.431526 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ddcd31-71d3-42e1-b057-4c7b188731d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:33.432507 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddcd31-71d3-42e1-b057-4c7b188731d7 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:33.432945 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddcd31-71d3-42e1-b057-4c7b188731d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:33.433509 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddcd31-71d3-42e1-b057-4c7b188731d7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:33.443905 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ddcd31-71d3-42e1-b057-4c7b188731d7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:33.445559 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ddcd31-71d3-42e1-b057-4c7b188731d7 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:33.453932 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1c32a-63ae-4ed7-a1f2-7e769ccc6971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:33.454488 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1c32a-63ae-4ed7-a1f2-7e769ccc6971 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:33.454863 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1c32a-63ae-4ed7-a1f2-7e769ccc6971 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:33.455246 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1c32a-63ae-4ed7-a1f2-7e769ccc6971 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:33.456061 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1c32a-63ae-4ed7-a1f2-7e769ccc6971 None admin] RBAC: Adding query filter params (role.id=e5f27e532c9d4bc7a57e31856ecee597, scope.project.id=88de9f1470c6415b97866ad5a3256ef2, user.id=c95448c1b8b1466cae37fda5c713d53f) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:33.456375 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1c32a-63ae-4ed7-a1f2-7e769ccc6971 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:33.457909 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1c32a-63ae-4ed7-a1f2-7e769ccc6971 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:33.461096 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-41ddcd31-71d3-42e1-b057-4c7b188731d7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 08 13:35:33.461096 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:33.461096 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:33.461096 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:33.461096 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:33.461096 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:33.461096 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:33.461096 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:33.461096 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:33.461096 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:33.461096 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:33.461096 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:33.461096 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:35:33.461096 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:35:33.461096 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:35:33.461096 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:35:33.462363 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:33.462363 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:33.462363 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:35:33.462363 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:35:33.462363 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:35:33.462363 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:35:33.462363 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:33.462363 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:33.462363 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:33.462363 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:33.462363 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:33.462363 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:33.462363 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:33.462363 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:33.462363 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:33.462363 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:33.462363 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:33.462363 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:33.463322 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:33.463322 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:33.463322 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:35:33.463322 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:35:33.463322 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:35:33.463322 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:35:33.463322 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:35:33.463322 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:35:33.463322 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 08 13:35:33.463322 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:33.463322 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 326/650] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:35:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:33.463322 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ddcd31-71d3-42e1-b057-4c7b188731d7 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:33.471284 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 325/651] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 8 13:35:33 2022] GET /identity/v3/role_assignments?user.id=c95448c1b8b1466cae37fda5c713d53f&scope.project.id=88de9f1470c6415b97866ad5a3256ef2&role.id=e5f27e532c9d4bc7a57e31856ecee597 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:33.472997 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1c32a-63ae-4ed7-a1f2-7e769ccc6971 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:33.559529 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:33.617933 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:33.629260 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1c32a-63ae-4ed7-a1f2-7e769ccc6971 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:33.641888 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ddcd31-71d3-42e1-b057-4c7b188731d7 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:33.671640 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efccbe95-1884-4c13-91c4-2a36580b5d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:33.672413 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccbe95-1884-4c13-91c4-2a36580b5d12 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:33.673129 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccbe95-1884-4c13-91c4-2a36580b5d12 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:33.673309 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccbe95-1884-4c13-91c4-2a36580b5d12 None admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:33.674062 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efccbe95-1884-4c13-91c4-2a36580b5d12 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:33.675080 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efccbe95-1884-4c13-91c4-2a36580b5d12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:33.675860 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efccbe95-1884-4c13-91c4-2a36580b5d12 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:33.691270 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28355b-ef89-4253-88c5-372f02a5e69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:33.692324 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28355b-ef89-4253-88c5-372f02a5e69e None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:33.692857 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28355b-ef89-4253-88c5-372f02a5e69e None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:33.693409 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28355b-ef89-4253-88c5-372f02a5e69e None admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:33.694293 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb28355b-ef89-4253-88c5-372f02a5e69e None admin] RBAC: Adding query filter params (name=service) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:33.694803 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb28355b-ef89-4253-88c5-372f02a5e69e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:33.696152 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 326/652] 10.222.0.69 () {56 vars in 1137 bytes} [Thu Sep 8 13:35:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:33.696679 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb28355b-ef89-4253-88c5-372f02a5e69e None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:33.697001 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efccbe95-1884-4c13-91c4-2a36580b5d12 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:33.707621 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 327/653] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Sep 8 13:35:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:33.709351 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28355b-ef89-4253-88c5-372f02a5e69e None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:33.824533 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efccbe95-1884-4c13-91c4-2a36580b5d12 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:33.831776 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28355b-ef89-4253-88c5-372f02a5e69e None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:33.847217 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:33.866240 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58821d1e-230e-4225-b2d1-6dea819b8709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:33.866812 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58821d1e-230e-4225-b2d1-6dea819b8709 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:33.867098 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58821d1e-230e-4225-b2d1-6dea819b8709 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:33.867372 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58821d1e-230e-4225-b2d1-6dea819b8709 None admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:33.868107 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58821d1e-230e-4225-b2d1-6dea819b8709 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:33.868446 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58821d1e-230e-4225-b2d1-6dea819b8709 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:33.869932 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58821d1e-230e-4225-b2d1-6dea819b8709 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:33.875463 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f80ac1b-2896-4db4-864b-f83517d390e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:33.876403 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f80ac1b-2896-4db4-864b-f83517d390e3 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:33.876903 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f80ac1b-2896-4db4-864b-f83517d390e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:33.877250 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f80ac1b-2896-4db4-864b-f83517d390e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:33.889125 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 327/654] 10.222.0.69 () {56 vars in 1137 bytes} [Thu Sep 8 13:35:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:33.890340 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58821d1e-230e-4225-b2d1-6dea819b8709 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:33.903846 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:33.963482 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f80ac1b-2896-4db4-864b-f83517d390e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:33.964925 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f80ac1b-2896-4db4-864b-f83517d390e3 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:34.006513 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58821d1e-230e-4225-b2d1-6dea819b8709 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:34.043854 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec0b79-9692-4db7-8a2d-fc77044f1654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:34.044485 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec0b79-9692-4db7-8a2d-fc77044f1654 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:34.044771 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec0b79-9692-4db7-8a2d-fc77044f1654 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:34.045044 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec0b79-9692-4db7-8a2d-fc77044f1654 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:34.056243 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec0b79-9692-4db7-8a2d-fc77044f1654 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:34.057734 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddec0b79-9692-4db7-8a2d-fc77044f1654 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:34.074005 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-ddec0b79-9692-4db7-8a2d-fc77044f1654 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:34.074005 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:34.074005 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:34.074005 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:34.074005 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:34.074005 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:34.074005 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:34.074005 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:34.074005 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:34.074005 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:34.074005 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:34.074005 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:34.074005 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:34.074005 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:34.074005 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:34.074005 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:34.075089 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:34.075089 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:34.075089 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:34.075089 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:34.075089 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:34.075089 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:34.075089 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:34.075089 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:34.075089 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:34.075089 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:34.075089 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:34.075089 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:34.075089 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:34.075089 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:34.075089 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:34.075089 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:34.075089 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:34.076152 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:34.076152 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:34.076152 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:34.076343 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 328/655] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:35:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:35:34.076524 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590a933-370e-4af0-889c-6b68ae245dbc None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:34.077009 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590a933-370e-4af0-889c-6b68ae245dbc None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:34.077174 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590a933-370e-4af0-889c-6b68ae245dbc None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:34.078886 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 329/656] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:35:34.083678 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 328/657] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:34.083678 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec0b79-9692-4db7-8a2d-fc77044f1654 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:34.084773 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e590a933-370e-4af0-889c-6b68ae245dbc None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:34.101027 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:34.165076 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:34.208660 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e590a933-370e-4af0-889c-6b68ae245dbc None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:34.216058 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddec0b79-9692-4db7-8a2d-fc77044f1654 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:34.244808 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e0f6b-d27b-4044-a106-7d5901a9b932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:34.245450 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e0f6b-d27b-4044-a106-7d5901a9b932 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:34.245731 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e0f6b-d27b-4044-a106-7d5901a9b932 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:34.246002 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e0f6b-d27b-4044-a106-7d5901a9b932 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:34.261286 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9335f27-ef34-493d-99a6-6a59cd09113d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:34.261954 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9335f27-ef34-493d-99a6-6a59cd09113d None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:34.262234 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9335f27-ef34-493d-99a6-6a59cd09113d None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:34.262505 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9335f27-ef34-493d-99a6-6a59cd09113d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:34.278905 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9335f27-ef34-493d-99a6-6a59cd09113d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:34.280362 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9335f27-ef34-493d-99a6-6a59cd09113d None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:34.297756 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-e9335f27-ef34-493d-99a6-6a59cd09113d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:34.297756 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:34.297756 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:34.297756 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:34.297756 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:34.297756 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:34.297756 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:34.297756 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:34.297756 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:34.297756 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:34.297756 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:34.297756 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:34.297756 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:34.297756 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:34.297756 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:34.297756 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:34.298770 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:34.298770 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:34.298770 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:34.298770 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:34.298770 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:34.298770 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:34.298770 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:34.298770 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:34.298770 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:34.298770 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:34.298770 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:34.298770 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:34.298770 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:34.298770 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:34.298770 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:34.298770 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:34.298770 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:34.299674 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:34.299674 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:34.299674 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:34.299674 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 329/658] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:34.300228 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965682b-d3b8-4dca-8533-83abbc8b788b None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:34.300372 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965682b-d3b8-4dca-8533-83abbc8b788b None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:34.300645 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965682b-d3b8-4dca-8533-83abbc8b788b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:34.324255 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-c965682b-d3b8-4dca-8533-83abbc8b788b None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:35:34.326208 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-c965682b-d3b8-4dca-8533-83abbc8b788b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:35:34.345664 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e0f6b-d27b-4044-a106-7d5901a9b932 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:34.347030 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e0f6b-d27b-4044-a106-7d5901a9b932 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:34.362558 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:34.409632 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 330/659] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:35:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:35:34.409632 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965682b-d3b8-4dca-8533-83abbc8b788b None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:34.468466 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 330/660] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:35:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:35:34.469467 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e0f6b-d27b-4044-a106-7d5901a9b932 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:34.475932 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:34.546904 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965682b-d3b8-4dca-8533-83abbc8b788b None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:34.597179 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373cf245-d7e1-46dc-948a-e8fa2b4ed15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:34.598796 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cf245-d7e1-46dc-948a-e8fa2b4ed15f None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:34.599504 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cf245-d7e1-46dc-948a-e8fa2b4ed15f None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:34.599934 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373cf245-d7e1-46dc-948a-e8fa2b4ed15f None admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:34.601013 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373cf245-d7e1-46dc-948a-e8fa2b4ed15f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:34.601916 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373cf245-d7e1-46dc-948a-e8fa2b4ed15f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:34.604007 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373cf245-d7e1-46dc-948a-e8fa2b4ed15f None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:34.608119 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e0f6b-d27b-4044-a106-7d5901a9b932 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:34.619736 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 331/661] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:34.621717 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373cf245-d7e1-46dc-948a-e8fa2b4ed15f None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:34.625387 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:34.656018 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05adaca-5b26-4ec9-9d92-c1ad570fd0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:34.656664 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05adaca-5b26-4ec9-9d92-c1ad570fd0f1 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:34.657053 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05adaca-5b26-4ec9-9d92-c1ad570fd0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:34.657475 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05adaca-5b26-4ec9-9d92-c1ad570fd0f1 None admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:34.658163 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05adaca-5b26-4ec9-9d92-c1ad570fd0f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:34.658466 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05adaca-5b26-4ec9-9d92-c1ad570fd0f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:34.660099 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05adaca-5b26-4ec9-9d92-c1ad570fd0f1 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:34.679203 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 331/662] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:34.679203 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05adaca-5b26-4ec9-9d92-c1ad570fd0f1 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:34.760335 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373cf245-d7e1-46dc-948a-e8fa2b4ed15f None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:34.761946 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:34.801846 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b97b1-cfbe-48f5-9e48-155d62120e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:34.802639 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b97b1-cfbe-48f5-9e48-155d62120e0d None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:34.802782 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b97b1-cfbe-48f5-9e48-155d62120e0d None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:34.803233 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b97b1-cfbe-48f5-9e48-155d62120e0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:34.811748 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05adaca-5b26-4ec9-9d92-c1ad570fd0f1 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:34.815621 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b97b1-cfbe-48f5-9e48-155d62120e0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:34.817096 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b97b1-cfbe-48f5-9e48-155d62120e0d None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:34.835388 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-a01b97b1-cfbe-48f5-9e48-155d62120e0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:34.835388 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:34.835388 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:34.835388 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:34.835388 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:34.835388 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:34.835388 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:34.835388 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:34.835388 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:34.835388 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:34.835388 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:34.835388 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:34.835388 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:34.835388 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:34.835388 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:34.835388 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:34.836776 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:34.836776 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:34.836776 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:34.836776 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:34.836776 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:34.836776 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:34.836776 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:34.836776 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:34.836776 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:34.836776 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:34.836776 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:34.836776 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:34.836776 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:34.836776 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:34.836776 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:34.836776 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:34.836776 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:34.838820 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:34.838820 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:34.838820 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:34.838820 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 332/663] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:34.838820 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b97b1-cfbe-48f5-9e48-155d62120e0d None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:34.867023 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3dfd3d-757b-4275-886a-3ac3df65ebd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:34.867412 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3dfd3d-757b-4275-886a-3ac3df65ebd2 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:34.867694 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3dfd3d-757b-4275-886a-3ac3df65ebd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:34.867968 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3dfd3d-757b-4275-886a-3ac3df65ebd2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:34.877176 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3dfd3d-757b-4275-886a-3ac3df65ebd2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:34.879031 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3dfd3d-757b-4275-886a-3ac3df65ebd2 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:34.893307 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-ef3dfd3d-757b-4275-886a-3ac3df65ebd2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 08 13:35:34.893307 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:34.893307 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:34.893307 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:34.893307 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:34.893307 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:34.893307 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:34.893307 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:34.893307 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:34.893307 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:34.893307 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:34.893307 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:34.893307 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:35:34.893307 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:35:34.893307 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:35:34.893307 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:35:34.894610 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:34.894610 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:34.894610 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:35:34.894610 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:35:34.894610 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:35:34.894610 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:35:34.894610 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:34.894610 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:34.894610 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:34.894610 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:34.894610 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:34.894610 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:34.894610 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:34.894610 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:34.894610 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:34.894610 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:34.894610 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:34.894610 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:34.895784 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:34.895784 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:34.895784 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:35:34.895784 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:35:34.895784 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:35:34.895784 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:35:34.895784 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:35:34.895784 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:35:34.895784 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 08 13:35:34.895784 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:34.899119 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 332/664] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Sep 8 13:35:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:34.900022 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3dfd3d-757b-4275-886a-3ac3df65ebd2 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:34.932467 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:34.959472 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b97b1-cfbe-48f5-9e48-155d62120e0d None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:35.000019 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3f0d3-a340-4e58-854f-ae907f25b99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:35.000652 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3f0d3-a340-4e58-854f-ae907f25b99c None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:35.000929 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3f0d3-a340-4e58-854f-ae907f25b99c None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:35.001192 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3f0d3-a340-4e58-854f-ae907f25b99c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:35.009043 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab3f0d3-a340-4e58-854f-ae907f25b99c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:35.010519 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab3f0d3-a340-4e58-854f-ae907f25b99c None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:35.011427 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3dfd3d-757b-4275-886a-3ac3df65ebd2 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:35.022458 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-fab3f0d3-a340-4e58-854f-ae907f25b99c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:35:35.022458 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:35.022458 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:35.022458 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:35.022458 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:35.022458 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:35.022458 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:35.022458 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:35.022458 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:35.022458 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:35.022458 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:35.022458 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:35.022458 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:35:35.022458 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:35:35.022458 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:35:35.023599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:35:35.023599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:35.023599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:35.023599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:35.023599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:35.023599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:35.023599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:35.023599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:35.023599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:35.023599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:35.023599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:35.023599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:35.023599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:35.023599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:35.023599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:35.023599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:35.023599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:35.024526 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:35:35.024526 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:35:35.024526 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:35:35.024526 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:35:35.024526 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:35:35.024526 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:35:35.024526 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:35:35.024526 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:35.024526 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 333/665] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:35:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:35.024526 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3f0d3-a340-4e58-854f-ae907f25b99c None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:35.041804 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:35.056414 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b9e4a-7523-4b7d-8795-4f98274e7647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:35.057037 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b9e4a-7523-4b7d-8795-4f98274e7647 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:35.057313 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b9e4a-7523-4b7d-8795-4f98274e7647 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:35.057612 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b9e4a-7523-4b7d-8795-4f98274e7647 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:35.069730 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b9e4a-7523-4b7d-8795-4f98274e7647 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:35:35.074897 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-733b9e4a-7523-4b7d-8795-4f98274e7647 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:35:35.074897 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:35.074897 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:35.074897 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:35.074897 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:35.074897 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:35.074897 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:35.074897 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:35.074897 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:35.074897 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:35.074897 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:35.074897 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:35.074897 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:35:35.074897 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:35:35.074897 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:35:35.074897 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:35:35.075843 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:35:35.075843 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:35:35.075843 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:35:35.075843 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:35:35.075843 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:35.075843 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:35.075843 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:35.075843 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:35.075843 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:35.075843 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:35.075843 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:35.075843 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:35.075843 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:35.075843 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:35.075843 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:35.075843 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:35.076758 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:35.076758 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:35.076758 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:35.076758 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:35.076758 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:35:35.076758 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:35:35.076758 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:35:35.076758 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:35:35.076758 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:35:35.076758 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:35:35.076758 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:35:35.076758 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:35.076758 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 333/666] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Sep 8 13:35:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:35.077524 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b9e4a-7523-4b7d-8795-4f98274e7647 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:35.152782 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3f0d3-a340-4e58-854f-ae907f25b99c None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:35.185037 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:35.193623 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e1c75-6722-4e7f-920a-355105350f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:35.194231 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e1c75-6722-4e7f-920a-355105350f11 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:35.194507 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e1c75-6722-4e7f-920a-355105350f11 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:35.194780 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e1c75-6722-4e7f-920a-355105350f11 None admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:35.195425 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9e1c75-6722-4e7f-920a-355105350f11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:35.195723 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9e1c75-6722-4e7f-920a-355105350f11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:35.196842 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b9e4a-7523-4b7d-8795-4f98274e7647 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:35.197082 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9e1c75-6722-4e7f-920a-355105350f11 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:35.210498 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 334/667] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:35.215583 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e1c75-6722-4e7f-920a-355105350f11 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:35.233676 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75230c-c1ef-4efa-abba-30febd6833d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:35.234270 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75230c-c1ef-4efa-abba-30febd6833d2 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:35.234535 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75230c-c1ef-4efa-abba-30febd6833d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:35.234810 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75230c-c1ef-4efa-abba-30febd6833d2 None admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:35.235528 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75230c-c1ef-4efa-abba-30febd6833d2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:35.236111 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75230c-c1ef-4efa-abba-30febd6833d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:35.237552 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75230c-c1ef-4efa-abba-30febd6833d2 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:35.261468 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 334/668] 10.222.0.69 () {56 vars in 1139 bytes} [Thu Sep 8 13:35:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:35.262646 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75230c-c1ef-4efa-abba-30febd6833d2 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:35.308488 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:35.338298 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e1c75-6722-4e7f-920a-355105350f11 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:35.374833 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7764d0-2486-41bd-8418-da37e223ceac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:35.375084 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75230c-c1ef-4efa-abba-30febd6833d2 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:35.375442 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7764d0-2486-41bd-8418-da37e223ceac None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:35.375769 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7764d0-2486-41bd-8418-da37e223ceac None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:35.375990 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7764d0-2486-41bd-8418-da37e223ceac None admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:35.376864 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7764d0-2486-41bd-8418-da37e223ceac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:35.377167 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7764d0-2486-41bd-8418-da37e223ceac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:35.379443 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7764d0-2486-41bd-8418-da37e223ceac None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:35.398594 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 335/669] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 8 13:35:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:35.398594 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7764d0-2486-41bd-8418-da37e223ceac None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:35.413018 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492b008-1fef-415c-abd2-3eee75098632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:35.413567 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492b008-1fef-415c-abd2-3eee75098632 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:35.413852 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492b008-1fef-415c-abd2-3eee75098632 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:35.414123 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492b008-1fef-415c-abd2-3eee75098632 None admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:35.414794 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0492b008-1fef-415c-abd2-3eee75098632 None admin] RBAC: Adding query filter params (name=service) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:35.415098 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0492b008-1fef-415c-abd2-3eee75098632 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:35.416459 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0492b008-1fef-415c-abd2-3eee75098632 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:35.435325 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 335/670] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Sep 8 13:35:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:35.436344 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492b008-1fef-415c-abd2-3eee75098632 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:35.454218 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:35.520433 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7764d0-2486-41bd-8418-da37e223ceac None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:35.550231 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492b008-1fef-415c-abd2-3eee75098632 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:35.560863 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9da2b5-2e53-4d60-8bf8-8cf457e3d1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:35.561847 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9da2b5-2e53-4d60-8bf8-8cf457e3d1b4 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:35.562338 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9da2b5-2e53-4d60-8bf8-8cf457e3d1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:35.562816 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9da2b5-2e53-4d60-8bf8-8cf457e3d1b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:35.565717 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:35.573341 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9da2b5-2e53-4d60-8bf8-8cf457e3d1b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:35.575754 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9da2b5-2e53-4d60-8bf8-8cf457e3d1b4 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:35.587704 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b99e5-dd6d-4606-9713-88abf79061af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:35.588360 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-cc9da2b5-2e53-4d60-8bf8-8cf457e3d1b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:35:35.588360 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:35.588360 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:35.588360 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:35.588360 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:35.588360 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:35.588360 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:35.588360 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:35.588360 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:35.588360 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:35.588360 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:35.588360 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:35.588360 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:35:35.588360 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:35:35.588360 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:35:35.594718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:35:35.594718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:35.594718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:35.594718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:35.594718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:35.594718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:35.594718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:35.594718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:35.594718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:35.594718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:35.594718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:35.594718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:35.594718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:35.594718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:35.594718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:35.594718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:35.594718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:35.595794 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:35:35.595794 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:35:35.595794 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:35:35.595794 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:35:35.595794 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:35:35.595794 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:35:35.595794 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:35:35.595794 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:35.596239 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b99e5-dd6d-4606-9713-88abf79061af None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:35.596313 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 336/671] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:35:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:35.596402 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b99e5-dd6d-4606-9713-88abf79061af None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:35.596402 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b99e5-dd6d-4606-9713-88abf79061af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:35.596535 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9da2b5-2e53-4d60-8bf8-8cf457e3d1b4 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:35.667392 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b99e5-dd6d-4606-9713-88abf79061af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:35.668832 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b99e5-dd6d-4606-9713-88abf79061af None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:35.684255 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:35.713392 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9da2b5-2e53-4d60-8bf8-8cf457e3d1b4 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:35.744509 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04339ae3-dea1-41a2-a75b-0e17aea877aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:35.745180 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04339ae3-dea1-41a2-a75b-0e17aea877aa None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:35.745388 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04339ae3-dea1-41a2-a75b-0e17aea877aa None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:35.745680 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04339ae3-dea1-41a2-a75b-0e17aea877aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:35.746406 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04339ae3-dea1-41a2-a75b-0e17aea877aa None admin] RBAC: Adding query filter params (role.id=e5f27e532c9d4bc7a57e31856ecee597, scope.project.id=88de9f1470c6415b97866ad5a3256ef2, user.id=6677b4518c094636bc8ed7b588103390) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:35.746712 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04339ae3-dea1-41a2-a75b-0e17aea877aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:35.748300 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04339ae3-dea1-41a2-a75b-0e17aea877aa None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:35.754444 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 337/672] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 8 13:35:35 2022] GET /identity/v3/role_assignments?user.id=6677b4518c094636bc8ed7b588103390&scope.project.id=88de9f1470c6415b97866ad5a3256ef2&role.id=e5f27e532c9d4bc7a57e31856ecee597 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:35.755785 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04339ae3-dea1-41a2-a75b-0e17aea877aa None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:35.818442 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 336/673] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:35:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:35:35.819644 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b99e5-dd6d-4606-9713-88abf79061af None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:35.836418 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:35.885935 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04339ae3-dea1-41a2-a75b-0e17aea877aa None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:35.927931 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f5265-73aa-4253-8131-d40301d801bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:35.928495 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f5265-73aa-4253-8131-d40301d801bb None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:35.928843 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f5265-73aa-4253-8131-d40301d801bb None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:35.929051 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f5265-73aa-4253-8131-d40301d801bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:35.939781 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b99e5-dd6d-4606-9713-88abf79061af None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:35.941189 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f5265-73aa-4253-8131-d40301d801bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:35.943774 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141f5265-73aa-4253-8131-d40301d801bb None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:35.956186 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:35.959980 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-141f5265-73aa-4253-8131-d40301d801bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:35.959980 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:35.959980 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:35.959980 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:35.959980 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:35.959980 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:35.959980 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:35.959980 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:35.959980 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:35.959980 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:35.959980 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:35.959980 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:35.959980 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:35.959980 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:35.959980 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:35.959980 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:35.961058 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:35.961058 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:35.961058 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:35.961058 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:35.961058 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:35.961058 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:35.961058 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:35.961058 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:35.961058 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:35.961058 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:35.961058 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:35.961058 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:35.961058 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:35.961058 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:35.961058 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:35.961058 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:35.961058 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:35.962184 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:35.962184 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:35.962184 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:35.962184 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 338/674] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:35.964111 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f5265-73aa-4253-8131-d40301d801bb None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:35.983911 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c990ad2-a896-4158-96ef-7032da850436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:35.984680 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c990ad2-a896-4158-96ef-7032da850436 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:35.985058 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c990ad2-a896-4158-96ef-7032da850436 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:35.985539 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c990ad2-a896-4158-96ef-7032da850436 None admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:35.986338 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c990ad2-a896-4158-96ef-7032da850436 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:35.986637 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c990ad2-a896-4158-96ef-7032da850436 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:35.988078 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c990ad2-a896-4158-96ef-7032da850436 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:36.001888 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 337/675] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 8 13:35:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:36.004212 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03619fd8-a8a2-473b-9eb9-2397c0af8943 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:36.004616 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03619fd8-a8a2-473b-9eb9-2397c0af8943 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:36.005763 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03619fd8-a8a2-473b-9eb9-2397c0af8943 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:36.007735 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 338/676] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:35:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:35:36.008605 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03619fd8-a8a2-473b-9eb9-2397c0af8943 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:36.088849 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141f5265-73aa-4253-8131-d40301d801bb None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:36.101270 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:36.128625 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03619fd8-a8a2-473b-9eb9-2397c0af8943 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:36.133254 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86643b04-b0df-45de-9c7d-3cf0baa8eb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:36.133984 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86643b04-b0df-45de-9c7d-3cf0baa8eb0e None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:36.134324 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86643b04-b0df-45de-9c7d-3cf0baa8eb0e None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:36.134599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86643b04-b0df-45de-9c7d-3cf0baa8eb0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:36.147111 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86643b04-b0df-45de-9c7d-3cf0baa8eb0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:36.148773 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86643b04-b0df-45de-9c7d-3cf0baa8eb0e None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:36.166581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-86643b04-b0df-45de-9c7d-3cf0baa8eb0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:36.166581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:36.166581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:36.166581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:36.166581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:36.166581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:36.166581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:36.166581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:36.166581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:36.166581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:36.166581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:36.166581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:36.166581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:36.166581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:36.166581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:36.166581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:36.167765 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:36.167765 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:36.167765 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:36.167765 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:36.167765 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:36.167765 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:36.167765 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:36.167765 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:36.167765 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:36.167765 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:36.167765 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:36.167765 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:36.167765 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:36.167765 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:36.167765 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:36.167765 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:36.167765 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:36.168869 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:36.168869 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:36.168869 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:36.169076 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6f898-de43-45ac-80cb-bfe07e7cca9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:36.169076 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6f898-de43-45ac-80cb-bfe07e7cca9d None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:36.169076 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6f898-de43-45ac-80cb-bfe07e7cca9d None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:36.169076 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6f898-de43-45ac-80cb-bfe07e7cca9d None admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:36.169397 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d6f898-de43-45ac-80cb-bfe07e7cca9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:36.169397 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d6f898-de43-45ac-80cb-bfe07e7cca9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:36.170352 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d6f898-de43-45ac-80cb-bfe07e7cca9d None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:36.171268 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 339/677] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:36.172569 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86643b04-b0df-45de-9c7d-3cf0baa8eb0e None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:36.185510 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 339/678] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:36.187146 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa3380-f3ad-48a5-8abd-2716b69e87be None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:36.187573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa3380-f3ad-48a5-8abd-2716b69e87be None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:36.188017 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa3380-f3ad-48a5-8abd-2716b69e87be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:36.208597 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-31fa3380-f3ad-48a5-8abd-2716b69e87be None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:35:36.209664 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-31fa3380-f3ad-48a5-8abd-2716b69e87be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:35:36.238146 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:36.297854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 340/679] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:35:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:35:36.297854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa3380-f3ad-48a5-8abd-2716b69e87be None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:36.309075 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86643b04-b0df-45de-9c7d-3cf0baa8eb0e None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:36.354056 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64ae9b-a823-4a98-bf01-9c65d35fe9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:36.354918 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64ae9b-a823-4a98-bf01-9c65d35fe9ba None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:36.355347 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64ae9b-a823-4a98-bf01-9c65d35fe9ba None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:36.355769 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64ae9b-a823-4a98-bf01-9c65d35fe9ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:36.357101 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a64ae9b-a823-4a98-bf01-9c65d35fe9ba None admin] RBAC: Adding query filter params (role.id=e5f27e532c9d4bc7a57e31856ecee597, scope.project.id=88de9f1470c6415b97866ad5a3256ef2, user.id=d311099f51484141bd8504184b818ee8) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:36.357101 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a64ae9b-a823-4a98-bf01-9c65d35fe9ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:36.358600 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a64ae9b-a823-4a98-bf01-9c65d35fe9ba None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:36.366594 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 340/680] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 8 13:35:36 2022] GET /identity/v3/role_assignments?user.id=d311099f51484141bd8504184b818ee8&scope.project.id=88de9f1470c6415b97866ad5a3256ef2&role.id=e5f27e532c9d4bc7a57e31856ecee597 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:36.367559 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64ae9b-a823-4a98-bf01-9c65d35fe9ba None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:36.413778 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:36.443879 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa3380-f3ad-48a5-8abd-2716b69e87be None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:36.525471 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf08f2c-ed22-4da5-bf35-0b8ee405b45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:36.526099 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf08f2c-ed22-4da5-bf35-0b8ee405b45f None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:36.526374 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf08f2c-ed22-4da5-bf35-0b8ee405b45f None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:36.526641 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf08f2c-ed22-4da5-bf35-0b8ee405b45f None admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:36.527358 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf08f2c-ed22-4da5-bf35-0b8ee405b45f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:36.527664 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf08f2c-ed22-4da5-bf35-0b8ee405b45f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:36.529150 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf08f2c-ed22-4da5-bf35-0b8ee405b45f None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:36.556946 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 341/681] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:36.563791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf08f2c-ed22-4da5-bf35-0b8ee405b45f None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:36.575733 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64ae9b-a823-4a98-bf01-9c65d35fe9ba None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:36.600805 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:36.636508 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3fb44-5e47-4833-984b-0ef171e747d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:36.637221 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3fb44-5e47-4833-984b-0ef171e747d6 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:36.637587 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3fb44-5e47-4833-984b-0ef171e747d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:36.637869 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3fb44-5e47-4833-984b-0ef171e747d6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:36.647719 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a3fb44-5e47-4833-984b-0ef171e747d6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:36.650037 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a3fb44-5e47-4833-984b-0ef171e747d6 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:36.665675 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-a1a3fb44-5e47-4833-984b-0ef171e747d6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 08 13:35:36.665675 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:36.665675 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:36.665675 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:36.665675 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:36.665675 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:36.665675 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:36.665675 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:36.665675 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:36.665675 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:36.665675 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:36.665675 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:36.665675 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:35:36.665675 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:35:36.665675 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:35:36.665675 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:35:36.666698 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:36.666698 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:36.666698 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:35:36.666698 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:35:36.666698 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:35:36.666698 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:35:36.666698 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:36.666698 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:36.666698 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:36.666698 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:36.666698 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:36.666698 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:36.666698 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:36.666698 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:36.666698 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:36.666698 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:36.666698 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:36.666698 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:36.667728 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:36.667728 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:36.667728 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:35:36.667728 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:35:36.667728 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:35:36.667728 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:35:36.667728 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:35:36.667728 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:35:36.667728 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 08 13:35:36.667728 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:36.667728 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 341/682] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 8 13:35:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:36.674730 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3fb44-5e47-4833-984b-0ef171e747d6 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:36.713403 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf08f2c-ed22-4da5-bf35-0b8ee405b45f None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:36.766937 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c580885-d363-48f5-98e9-46e5cba40042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:36.767854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c580885-d363-48f5-98e9-46e5cba40042 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:36.768174 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c580885-d363-48f5-98e9-46e5cba40042 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:36.768464 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c580885-d363-48f5-98e9-46e5cba40042 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:36.777023 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c580885-d363-48f5-98e9-46e5cba40042 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:36.778521 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c580885-d363-48f5-98e9-46e5cba40042 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:36.784193 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:36.799949 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-2c580885-d363-48f5-98e9-46e5cba40042 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:35:36.799949 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:36.799949 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:36.799949 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:36.799949 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:36.799949 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:36.799949 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:36.799949 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:36.799949 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:36.799949 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:36.799949 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:36.799949 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:36.799949 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:35:36.799949 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:35:36.799949 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:35:36.800919 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:35:36.800919 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:36.800919 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:36.800919 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:36.800919 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:36.800919 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:36.800919 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:36.800919 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:36.800919 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:36.800919 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:36.800919 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:36.800919 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:36.800919 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:36.800919 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:36.800919 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:36.800919 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:36.800919 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:36.802539 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:35:36.802539 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:35:36.802539 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:35:36.802539 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:35:36.802539 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:35:36.802539 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:35:36.802539 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:35:36.802539 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:36.803384 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 342/683] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:35:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:35:36.803937 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c580885-d363-48f5-98e9-46e5cba40042 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:36.805468 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3fb44-5e47-4833-984b-0ef171e747d6 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:36.857747 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c395b-7dc0-4d7f-8971-0a0748fdcd2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:36.858391 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c395b-7dc0-4d7f-8971-0a0748fdcd2d None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:36.858673 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c395b-7dc0-4d7f-8971-0a0748fdcd2d None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:36.858951 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c395b-7dc0-4d7f-8971-0a0748fdcd2d None admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:36.859692 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c395b-7dc0-4d7f-8971-0a0748fdcd2d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:36.860000 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c395b-7dc0-4d7f-8971-0a0748fdcd2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:36.862162 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c395b-7dc0-4d7f-8971-0a0748fdcd2d None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:36.887582 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 342/684] 10.222.0.69 () {56 vars in 1135 bytes} [Thu Sep 8 13:35:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:36.888850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c395b-7dc0-4d7f-8971-0a0748fdcd2d None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:36.914562 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:36.935637 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c580885-d363-48f5-98e9-46e5cba40042 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:36.973352 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1e407-0c0b-481d-8a91-a634be99c488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:36.974722 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1e407-0c0b-481d-8a91-a634be99c488 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:36.975199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1e407-0c0b-481d-8a91-a634be99c488 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:36.975683 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1e407-0c0b-481d-8a91-a634be99c488 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:36.987396 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1e407-0c0b-481d-8a91-a634be99c488 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:35:36.993669 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-44c1e407-0c0b-481d-8a91-a634be99c488 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:35:36.993669 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:36.993669 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:36.993669 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:36.993669 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:36.993669 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:36.993669 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:36.993669 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:36.993669 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:36.993669 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:36.993669 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:36.993669 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:36.993669 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:35:36.993669 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:35:36.993669 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:35:36.993669 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:35:36.994635 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:35:36.994635 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:35:36.994635 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:35:36.994635 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:35:36.994635 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:36.994635 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:36.994635 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:36.994635 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:36.994635 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:36.994635 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:36.994635 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:36.994635 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:36.994635 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:36.994635 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:36.994635 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:36.994635 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:36.995511 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:36.995511 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:36.995511 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:36.995511 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:36.995511 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:35:36.995511 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:35:36.995511 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:35:36.995511 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:35:36.995511 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:35:36.995511 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:35:36.995511 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:35:36.995511 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:36.998302 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 343/685] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 8 13:35:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:36.999347 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1e407-0c0b-481d-8a91-a634be99c488 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:37.018802 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c395b-7dc0-4d7f-8971-0a0748fdcd2d None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:37.063149 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d15be-5449-4909-b739-fdab596a83e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:37.063667 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d15be-5449-4909-b739-fdab596a83e4 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:37.063952 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d15be-5449-4909-b739-fdab596a83e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:37.064223 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d15be-5449-4909-b739-fdab596a83e4 None admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:37.064924 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180d15be-5449-4909-b739-fdab596a83e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:37.065231 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180d15be-5449-4909-b739-fdab596a83e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:37.066687 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180d15be-5449-4909-b739-fdab596a83e4 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:37.094336 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 343/686] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 8 13:35:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:37.094336 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d15be-5449-4909-b739-fdab596a83e4 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:37.096541 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:37.135067 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1e407-0c0b-481d-8a91-a634be99c488 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:37.179499 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0e4a4-83fd-4fba-a97c-4da407246f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:37.180233 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0e4a4-83fd-4fba-a97c-4da407246f77 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:37.180572 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0e4a4-83fd-4fba-a97c-4da407246f77 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:37.180908 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0e4a4-83fd-4fba-a97c-4da407246f77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:37.195096 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:37.246856 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d15be-5449-4909-b739-fdab596a83e4 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:37.288044 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b0e4a4-83fd-4fba-a97c-4da407246f77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:37.289640 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b0e4a4-83fd-4fba-a97c-4da407246f77 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:37.291962 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71f128-3f96-4cd9-8170-cfe8ef21cf1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:37.292821 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71f128-3f96-4cd9-8170-cfe8ef21cf1f None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:37.293476 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71f128-3f96-4cd9-8170-cfe8ef21cf1f None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:37.293959 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71f128-3f96-4cd9-8170-cfe8ef21cf1f None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:37.294993 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b71f128-3f96-4cd9-8170-cfe8ef21cf1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:37.295605 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b71f128-3f96-4cd9-8170-cfe8ef21cf1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:37.297789 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b71f128-3f96-4cd9-8170-cfe8ef21cf1f None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:37.311264 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 344/687] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:35:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:37.312740 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71f128-3f96-4cd9-8170-cfe8ef21cf1f None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:37.410791 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:37.411517 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 344/688] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:35:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:35:37.412841 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0e4a4-83fd-4fba-a97c-4da407246f77 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:37.461597 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:37.465594 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71f128-3f96-4cd9-8170-cfe8ef21cf1f None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:37.511349 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43236402-ccc1-440e-bd96-4de645a510f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:37.511872 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43236402-ccc1-440e-bd96-4de645a510f5 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:37.512156 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43236402-ccc1-440e-bd96-4de645a510f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:37.512430 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43236402-ccc1-440e-bd96-4de645a510f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:37.513174 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43236402-ccc1-440e-bd96-4de645a510f5 None admin] RBAC: Adding query filter params (role.id=e5f27e532c9d4bc7a57e31856ecee597, scope.project.id=88de9f1470c6415b97866ad5a3256ef2, user.id=db898158553743d3a28f3d6237e91a8b) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:37.513661 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43236402-ccc1-440e-bd96-4de645a510f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:37.515368 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43236402-ccc1-440e-bd96-4de645a510f5 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:37.530168 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 345/689] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 8 13:35:37 2022] GET /identity/v3/role_assignments?user.id=db898158553743d3a28f3d6237e91a8b&scope.project.id=88de9f1470c6415b97866ad5a3256ef2&role.id=e5f27e532c9d4bc7a57e31856ecee597 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:37.531555 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43236402-ccc1-440e-bd96-4de645a510f5 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:37.560013 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0e4a4-83fd-4fba-a97c-4da407246f77 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:37.636979 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2b619-1781-4cdc-b0cf-736a101e4bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:37.638073 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2b619-1781-4cdc-b0cf-736a101e4bf3 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:37.638553 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2b619-1781-4cdc-b0cf-736a101e4bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:37.639038 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2b619-1781-4cdc-b0cf-736a101e4bf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:37.653270 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2b619-1781-4cdc-b0cf-736a101e4bf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:37.655299 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2b619-1781-4cdc-b0cf-736a101e4bf3 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:37.680357 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-5cf2b619-1781-4cdc-b0cf-736a101e4bf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:37.680357 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:37.680357 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:37.680357 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:37.680357 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:37.680357 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:37.680357 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:37.680357 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:37.680357 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:37.680357 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:37.680357 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:37.680357 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:37.680357 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:37.680357 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:37.680357 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:37.680357 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:37.681431 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:37.681431 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:37.681431 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:37.681431 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:37.681431 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:37.681431 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:37.681431 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:37.681431 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:37.681431 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:37.681431 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:37.681431 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:37.681431 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:37.681431 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:37.681431 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:37.681431 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:37.681431 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:37.681431 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:37.682350 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:37.682350 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:37.682350 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:37.686748 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 345/690] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:37.693343 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2b619-1781-4cdc-b0cf-736a101e4bf3 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:37.768057 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43236402-ccc1-440e-bd96-4de645a510f5 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:37.811515 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:37.823014 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9bc04-6e86-4031-a059-7f5c74028d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:37.823661 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9bc04-6e86-4031-a059-7f5c74028d0c None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:37.823941 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9bc04-6e86-4031-a059-7f5c74028d0c None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:37.824274 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9bc04-6e86-4031-a059-7f5c74028d0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:37.841487 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe9bc04-6e86-4031-a059-7f5c74028d0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:37.842969 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe9bc04-6e86-4031-a059-7f5c74028d0c None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:37.857637 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:37.868238 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-3fe9bc04-6e86-4031-a059-7f5c74028d0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:37.868238 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:37.868238 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:37.868238 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:37.868238 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:37.868238 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:37.868238 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:37.868238 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:37.868238 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:37.868238 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:37.868238 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:37.868238 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:37.868238 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:37.868238 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:37.868238 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:37.868238 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:37.869395 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:37.869395 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:37.869395 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:37.869395 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:37.869395 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:37.869395 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:37.869395 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:37.869395 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:37.869395 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:37.869395 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:37.869395 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:37.869395 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:37.869395 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:37.869395 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:37.869395 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:37.869395 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:37.869395 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:37.870342 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:37.870342 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:37.870342 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:37.870944 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2b619-1781-4cdc-b0cf-736a101e4bf3 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:37.872812 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 346/691] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:37.880904 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9bc04-6e86-4031-a059-7f5c74028d0c None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:37.916076 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1d9ed-dd3c-4ce5-bccb-a9ea0f895e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:37.916693 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1d9ed-dd3c-4ce5-bccb-a9ea0f895e21 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:37.917004 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1d9ed-dd3c-4ce5-bccb-a9ea0f895e21 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:37.917537 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1d9ed-dd3c-4ce5-bccb-a9ea0f895e21 None admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:37.918643 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1d9ed-dd3c-4ce5-bccb-a9ea0f895e21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:37.919112 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1d9ed-dd3c-4ce5-bccb-a9ea0f895e21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:37.922273 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c1d9ed-dd3c-4ce5-bccb-a9ea0f895e21 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:37.938544 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 346/692] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:37.945291 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1d9ed-dd3c-4ce5-bccb-a9ea0f895e21 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:38.003076 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9bc04-6e86-4031-a059-7f5c74028d0c None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:38.039474 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a18617-e985-40b2-8e5b-759e4cfe909b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:38.040003 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a18617-e985-40b2-8e5b-759e4cfe909b None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:38.040280 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a18617-e985-40b2-8e5b-759e4cfe909b None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:38.040559 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a18617-e985-40b2-8e5b-759e4cfe909b None admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:38.041349 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a18617-e985-40b2-8e5b-759e4cfe909b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:38.041681 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a18617-e985-40b2-8e5b-759e4cfe909b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:38.043092 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a18617-e985-40b2-8e5b-759e4cfe909b None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:38.056967 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 347/693] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:35:38.062863 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a18617-e985-40b2-8e5b-759e4cfe909b None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:38.072386 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c1d9ed-dd3c-4ce5-bccb-a9ea0f895e21 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:38.117848 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:38.154231 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0748b4-98ce-4528-9a95-06dfeb4ce846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:38.154894 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0748b4-98ce-4528-9a95-06dfeb4ce846 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:38.155178 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0748b4-98ce-4528-9a95-06dfeb4ce846 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:38.155453 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0748b4-98ce-4528-9a95-06dfeb4ce846 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:38.174820 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0748b4-98ce-4528-9a95-06dfeb4ce846 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:38.176316 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0748b4-98ce-4528-9a95-06dfeb4ce846 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:38.188651 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a18617-e985-40b2-8e5b-759e4cfe909b None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:38.197512 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-0a0748b4-98ce-4528-9a95-06dfeb4ce846 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:35:38.197512 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:38.197512 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:38.197512 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:38.197512 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:38.197512 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:38.197512 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:38.197512 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:38.197512 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:38.197512 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:38.197512 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:38.197512 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:38.197512 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:35:38.197512 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:35:38.197512 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:35:38.197512 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:35:38.198770 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:38.198770 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:38.198770 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:35:38.198770 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:35:38.198770 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:35:38.198770 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:35:38.198770 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:38.198770 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:38.198770 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:38.198770 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:38.198770 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:38.198770 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:38.198770 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:38.198770 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:38.198770 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:38.198770 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:38.198770 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:38.198770 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:38.199795 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:38.199795 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:38.199795 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:35:38.199795 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:35:38.199795 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:35:38.199795 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:35:38.199795 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:35:38.199795 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:35:38.199795 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:35:38.199795 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:38.207173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 347/694] 10.222.0.69 () {56 vars in 1093 bytes} [Thu Sep 8 13:35:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:38.215861 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0748b4-98ce-4528-9a95-06dfeb4ce846 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:38.236847 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:38.261526 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6303ee-bd28-49b7-acf9-656d370642a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:38.261526 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6303ee-bd28-49b7-acf9-656d370642a4 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:38.261833 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6303ee-bd28-49b7-acf9-656d370642a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:38.262101 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6303ee-bd28-49b7-acf9-656d370642a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:38.270033 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6303ee-bd28-49b7-acf9-656d370642a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:38.272085 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6303ee-bd28-49b7-acf9-656d370642a4 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:38.291279 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-5d6303ee-bd28-49b7-acf9-656d370642a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:35:38.291279 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:38.291279 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:38.291279 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:38.291279 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:38.291279 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:38.291279 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:38.291279 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:38.291279 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:38.291279 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:38.291279 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:38.291279 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:38.291279 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:35:38.291279 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:35:38.291279 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:35:38.292534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:35:38.292534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:38.292534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:38.292534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:38.292534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:38.292534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:38.292534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:38.292534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:38.292534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:38.292534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:38.292534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:38.292534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:38.292534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:38.292534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:38.292534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:38.292534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:38.292534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:38.293606 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:35:38.293606 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:35:38.293606 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:35:38.293606 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:35:38.293606 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:35:38.293606 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:35:38.293606 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:35:38.293606 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:38.293606 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 348/695] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:35:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:35:38.294784 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2adad0-60ec-42f3-9116-e20f3dffbeac None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:38.294784 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2adad0-60ec-42f3-9116-e20f3dffbeac None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:38.294784 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2adad0-60ec-42f3-9116-e20f3dffbeac None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:38.296925 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 349/696] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:35:38.303002 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaee396-1536-4ea3-a11a-7fd36dc611d2 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:38.303277 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaee396-1536-4ea3-a11a-7fd36dc611d2 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:38.303552 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaee396-1536-4ea3-a11a-7fd36dc611d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:38.325036 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-dbaee396-1536-4ea3-a11a-7fd36dc611d2 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:35:38.326285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-dbaee396-1536-4ea3-a11a-7fd36dc611d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:35:38.367039 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0748b4-98ce-4528-9a95-06dfeb4ce846 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:38.414197 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa7cd6-9651-4260-8fdc-dcef99be3d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:38.414970 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa7cd6-9651-4260-8fdc-dcef99be3d08 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:38.415239 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa7cd6-9651-4260-8fdc-dcef99be3d08 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:38.415516 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa7cd6-9651-4260-8fdc-dcef99be3d08 None admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:38.416252 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa7cd6-9651-4260-8fdc-dcef99be3d08 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:38.416554 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa7cd6-9651-4260-8fdc-dcef99be3d08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:38.416990 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 350/697] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:35:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:35:38.417777 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaee396-1536-4ea3-a11a-7fd36dc611d2 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:38.418137 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fa7cd6-9651-4260-8fdc-dcef99be3d08 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:38.464169 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 348/698] 10.222.0.69 () {56 vars in 1133 bytes} [Thu Sep 8 13:35:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:38.466084 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa7cd6-9651-4260-8fdc-dcef99be3d08 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:38.495216 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:38.631156 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:38.634534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaee396-1536-4ea3-a11a-7fd36dc611d2 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:38.704365 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c7475-089c-4e08-8d6b-63ba75d651b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:38.706488 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c7475-089c-4e08-8d6b-63ba75d651b7 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:38.708820 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c7475-089c-4e08-8d6b-63ba75d651b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:38.709390 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c7475-089c-4e08-8d6b-63ba75d651b7 None admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:38.710329 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c7475-089c-4e08-8d6b-63ba75d651b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:38.710841 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c7475-089c-4e08-8d6b-63ba75d651b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:38.713403 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c7475-089c-4e08-8d6b-63ba75d651b7 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:38.716819 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa7cd6-9651-4260-8fdc-dcef99be3d08 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:38.732660 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 351/699] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 8 13:35:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:38.739305 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c7475-089c-4e08-8d6b-63ba75d651b7 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:38.769847 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14221ce0-fdf2-421e-b9d3-0affa14f5664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:38.770454 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14221ce0-fdf2-421e-b9d3-0affa14f5664 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:38.771326 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14221ce0-fdf2-421e-b9d3-0affa14f5664 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:38.771601 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14221ce0-fdf2-421e-b9d3-0affa14f5664 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:38.851638 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14221ce0-fdf2-421e-b9d3-0affa14f5664 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:38.853595 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14221ce0-fdf2-421e-b9d3-0affa14f5664 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:38.868170 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:38.879154 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c7475-089c-4e08-8d6b-63ba75d651b7 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:38.952835 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:38.954654 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96259158-7c36-48a5-9d48-fd3e81d32e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:38.955791 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96259158-7c36-48a5-9d48-fd3e81d32e0b None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:38.956266 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96259158-7c36-48a5-9d48-fd3e81d32e0b None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:38.956728 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96259158-7c36-48a5-9d48-fd3e81d32e0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:38.957685 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96259158-7c36-48a5-9d48-fd3e81d32e0b None admin] RBAC: Adding query filter params (role.id=e5f27e532c9d4bc7a57e31856ecee597, scope.project.id=88de9f1470c6415b97866ad5a3256ef2, user.id=fa9b97592a6840c3865d7dcf886221e0) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:38.958720 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96259158-7c36-48a5-9d48-fd3e81d32e0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:38.962194 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96259158-7c36-48a5-9d48-fd3e81d32e0b None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:38.971222 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 352/700] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 8 13:35:38 2022] GET /identity/v3/role_assignments?user.id=fa9b97592a6840c3865d7dcf886221e0&scope.project.id=88de9f1470c6415b97866ad5a3256ef2&role.id=e5f27e532c9d4bc7a57e31856ecee597 => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:38.972379 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96259158-7c36-48a5-9d48-fd3e81d32e0b None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:39.012430 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 349/701] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:35:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:35:39.021217 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14221ce0-fdf2-421e-b9d3-0affa14f5664 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:39.140494 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96259158-7c36-48a5-9d48-fd3e81d32e0b None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:39.169521 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14221ce0-fdf2-421e-b9d3-0affa14f5664 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:39.184788 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7843d5-cec7-44ab-8e77-e3cd3f4cc9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:39.185738 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7843d5-cec7-44ab-8e77-e3cd3f4cc9c1 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:39.186128 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7843d5-cec7-44ab-8e77-e3cd3f4cc9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:39.186404 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7843d5-cec7-44ab-8e77-e3cd3f4cc9c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:39.198124 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7843d5-cec7-44ab-8e77-e3cd3f4cc9c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:39.199804 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7843d5-cec7-44ab-8e77-e3cd3f4cc9c1 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:39.212370 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dda57e-1408-4425-acda-d0bbd78324b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:39.213073 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dda57e-1408-4425-acda-d0bbd78324b4 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:39.213499 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dda57e-1408-4425-acda-d0bbd78324b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:39.213869 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dda57e-1408-4425-acda-d0bbd78324b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:39.217168 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-3b7843d5-cec7-44ab-8e77-e3cd3f4cc9c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:39.217168 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:39.217168 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:39.217168 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:39.217168 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:39.217168 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:39.217168 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:39.217168 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:39.217168 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:39.217168 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:39.217168 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:39.217168 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:39.217168 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:39.217168 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:39.217168 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:39.217168 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:39.218193 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:39.218193 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:39.218193 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:39.218193 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:39.218193 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:39.218193 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:39.218193 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:39.218193 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:39.218193 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:39.218193 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:39.218193 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:39.218193 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:39.218193 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:39.218193 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:39.218193 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:39.218193 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:39.218193 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:39.219082 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:39.219082 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:39.219082 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:39.219082 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 353/702] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:39.219711 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebbf19-2f27-4b37-a444-23ea06e30376 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:39.219805 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebbf19-2f27-4b37-a444-23ea06e30376 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:39.220013 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aebbf19-2f27-4b37-a444-23ea06e30376 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:39.225454 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 354/703] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:35:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:35:39.228124 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b407a3-e60d-4588-a1c7-062f1b6cfb82 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:39.228409 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b407a3-e60d-4588-a1c7-062f1b6cfb82 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:39.228683 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b407a3-e60d-4588-a1c7-062f1b6cfb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:39.231509 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dda57e-1408-4425-acda-d0bbd78324b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:39.232964 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dda57e-1408-4425-acda-d0bbd78324b4 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:39.250600 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-c1b407a3-e60d-4588-a1c7-062f1b6cfb82 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:35:39.251783 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-c1b407a3-e60d-4588-a1c7-062f1b6cfb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:35:39.253912 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:39.254629 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-00dda57e-1408-4425-acda-d0bbd78324b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:39.254629 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:39.254629 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:39.254629 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:39.254629 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:39.254629 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:39.254629 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:39.254629 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:39.254629 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:39.254629 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:39.254629 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:39.254629 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:39.254629 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:39.254629 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:39.254629 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:39.254629 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:39.255796 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:39.255796 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:39.255796 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:39.255796 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:39.255796 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:39.255796 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:39.255796 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:39.255796 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:39.255796 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:39.255796 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:39.255796 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:39.255796 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:39.255796 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:39.255796 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:39.255796 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:39.255796 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:39.255796 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:39.256674 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:39.256674 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:39.256674 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:39.257578 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 350/704] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:39.259136 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dda57e-1408-4425-acda-d0bbd78324b4 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:39.289849 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:39.366883 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 355/705] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:35:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:35:39.368763 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b407a3-e60d-4588-a1c7-062f1b6cfb82 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:39.380708 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dda57e-1408-4425-acda-d0bbd78324b4 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:39.419365 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8841c7-37e4-4867-9bd5-133682fe70b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:39.419834 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8841c7-37e4-4867-9bd5-133682fe70b8 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:39.420245 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8841c7-37e4-4867-9bd5-133682fe70b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:39.420589 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8841c7-37e4-4867-9bd5-133682fe70b8 None admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:39.421401 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8841c7-37e4-4867-9bd5-133682fe70b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:39.421779 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8841c7-37e4-4867-9bd5-133682fe70b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:39.423221 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8841c7-37e4-4867-9bd5-133682fe70b8 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:39.441409 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 351/706] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:39.443413 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8841c7-37e4-4867-9bd5-133682fe70b8 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:39.492094 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b407a3-e60d-4588-a1c7-062f1b6cfb82 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:39.532122 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f788b-dcd2-4bde-a3cd-a47aae6affa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:39.533282 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f788b-dcd2-4bde-a3cd-a47aae6affa9 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:39.534154 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f788b-dcd2-4bde-a3cd-a47aae6affa9 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:39.534908 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f788b-dcd2-4bde-a3cd-a47aae6affa9 None admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:39.535808 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f788b-dcd2-4bde-a3cd-a47aae6affa9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:39.536151 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:39.537093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f788b-dcd2-4bde-a3cd-a47aae6affa9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:39.539239 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f788b-dcd2-4bde-a3cd-a47aae6affa9 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:39.547589 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:39.555687 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 356/707] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:39.560134 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8841c7-37e4-4867-9bd5-133682fe70b8 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:39.561548 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f788b-dcd2-4bde-a3cd-a47aae6affa9 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:39.596276 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966c305-4075-459b-a690-20400d5f71ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:39.596887 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966c305-4075-459b-a690-20400d5f71ce None admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:39.597166 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966c305-4075-459b-a690-20400d5f71ce None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:39.602763 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966c305-4075-459b-a690-20400d5f71ce None admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:39.602763 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c966c305-4075-459b-a690-20400d5f71ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:39.602763 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c966c305-4075-459b-a690-20400d5f71ce None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:39.636971 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 352/708] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Sep 8 13:35:39 2022] POST /identity/v3/users => generated 254 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:35:39.698997 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f788b-dcd2-4bde-a3cd-a47aae6affa9 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:39.739987 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d2f77-9bba-46de-91cf-03a325d4c04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:39.741010 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d2f77-9bba-46de-91cf-03a325d4c04e None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:39.741560 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d2f77-9bba-46de-91cf-03a325d4c04e None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:39.742172 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d2f77-9bba-46de-91cf-03a325d4c04e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:39.750852 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d2f77-9bba-46de-91cf-03a325d4c04e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:39.752832 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d2f77-9bba-46de-91cf-03a325d4c04e None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:39.767136 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-1f0d2f77-9bba-46de-91cf-03a325d4c04e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:35:39.767136 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:39.767136 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:39.767136 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:39.767136 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:39.767136 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:39.767136 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:39.767136 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:39.767136 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:39.767136 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:39.767136 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:39.767136 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:39.767136 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:35:39.767136 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:35:39.767136 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:35:39.768159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:35:39.768159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:39.768159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:39.768159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:39.768159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:39.768159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:39.768159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:39.768159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:39.768159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:39.768159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:39.768159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:39.768159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:39.768159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:39.768159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:39.768159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:39.768159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:39.768159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:39.769299 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:35:39.769299 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:35:39.769299 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:35:39.769299 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:35:39.769299 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:35:39.769299 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:35:39.769299 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:35:39.769299 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:39.772805 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 357/709] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:35:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:39.779578 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966c305-4075-459b-a690-20400d5f71ce None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:39.846070 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d2f77-9bba-46de-91cf-03a325d4c04e None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:39.918918 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966c305-4075-459b-a690-20400d5f71ce None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:39.933825 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:39.967400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd332692-eba0-49de-be25-64bed78ae7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:39.968572 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd332692-eba0-49de-be25-64bed78ae7c3 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:39.969401 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd332692-eba0-49de-be25-64bed78ae7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:39.969949 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd332692-eba0-49de-be25-64bed78ae7c3 None admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:39.970848 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd332692-eba0-49de-be25-64bed78ae7c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:39.971359 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd332692-eba0-49de-be25-64bed78ae7c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:39.974257 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd332692-eba0-49de-be25-64bed78ae7c3 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:39.986477 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d2f77-9bba-46de-91cf-03a325d4c04e None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:39.989081 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:39.997621 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 353/710] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 8 13:35:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:40.006421 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd332692-eba0-49de-be25-64bed78ae7c3 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:40.039751 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a88e84-2251-4f03-bfef-fd2d5a16f2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:40.040476 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a88e84-2251-4f03-bfef-fd2d5a16f2bc None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:40.040907 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a88e84-2251-4f03-bfef-fd2d5a16f2bc None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:40.041094 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a88e84-2251-4f03-bfef-fd2d5a16f2bc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:40.041753 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a88e84-2251-4f03-bfef-fd2d5a16f2bc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:40.043364 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a88e84-2251-4f03-bfef-fd2d5a16f2bc None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:40.058075 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-99a88e84-2251-4f03-bfef-fd2d5a16f2bc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 13:35:40.058075 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:40.058075 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:35:40.058075 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:35:40.058075 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:35:40.058075 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:35:40.058075 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:35:40.058075 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:35:40.058075 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 13:35:40.058075 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:40.058075 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:35:40.058075 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:40.058075 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:40.058075 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:40.058075 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:40.058075 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:40.058075 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:40.059252 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:40.059252 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:40.059252 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:40.059252 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:40.059252 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:40.059252 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:40.059252 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:35:40.059252 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:35:40.059252 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:35:40.059252 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:35:40.059252 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:40.059252 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:40.059252 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:40.059252 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:40.059252 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:40.059252 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:40.060163 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:40.060163 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:40.060163 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:40.060163 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:40.060163 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:40.060163 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:40.060163 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:40.060163 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:40.060163 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:40.060163 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:40.060163 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:35:40.060163 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:35:40.060163 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 13:35:40.060163 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:40.064325 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 358/711] 10.222.0.69 () {56 vars in 1129 bytes} [Thu Sep 8 13:35:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:35:40.065831 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a88e84-2251-4f03-bfef-fd2d5a16f2bc None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:40.147722 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd332692-eba0-49de-be25-64bed78ae7c3 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:40.190257 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a88e84-2251-4f03-bfef-fd2d5a16f2bc None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:40.196296 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b0bf3-1fc8-443f-b3c8-c3139ff1c660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:40.197265 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b0bf3-1fc8-443f-b3c8-c3139ff1c660 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:40.197802 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b0bf3-1fc8-443f-b3c8-c3139ff1c660 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:40.198278 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b0bf3-1fc8-443f-b3c8-c3139ff1c660 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:40.199665 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496b0bf3-1fc8-443f-b3c8-c3139ff1c660 None admin] RBAC: Adding query filter params (role.id=9c76f398c9e04caeab83842e70eb824b, scope.project.id=88de9f1470c6415b97866ad5a3256ef2, user.id=c95448c1b8b1466cae37fda5c713d53f) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:40.200185 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496b0bf3-1fc8-443f-b3c8-c3139ff1c660 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:40.202205 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496b0bf3-1fc8-443f-b3c8-c3139ff1c660 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:40.211758 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 354/712] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 8 13:35:40 2022] GET /identity/v3/role_assignments?user.id=c95448c1b8b1466cae37fda5c713d53f&scope.project.id=88de9f1470c6415b97866ad5a3256ef2&role.id=9c76f398c9e04caeab83842e70eb824b => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:40.239788 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:40.241705 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ac1c1-a145-458b-bab1-2f2961bb7590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:40.242478 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ac1c1-a145-458b-bab1-2f2961bb7590 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:40.242868 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ac1c1-a145-458b-bab1-2f2961bb7590 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:40.243153 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ac1c1-a145-458b-bab1-2f2961bb7590 None admin] PATH_INFO: `/v3/services` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:40.243850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2ac1c1-a145-458b-bab1-2f2961bb7590 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:40.250031 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2ac1c1-a145-458b-bab1-2f2961bb7590 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:40.251508 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2ac1c1-a145-458b-bab1-2f2961bb7590 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:40.262912 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 359/713] 10.222.0.69 () {56 vars in 1124 bytes} [Thu Sep 8 13:35:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:35:40.264368 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b0bf3-1fc8-443f-b3c8-c3139ff1c660 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:40.366231 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35428319-6f1a-4d52-be89-af3be4db85eb None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:40.366596 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35428319-6f1a-4d52-be89-af3be4db85eb None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:40.366785 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35428319-6f1a-4d52-be89-af3be4db85eb None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:40.368410 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 360/714] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:35:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:35:40.371334 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:40.374700 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583fd9e7-27bc-4026-8022-13ea9f9e95cc None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:40.374977 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583fd9e7-27bc-4026-8022-13ea9f9e95cc None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:40.375249 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583fd9e7-27bc-4026-8022-13ea9f9e95cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:40.396198 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-583fd9e7-27bc-4026-8022-13ea9f9e95cc None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:35:40.397966 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-583fd9e7-27bc-4026-8022-13ea9f9e95cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:35:40.419888 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b0bf3-1fc8-443f-b3c8-c3139ff1c660 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:40.461646 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd78ce6a-0bbe-420d-bf0b-5b99427289fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:40.462789 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78ce6a-0bbe-420d-bf0b-5b99427289fb None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:40.463361 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78ce6a-0bbe-420d-bf0b-5b99427289fb None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:40.463866 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78ce6a-0bbe-420d-bf0b-5b99427289fb None admin] PATH_INFO: `/v3/services` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:40.464723 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd78ce6a-0bbe-420d-bf0b-5b99427289fb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:40.465356 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd78ce6a-0bbe-420d-bf0b-5b99427289fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:40.467004 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd78ce6a-0bbe-420d-bf0b-5b99427289fb None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:40.474363 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 355/715] 10.222.0.69 () {56 vars in 1124 bytes} [Thu Sep 8 13:35:40 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:40.533581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 361/716] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:35:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:35:40.828190 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd78ce6a-0bbe-420d-bf0b-5b99427289fb None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:40.957505 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd78ce6a-0bbe-420d-bf0b-5b99427289fb None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:40.987923 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:40.996907 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08bb649-d184-4bbc-93a8-5a9ed79106b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:40.997653 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bb649-d184-4bbc-93a8-5a9ed79106b6 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:40.997939 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bb649-d184-4bbc-93a8-5a9ed79106b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:40.998210 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bb649-d184-4bbc-93a8-5a9ed79106b6 None admin] PATH_INFO: `/v3/services/network` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:40.998795 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08bb649-d184-4bbc-93a8-5a9ed79106b6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:41.000177 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08bb649-d184-4bbc-93a8-5a9ed79106b6 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:41.012420 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-b08bb649-d184-4bbc-93a8-5a9ed79106b6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 13:35:41.012420 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:41.012420 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:35:41.012420 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:35:41.012420 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:35:41.012420 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:35:41.012420 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:35:41.012420 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:35:41.012420 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 13:35:41.012420 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:41.012420 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:35:41.012420 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:41.012420 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:41.012420 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:41.012420 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:41.012420 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:41.012420 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:41.013543 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:41.013543 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:41.013543 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:41.013543 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:41.013543 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:41.013543 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:41.013543 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:35:41.013543 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:35:41.013543 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:35:41.013543 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:35:41.013543 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:41.013543 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:41.013543 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:41.013543 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:41.013543 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:41.013543 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:41.014986 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:41.014986 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:41.014986 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:41.014986 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:41.014986 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:41.014986 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:41.014986 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:41.014986 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:41.014986 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:41.014986 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:41.014986 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:35:41.014986 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:35:41.014986 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 13:35:41.014986 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:41.014986 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 356/717] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:35:40 2022] GET /identity/v3/services/network => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:41.019442 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583fd9e7-27bc-4026-8022-13ea9f9e95cc None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:41.177986 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583fd9e7-27bc-4026-8022-13ea9f9e95cc None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:41.204820 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:41.232843 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14c294-37fc-41b7-a790-9bdcb2ffaeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:41.233492 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14c294-37fc-41b7-a790-9bdcb2ffaeb4 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:41.233771 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14c294-37fc-41b7-a790-9bdcb2ffaeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:41.234047 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14c294-37fc-41b7-a790-9bdcb2ffaeb4 None admin] PATH_INFO: `/v3/services` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:41.234683 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14c294-37fc-41b7-a790-9bdcb2ffaeb4 None admin] RBAC: Adding query filter params (name=network) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:41.234987 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14c294-37fc-41b7-a790-9bdcb2ffaeb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:41.236358 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14c294-37fc-41b7-a790-9bdcb2ffaeb4 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:41.245524 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 362/718] 10.222.0.69 () {56 vars in 1112 bytes} [Thu Sep 8 13:35:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:41.251214 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08bb649-d184-4bbc-93a8-5a9ed79106b6 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:41.441633 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08bb649-d184-4bbc-93a8-5a9ed79106b6 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:41.502460 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53432d7-5491-48d4-8141-0fc0bdf2f5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:41.503073 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53432d7-5491-48d4-8141-0fc0bdf2f5bd None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:41.503352 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53432d7-5491-48d4-8141-0fc0bdf2f5bd None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:41.503620 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53432d7-5491-48d4-8141-0fc0bdf2f5bd None admin] PATH_INFO: `/v3/services` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:41.504288 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53432d7-5491-48d4-8141-0fc0bdf2f5bd None admin] RBAC: Adding query filter params (type=network) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:41.504655 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53432d7-5491-48d4-8141-0fc0bdf2f5bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:41.506818 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53432d7-5491-48d4-8141-0fc0bdf2f5bd None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:41.516342 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 357/719] 10.222.0.69 () {56 vars in 1112 bytes} [Thu Sep 8 13:35:41 2022] GET /identity/v3/services?type=network => generated 124 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:41.983766 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585c67c-6124-4a6c-ad48-2c470bbc405c None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:41.984186 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585c67c-6124-4a6c-ad48-2c470bbc405c None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:41.984362 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585c67c-6124-4a6c-ad48-2c470bbc405c None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:41.985912 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 363/720] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:35:41.992295 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec9e32-2518-4fb4-b6d3-5ce37bce98c6 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:41.992774 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec9e32-2518-4fb4-b6d3-5ce37bce98c6 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:41.992874 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec9e32-2518-4fb4-b6d3-5ce37bce98c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:42.018092 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-7dec9e32-2518-4fb4-b6d3-5ce37bce98c6 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:35:42.019296 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-7dec9e32-2518-4fb4-b6d3-5ce37bce98c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:35:42.094644 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:42.117922 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 358/721] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:35:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:35:42.465566 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585c67c-6124-4a6c-ad48-2c470bbc405c None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:42.586998 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15124dae-0262-43d5-8609-9f40afaa0d89 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:42.587650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15124dae-0262-43d5-8609-9f40afaa0d89 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:42.588264 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15124dae-0262-43d5-8609-9f40afaa0d89 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:42.590266 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 359/722] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:35:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:35:42.597059 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0f5fd-ab46-4557-8b43-8bc2808dca89 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:42.597866 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0f5fd-ab46-4557-8b43-8bc2808dca89 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:42.598914 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0f5fd-ab46-4557-8b43-8bc2808dca89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:42.618943 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585c67c-6124-4a6c-ad48-2c470bbc405c None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:42.646965 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-d8c0f5fd-ab46-4557-8b43-8bc2808dca89 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:35:42.648211 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-d8c0f5fd-ab46-4557-8b43-8bc2808dca89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:35:42.682050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6656e-5bf2-440b-a4e1-8104cb3344ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:42.682974 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6656e-5bf2-440b-a4e1-8104cb3344ff None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:42.683714 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6656e-5bf2-440b-a4e1-8104cb3344ff None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:42.684416 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6656e-5bf2-440b-a4e1-8104cb3344ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:42.698034 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6656e-5bf2-440b-a4e1-8104cb3344ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:35:42.704318 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-b2d6656e-5bf2-440b-a4e1-8104cb3344ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:35:42.704318 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:42.704318 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:42.704318 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:42.704318 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:42.704318 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:42.704318 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:42.704318 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:42.704318 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:42.704318 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:42.704318 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:42.704318 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:42.704318 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:35:42.704318 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:35:42.704318 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:35:42.704318 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:35:42.705422 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:35:42.705422 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:35:42.705422 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:35:42.705422 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:35:42.705422 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:42.705422 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:42.705422 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:42.705422 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:42.705422 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:42.705422 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:42.705422 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:42.705422 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:42.705422 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:42.705422 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:42.705422 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:42.705422 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:42.706449 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:42.706449 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:42.706449 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:42.706449 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:42.706449 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:35:42.706449 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:35:42.706449 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:35:42.706449 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:35:42.706449 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:35:42.706449 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:35:42.706449 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:35:42.706449 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:42.709709 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 364/723] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 8 13:35:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:42.715536 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6656e-5bf2-440b-a4e1-8104cb3344ff None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:42.810011 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:42.834806 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6656e-5bf2-440b-a4e1-8104cb3344ff None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:42.871016 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 360/724] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:35:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 08 13:35:42.874349 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e5a5a-ccff-456a-99b9-cc7e2fe6f03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:42.875220 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e5a5a-ccff-456a-99b9-cc7e2fe6f03e None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:42.875710 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e5a5a-ccff-456a-99b9-cc7e2fe6f03e None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:42.876223 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e5a5a-ccff-456a-99b9-cc7e2fe6f03e None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:42.877094 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85e5a5a-ccff-456a-99b9-cc7e2fe6f03e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:42.877607 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85e5a5a-ccff-456a-99b9-cc7e2fe6f03e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:42.879160 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85e5a5a-ccff-456a-99b9-cc7e2fe6f03e None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:42.893538 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 365/725] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:35:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:42.897691 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0f5fd-ab46-4557-8b43-8bc2808dca89 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:43.112738 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0f5fd-ab46-4557-8b43-8bc2808dca89 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:43.139933 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:43.168033 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefb781-8961-4393-b5b2-42718062ca2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:43.168686 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefb781-8961-4393-b5b2-42718062ca2c None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:43.169025 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefb781-8961-4393-b5b2-42718062ca2c None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:43.169301 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefb781-8961-4393-b5b2-42718062ca2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:43.187696 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daefb781-8961-4393-b5b2-42718062ca2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:43.189233 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daefb781-8961-4393-b5b2-42718062ca2c None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:43.199632 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e5a5a-ccff-456a-99b9-cc7e2fe6f03e None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:43.224781 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-daefb781-8961-4393-b5b2-42718062ca2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:43.224781 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:43.224781 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:43.224781 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:43.224781 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:43.224781 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:43.224781 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:43.224781 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:43.224781 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:43.224781 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:43.224781 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:43.224781 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:43.224781 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:43.224781 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:43.224781 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:43.224781 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:43.226265 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:43.226265 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:43.226265 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:43.226265 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:43.226265 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:43.226265 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:43.226265 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:43.226265 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:43.226265 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:43.226265 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:43.226265 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:43.226265 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:43.226265 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:43.226265 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:43.226265 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:43.226265 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:43.226265 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:43.227238 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:43.227238 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:43.227238 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:43.231172 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 361/726] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:43.232868 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefb781-8961-4393-b5b2-42718062ca2c None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:43.346531 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e5a5a-ccff-456a-99b9-cc7e2fe6f03e None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:43.350609 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:43.399025 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512fcb3-eb53-4b95-91fa-569e232bc298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:43.400078 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512fcb3-eb53-4b95-91fa-569e232bc298 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:43.400824 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512fcb3-eb53-4b95-91fa-569e232bc298 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:43.401727 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512fcb3-eb53-4b95-91fa-569e232bc298 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:43.416345 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefb781-8961-4393-b5b2-42718062ca2c None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:43.419000 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1512fcb3-eb53-4b95-91fa-569e232bc298 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:35:43.425892 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-1512fcb3-eb53-4b95-91fa-569e232bc298 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:35:43.425892 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:43.425892 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:43.425892 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:43.425892 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:43.425892 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:43.425892 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:43.425892 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:43.425892 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:43.425892 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:43.425892 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:43.425892 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:43.425892 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:35:43.425892 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:35:43.425892 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:35:43.425892 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:35:43.427683 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:35:43.427683 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:35:43.427683 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:35:43.427683 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:35:43.427683 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:43.427683 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:43.427683 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:43.427683 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:43.427683 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:43.427683 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:43.427683 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:43.427683 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:43.427683 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:43.427683 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:43.427683 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:43.427683 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:43.429420 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:43.429420 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:43.429420 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:43.429420 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:43.429420 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:35:43.429420 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:35:43.429420 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:35:43.429420 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:35:43.429420 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:35:43.429420 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:35:43.429420 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:35:43.429420 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:43.429420 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 366/727] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Sep 8 13:35:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:35:43.430754 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83f10a-4892-4114-98e2-45b1574c1163 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:43.431103 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83f10a-4892-4114-98e2-45b1574c1163 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:43.431450 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83f10a-4892-4114-98e2-45b1574c1163 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:43.437634 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 367/728] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:35:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:35:43.438753 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83f10a-4892-4114-98e2-45b1574c1163 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:43.481032 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ff928-4182-43d7-a9dc-683769a60de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:43.482502 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ff928-4182-43d7-a9dc-683769a60de1 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:43.483432 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ff928-4182-43d7-a9dc-683769a60de1 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:43.484217 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ff928-4182-43d7-a9dc-683769a60de1 None admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:43.485796 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ff928-4182-43d7-a9dc-683769a60de1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:43.486557 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ff928-4182-43d7-a9dc-683769a60de1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:43.490020 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ff928-4182-43d7-a9dc-683769a60de1 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:43.512071 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 362/729] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:35:43.513834 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11272607-36a3-4359-a913-9d2840a14260 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:43.515056 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11272607-36a3-4359-a913-9d2840a14260 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:43.515504 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11272607-36a3-4359-a913-9d2840a14260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:43.539042 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-11272607-36a3-4359-a913-9d2840a14260 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:35:43.540280 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-11272607-36a3-4359-a913-9d2840a14260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:35:43.576579 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:43.588008 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83f10a-4892-4114-98e2-45b1574c1163 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:43.634184 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529c2f4-318c-4100-a248-9c5be693cdd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:43.634997 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529c2f4-318c-4100-a248-9c5be693cdd8 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:43.635280 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529c2f4-318c-4100-a248-9c5be693cdd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:43.635553 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529c2f4-318c-4100-a248-9c5be693cdd8 None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:43.636247 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1529c2f4-318c-4100-a248-9c5be693cdd8 None admin] RBAC: Adding query filter params (name=service) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:43.636546 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1529c2f4-318c-4100-a248-9c5be693cdd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:43.638641 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1529c2f4-318c-4100-a248-9c5be693cdd8 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:43.649484 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 363/730] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:35:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:35:43.649484 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07285b5b-aeba-4f22-aae5-72735a6e7c7e None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:43.649484 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07285b5b-aeba-4f22-aae5-72735a6e7c7e None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:43.649484 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07285b5b-aeba-4f22-aae5-72735a6e7c7e None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:43.649484 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 364/731] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:35:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:35:43.650057 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07285b5b-aeba-4f22-aae5-72735a6e7c7e None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:43.665146 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 368/732] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Sep 8 13:35:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:43.666721 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f694ea-abfc-4bb5-aec7-36943e946e74 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:43.667065 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f694ea-abfc-4bb5-aec7-36943e946e74 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:43.667340 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f694ea-abfc-4bb5-aec7-36943e946e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:43.695475 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-70f694ea-abfc-4bb5-aec7-36943e946e74 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:35:43.696852 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-70f694ea-abfc-4bb5-aec7-36943e946e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:35:43.722157 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:43.801382 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 369/733] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:35:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:35:43.802876 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f694ea-abfc-4bb5-aec7-36943e946e74 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:43.814472 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07285b5b-aeba-4f22-aae5-72735a6e7c7e None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:43.898954 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd4228-e84f-49b1-ae4a-3958fb10899b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:43.905607 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd4228-e84f-49b1-ae4a-3958fb10899b None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:43.905607 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd4228-e84f-49b1-ae4a-3958fb10899b None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:43.905607 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd4228-e84f-49b1-ae4a-3958fb10899b None admin] PATH_INFO: `/v3/users/swift` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:43.923451 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd4228-e84f-49b1-ae4a-3958fb10899b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:43.928247 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd4228-e84f-49b1-ae4a-3958fb10899b None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:43.961835 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-92dd4228-e84f-49b1-ae4a-3958fb10899b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 08 13:35:43.961835 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:43.961835 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:43.961835 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:43.961835 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:43.961835 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:43.961835 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:43.961835 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:43.961835 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:43.961835 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:43.961835 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:43.961835 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:43.961835 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:35:43.961835 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:35:43.961835 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:35:43.961835 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:35:43.962871 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:43.962871 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:43.962871 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:35:43.962871 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:35:43.962871 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:35:43.962871 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:35:43.962871 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:43.962871 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:43.962871 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:43.962871 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:43.962871 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:43.962871 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:43.962871 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:43.962871 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:43.962871 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:43.962871 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:43.962871 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:43.962871 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:43.964503 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:43.964503 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:43.964503 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:35:43.964503 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:35:43.964503 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:35:43.964503 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:35:43.964503 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:35:43.964503 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:35:43.964503 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 08 13:35:43.964503 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:43.964503 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 365/734] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 8 13:35:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:43.975137 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd4228-e84f-49b1-ae4a-3958fb10899b None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:43.978600 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f694ea-abfc-4bb5-aec7-36943e946e74 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:44.004468 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:44.050400 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43704f3a-6684-4efc-b4ae-f45a1e88f8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:44.051943 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43704f3a-6684-4efc-b4ae-f45a1e88f8ee None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:44.052666 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43704f3a-6684-4efc-b4ae-f45a1e88f8ee None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:44.054235 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43704f3a-6684-4efc-b4ae-f45a1e88f8ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:44.077412 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43704f3a-6684-4efc-b4ae-f45a1e88f8ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:44.080375 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43704f3a-6684-4efc-b4ae-f45a1e88f8ee None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:44.108677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-43704f3a-6684-4efc-b4ae-f45a1e88f8ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:44.108677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:44.108677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:44.108677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:44.108677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:44.108677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:44.108677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:44.108677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:44.108677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:44.108677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:44.108677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:44.108677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:44.108677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:44.108677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:44.108677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:44.108677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:44.109736 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:44.109736 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:44.109736 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:44.109736 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:44.109736 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:44.109736 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:44.109736 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:44.109736 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:44.109736 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:44.109736 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:44.109736 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:44.109736 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:44.109736 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:44.109736 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:44.109736 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:44.109736 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:44.109736 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:44.110702 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:44.110702 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:44.110702 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:44.110702 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 370/735] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:44.116896 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43704f3a-6684-4efc-b4ae-f45a1e88f8ee None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:44.118932 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd4228-e84f-49b1-ae4a-3958fb10899b None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:44.131326 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:44.174405 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5df666-98f1-4139-bba3-10933d5d3324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:44.175368 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5df666-98f1-4139-bba3-10933d5d3324 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:44.175860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5df666-98f1-4139-bba3-10933d5d3324 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:44.176343 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5df666-98f1-4139-bba3-10933d5d3324 None admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:44.178150 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5df666-98f1-4139-bba3-10933d5d3324 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:44.178687 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5df666-98f1-4139-bba3-10933d5d3324 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:44.180695 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5df666-98f1-4139-bba3-10933d5d3324 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:44.203854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 366/736] 10.222.0.69 () {56 vars in 1135 bytes} [Thu Sep 8 13:35:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:44.205444 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5df666-98f1-4139-bba3-10933d5d3324 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:44.273128 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43704f3a-6684-4efc-b4ae-f45a1e88f8ee None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:44.314668 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:44.316138 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84f2d1-4a6d-4fa7-b0d2-cceca1a00fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:44.316790 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84f2d1-4a6d-4fa7-b0d2-cceca1a00fd6 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:44.317074 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84f2d1-4a6d-4fa7-b0d2-cceca1a00fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:44.317466 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84f2d1-4a6d-4fa7-b0d2-cceca1a00fd6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:44.329015 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f84f2d1-4a6d-4fa7-b0d2-cceca1a00fd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:35:44.335836 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-8f84f2d1-4a6d-4fa7-b0d2-cceca1a00fd6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:35:44.335836 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:44.335836 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:44.335836 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:44.335836 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:44.335836 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:44.335836 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:44.335836 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:44.335836 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:44.335836 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:44.335836 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:44.335836 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:44.335836 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:35:44.335836 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:35:44.335836 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:35:44.335836 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:35:44.336864 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:35:44.336864 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:35:44.336864 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:35:44.336864 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:35:44.336864 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:44.336864 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:44.336864 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:44.336864 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:44.336864 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:44.336864 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:44.336864 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:44.336864 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:44.336864 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:44.336864 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:44.336864 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:44.336864 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:44.337747 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:44.337747 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:44.337747 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:44.337747 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:44.337747 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:35:44.337747 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:35:44.337747 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:35:44.337747 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:35:44.337747 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:35:44.337747 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:35:44.337747 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:35:44.337747 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:44.337747 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 371/737] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 8 13:35:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:44.338460 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84f2d1-4a6d-4fa7-b0d2-cceca1a00fd6 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:44.352994 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5df666-98f1-4139-bba3-10933d5d3324 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:44.409921 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd91a3-2768-4299-a953-419ed668eb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:44.410531 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd91a3-2768-4299-a953-419ed668eb86 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:44.410809 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd91a3-2768-4299-a953-419ed668eb86 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:44.411588 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd91a3-2768-4299-a953-419ed668eb86 None admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:44.412234 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dd91a3-2768-4299-a953-419ed668eb86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:44.412534 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dd91a3-2768-4299-a953-419ed668eb86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:44.413952 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dd91a3-2768-4299-a953-419ed668eb86 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:44.430944 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 367/738] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:44.430944 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd91a3-2768-4299-a953-419ed668eb86 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:44.436340 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:44.482374 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84f2d1-4a6d-4fa7-b0d2-cceca1a00fd6 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:44.526222 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dce798-e5d2-4afa-82b9-ea65fcd0c2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:44.527183 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dce798-e5d2-4afa-82b9-ea65fcd0c2a4 None admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:44.527183 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dce798-e5d2-4afa-82b9-ea65fcd0c2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:44.527474 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dce798-e5d2-4afa-82b9-ea65fcd0c2a4 None admin] PATH_INFO: `/v3/services` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:44.528036 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dce798-e5d2-4afa-82b9-ea65fcd0c2a4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:44.529505 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dce798-e5d2-4afa-82b9-ea65fcd0c2a4 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:44.549333 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 372/739] 10.222.0.69 () {60 vars in 1141 bytes} [Thu Sep 8 13:35:44 2022] POST /identity/v3/services => generated 251 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:35:44.550379 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dce798-e5d2-4afa-82b9-ea65fcd0c2a4 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:44.698015 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd91a3-2768-4299-a953-419ed668eb86 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:44.722147 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dce798-e5d2-4afa-82b9-ea65fcd0c2a4 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:44.750660 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1bf94-0c96-4a4c-9b61-16004655a731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:44.751442 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1bf94-0c96-4a4c-9b61-16004655a731 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:44.751806 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1bf94-0c96-4a4c-9b61-16004655a731 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:44.752113 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f1bf94-0c96-4a4c-9b61-16004655a731 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:44.757397 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:44.761748 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:44.777024 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c258be9-dacc-4d8f-98af-680379e2e2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:44.778086 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c258be9-dacc-4d8f-98af-680379e2e2fc None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:44.778981 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c258be9-dacc-4d8f-98af-680379e2e2fc None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:44.778981 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c258be9-dacc-4d8f-98af-680379e2e2fc None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:44.779393 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c258be9-dacc-4d8f-98af-680379e2e2fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:44.779629 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c258be9-dacc-4d8f-98af-680379e2e2fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:44.780988 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c258be9-dacc-4d8f-98af-680379e2e2fc None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:44.792079 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 373/740] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:35:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:44.793263 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dccd47d-0b18-4e86-9fe2-3a978b10368f None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:44.793587 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dccd47d-0b18-4e86-9fe2-3a978b10368f None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:44.793935 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dccd47d-0b18-4e86-9fe2-3a978b10368f None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:44.795563 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 374/741] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:35:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:35:44.796351 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dccd47d-0b18-4e86-9fe2-3a978b10368f None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:44.858774 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f1bf94-0c96-4a4c-9b61-16004655a731 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:44.861236 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f1bf94-0c96-4a4c-9b61-16004655a731 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:44.938712 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dccd47d-0b18-4e86-9fe2-3a978b10368f None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:44.980352 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f8c92-0975-4556-a0e7-d7c820ae321a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:44.981249 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f8c92-0975-4556-a0e7-d7c820ae321a None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:44.981638 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f8c92-0975-4556-a0e7-d7c820ae321a None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:44.982102 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f8c92-0975-4556-a0e7-d7c820ae321a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:44.986623 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 368/742] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:35:44 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:35:44.987558 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1bf94-0c96-4a4c-9b61-16004655a731 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:44.993418 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f8c92-0975-4556-a0e7-d7c820ae321a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:44.995271 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96f8c92-0975-4556-a0e7-d7c820ae321a None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:45.010018 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-f96f8c92-0975-4556-a0e7-d7c820ae321a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 13:35:45.010018 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:45.010018 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:45.010018 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:45.010018 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:45.010018 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:45.010018 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:45.010018 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:45.010018 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:45.010018 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:45.010018 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:45.010018 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:45.010018 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:35:45.010018 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:35:45.010018 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:35:45.010018 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:35:45.011233 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:45.011233 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:45.011233 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:35:45.011233 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:35:45.011233 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:35:45.011233 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:35:45.011233 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:45.011233 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:45.011233 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:45.011233 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:45.011233 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:45.011233 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:45.011233 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:45.011233 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:45.011233 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:45.011233 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:45.011233 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:45.011233 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:45.012383 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:45.012383 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:45.012383 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:35:45.012383 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:35:45.012383 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:35:45.012383 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:35:45.012383 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:35:45.012383 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:35:45.012383 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 13:35:45.012383 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:45.018277 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 375/743] 10.222.0.69 () {56 vars in 1117 bytes} [Thu Sep 8 13:35:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:45.020277 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa997b-ab25-4352-831c-623693d6bd45 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:45.020889 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa997b-ab25-4352-831c-623693d6bd45 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:45.021576 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa997b-ab25-4352-831c-623693d6bd45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:45.035830 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:45.044432 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-32aa997b-ab25-4352-831c-623693d6bd45 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:35:45.045850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-32aa997b-ab25-4352-831c-623693d6bd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:35:45.118124 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:45.129059 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f1bf94-0c96-4a4c-9b61-16004655a731 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:45.159433 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 376/744] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:35:45 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 08 13:35:45.171081 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa997b-ab25-4352-831c-623693d6bd45 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:45.175836 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313f0c6-3c2f-432b-9cb8-ee6abbad08a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:45.176688 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313f0c6-3c2f-432b-9cb8-ee6abbad08a8 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:45.177162 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313f0c6-3c2f-432b-9cb8-ee6abbad08a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:45.177647 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313f0c6-3c2f-432b-9cb8-ee6abbad08a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:45.192069 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5313f0c6-3c2f-432b-9cb8-ee6abbad08a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:45.195908 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5313f0c6-3c2f-432b-9cb8-ee6abbad08a8 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:45.217816 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-5313f0c6-3c2f-432b-9cb8-ee6abbad08a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:45.217816 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:45.217816 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:45.217816 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:45.217816 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:45.217816 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:45.217816 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:45.217816 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:45.217816 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:45.217816 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:45.217816 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:45.217816 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:45.217816 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:45.217816 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:45.217816 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:45.217816 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:45.224309 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:45.224309 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:45.224309 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:45.224309 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:45.224309 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:45.224309 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:45.224309 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:45.224309 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:45.224309 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:45.224309 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:45.224309 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:45.224309 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:45.224309 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:45.224309 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:45.224309 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:45.224309 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:45.224309 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:45.226012 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:45.226012 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:45.226012 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:45.226012 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 369/745] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:45.226012 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313f0c6-3c2f-432b-9cb8-ee6abbad08a8 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:45.315355 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa997b-ab25-4352-831c-623693d6bd45 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:45.350176 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:45.354274 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b11c0-fcda-4104-9687-a165acac0f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:45.355218 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b11c0-fcda-4104-9687-a165acac0f5d None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:45.355696 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b11c0-fcda-4104-9687-a165acac0f5d None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:45.356173 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b11c0-fcda-4104-9687-a165acac0f5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:45.366410 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313f0c6-3c2f-432b-9cb8-ee6abbad08a8 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:45.367849 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b11c0-fcda-4104-9687-a165acac0f5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:45.369515 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04b11c0-fcda-4104-9687-a165acac0f5d None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:45.385083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-a04b11c0-fcda-4104-9687-a165acac0f5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:45.385083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:45.385083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:45.385083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:45.385083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:45.385083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:45.385083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:45.385083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:45.385083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:45.385083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:45.385083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:45.385083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:45.385083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:45.385083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:45.385083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:45.385083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:45.386134 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:45.386134 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:45.386134 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:45.386134 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:45.386134 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:45.386134 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:45.386134 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:45.386134 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:45.386134 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:45.386134 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:45.386134 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:45.386134 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:45.386134 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:45.386134 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:45.386134 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:45.386134 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:45.386134 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:45.387026 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:45.387026 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:45.387026 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:45.389101 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 377/746] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:45.390218 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b11c0-fcda-4104-9687-a165acac0f5d None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:45.410212 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69497628-72f0-4343-8b26-a757cc7dc292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:45.410824 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69497628-72f0-4343-8b26-a757cc7dc292 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:45.411696 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69497628-72f0-4343-8b26-a757cc7dc292 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:45.411971 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69497628-72f0-4343-8b26-a757cc7dc292 None admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:45.412799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69497628-72f0-4343-8b26-a757cc7dc292 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:45.413150 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69497628-72f0-4343-8b26-a757cc7dc292 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:45.414680 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69497628-72f0-4343-8b26-a757cc7dc292 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:45.422964 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:45.439434 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 370/747] 10.222.0.69 () {56 vars in 1149 bytes} [Thu Sep 8 13:35:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:45.440425 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69497628-72f0-4343-8b26-a757cc7dc292 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:45.503459 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b11c0-fcda-4104-9687-a165acac0f5d None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:45.541208 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aacd49-19e3-4526-9e75-7d87dba1d1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:45.542522 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aacd49-19e3-4526-9e75-7d87dba1d1b9 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:45.543017 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aacd49-19e3-4526-9e75-7d87dba1d1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:45.543495 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aacd49-19e3-4526-9e75-7d87dba1d1b9 None admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:45.544382 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aacd49-19e3-4526-9e75-7d87dba1d1b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:45.544889 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aacd49-19e3-4526-9e75-7d87dba1d1b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:45.546599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aacd49-19e3-4526-9e75-7d87dba1d1b9 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:45.565544 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69497628-72f0-4343-8b26-a757cc7dc292 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:45.573048 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 378/748] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:45.574712 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aacd49-19e3-4526-9e75-7d87dba1d1b9 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:45.611675 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa4d41-0527-4812-abd2-1799bcec28f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:45.612394 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa4d41-0527-4812-abd2-1799bcec28f4 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:45.612678 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa4d41-0527-4812-abd2-1799bcec28f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:45.612952 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa4d41-0527-4812-abd2-1799bcec28f4 None admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:45.613949 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa4d41-0527-4812-abd2-1799bcec28f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:45.615222 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa4d41-0527-4812-abd2-1799bcec28f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:45.617227 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa4d41-0527-4812-abd2-1799bcec28f4 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:45.632222 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 371/749] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:45.633466 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa4d41-0527-4812-abd2-1799bcec28f4 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:45.644697 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:45.671034 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:45.691618 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aacd49-19e3-4526-9e75-7d87dba1d1b9 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:45.734909 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39424c1d-9b82-4ad0-adce-a847d607e8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:45.735919 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39424c1d-9b82-4ad0-adce-a847d607e8e9 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:45.736303 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39424c1d-9b82-4ad0-adce-a847d607e8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:45.736718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39424c1d-9b82-4ad0-adce-a847d607e8e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:45.772448 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa4d41-0527-4812-abd2-1799bcec28f4 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:45.816907 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541de5c9-1af3-4a9e-a454-615a0e7c1791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:45.817774 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541de5c9-1af3-4a9e-a454-615a0e7c1791 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:45.818080 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541de5c9-1af3-4a9e-a454-615a0e7c1791 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:45.818368 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541de5c9-1af3-4a9e-a454-615a0e7c1791 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:45.827117 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541de5c9-1af3-4a9e-a454-615a0e7c1791 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:45.828745 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541de5c9-1af3-4a9e-a454-615a0e7c1791 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:45.842611 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-541de5c9-1af3-4a9e-a454-615a0e7c1791 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:35:45.842611 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:45.842611 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:45.842611 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:45.842611 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:45.842611 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:45.842611 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:45.842611 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:45.842611 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:45.842611 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:45.842611 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:45.842611 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:45.842611 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:35:45.842611 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:35:45.842611 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:35:45.842611 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:35:45.843799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:45.843799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:45.843799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:35:45.843799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:35:45.843799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:35:45.843799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:35:45.843799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:45.843799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:45.843799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:45.843799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:45.843799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:45.843799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:45.843799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:45.843799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:45.843799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:45.843799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:45.843799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:45.843799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:45.850542 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:45.850542 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:45.850542 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:35:45.850542 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:35:45.850542 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:35:45.850542 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:35:45.850542 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:35:45.850542 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:35:45.850542 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:35:45.850542 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:45.850542 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 372/750] 10.222.0.69 () {56 vars in 1093 bytes} [Thu Sep 8 13:35:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:45.850542 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541de5c9-1af3-4a9e-a454-615a0e7c1791 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:45.853109 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39424c1d-9b82-4ad0-adce-a847d607e8e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:45.857059 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39424c1d-9b82-4ad0-adce-a847d607e8e9 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:45.927266 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:45.956805 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:45.968926 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541de5c9-1af3-4a9e-a454-615a0e7c1791 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:45.976405 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 379/751] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:35:45 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 08 13:35:45.977345 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39424c1d-9b82-4ad0-adce-a847d607e8e9 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:46.011133 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6bfb3-8563-4b42-a7ab-08fde177b121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:46.012127 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6bfb3-8563-4b42-a7ab-08fde177b121 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:46.012127 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6bfb3-8563-4b42-a7ab-08fde177b121 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:46.012359 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6bfb3-8563-4b42-a7ab-08fde177b121 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:46.021820 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db6bfb3-8563-4b42-a7ab-08fde177b121 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:46.023284 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db6bfb3-8563-4b42-a7ab-08fde177b121 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:46.037054 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-6db6bfb3-8563-4b42-a7ab-08fde177b121 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:35:46.037054 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:46.037054 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:46.037054 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:46.037054 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:46.037054 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:46.037054 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:46.037054 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:46.037054 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:46.037054 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:46.037054 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:46.037054 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:46.037054 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:35:46.037054 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:35:46.037054 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:35:46.038156 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:35:46.038156 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:46.038156 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:46.038156 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:46.038156 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:46.038156 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:46.038156 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:46.038156 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:46.038156 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:46.038156 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:46.038156 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:46.038156 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:46.038156 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:46.038156 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:46.038156 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:46.038156 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:46.038156 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:46.045878 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:35:46.045878 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:35:46.045878 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:35:46.045878 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:35:46.045878 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:35:46.045878 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:35:46.045878 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:35:46.045878 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:46.045878 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 373/752] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:35:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:46.045878 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6bfb3-8563-4b42-a7ab-08fde177b121 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:46.094487 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39424c1d-9b82-4ad0-adce-a847d607e8e9 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:46.133625 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83cc242-94b9-4447-906e-127a88009741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:46.134350 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83cc242-94b9-4447-906e-127a88009741 None admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:46.134627 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83cc242-94b9-4447-906e-127a88009741 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:46.134897 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83cc242-94b9-4447-906e-127a88009741 None admin] PATH_INFO: `/v3/services` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:46.135555 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83cc242-94b9-4447-906e-127a88009741 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:46.136927 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83cc242-94b9-4447-906e-127a88009741 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:46.158690 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 380/753] 10.222.0.69 () {60 vars in 1141 bytes} [Thu Sep 8 13:35:45 2022] POST /identity/v3/services => generated 240 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:35:46.167349 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83cc242-94b9-4447-906e-127a88009741 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:46.179048 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6bfb3-8563-4b42-a7ab-08fde177b121 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:46.214756 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:46.234562 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c7392-3988-4e1b-b3be-715a2fa0916a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:46.235600 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c7392-3988-4e1b-b3be-715a2fa0916a None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:46.236065 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c7392-3988-4e1b-b3be-715a2fa0916a None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:46.236523 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c7392-3988-4e1b-b3be-715a2fa0916a None admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:46.237520 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97c7392-3988-4e1b-b3be-715a2fa0916a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:46.238036 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97c7392-3988-4e1b-b3be-715a2fa0916a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:46.240856 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97c7392-3988-4e1b-b3be-715a2fa0916a None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:46.250357 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:46.267350 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 374/754] 10.222.0.69 () {56 vars in 1133 bytes} [Thu Sep 8 13:35:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:46.268676 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c7392-3988-4e1b-b3be-715a2fa0916a None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:46.344053 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83cc242-94b9-4447-906e-127a88009741 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:46.398573 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d27e214-77f4-4a41-843a-ec15b440285c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:46.399200 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27e214-77f4-4a41-843a-ec15b440285c None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:46.399481 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27e214-77f4-4a41-843a-ec15b440285c None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:46.399860 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d27e214-77f4-4a41-843a-ec15b440285c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:46.429654 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c7392-3988-4e1b-b3be-715a2fa0916a None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:46.430382 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d27e214-77f4-4a41-843a-ec15b440285c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:46.431944 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d27e214-77f4-4a41-843a-ec15b440285c None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:46.449208 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-2d27e214-77f4-4a41-843a-ec15b440285c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:46.449208 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:46.449208 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:46.449208 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:46.449208 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:46.449208 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:46.449208 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:46.449208 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:46.449208 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:46.449208 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:46.449208 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:46.449208 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:46.449208 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:46.449208 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:46.449208 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:46.449208 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:46.450292 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:46.450292 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:46.450292 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:46.450292 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:46.450292 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:46.450292 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:46.450292 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:46.450292 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:46.450292 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:46.450292 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:46.450292 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:46.450292 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:46.450292 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:46.450292 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:46.450292 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:46.450292 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:46.450292 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:46.451299 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:46.451299 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:46.451299 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:46.451299 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 381/755] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:46.452149 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d27e214-77f4-4a41-843a-ec15b440285c None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:46.479760 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d84625-ee4c-4b51-9f49-7b961a6b7f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:46.480689 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d84625-ee4c-4b51-9f49-7b961a6b7f3d None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:46.481661 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d84625-ee4c-4b51-9f49-7b961a6b7f3d None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:46.482156 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d84625-ee4c-4b51-9f49-7b961a6b7f3d None admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:46.483047 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d84625-ee4c-4b51-9f49-7b961a6b7f3d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:46.483552 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d84625-ee4c-4b51-9f49-7b961a6b7f3d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:46.485718 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d84625-ee4c-4b51-9f49-7b961a6b7f3d None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:46.503188 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 375/756] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 8 13:35:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:46.505498 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d84625-ee4c-4b51-9f49-7b961a6b7f3d None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:46.565329 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:46.573937 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:46.578140 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d27e214-77f4-4a41-843a-ec15b440285c None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:46.627419 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df66a2-2ca6-4e84-86a5-4f9bfbe63d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:46.628602 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df66a2-2ca6-4e84-86a5-4f9bfbe63d87 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:46.629173 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df66a2-2ca6-4e84-86a5-4f9bfbe63d87 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:46.629958 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df66a2-2ca6-4e84-86a5-4f9bfbe63d87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:46.645277 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d84625-ee4c-4b51-9f49-7b961a6b7f3d None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:46.654584 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05df66a2-2ca6-4e84-86a5-4f9bfbe63d87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:46.656357 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05df66a2-2ca6-4e84-86a5-4f9bfbe63d87 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:46.675433 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-05df66a2-2ca6-4e84-86a5-4f9bfbe63d87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:46.675433 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:46.675433 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:46.675433 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:46.675433 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:46.675433 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:46.675433 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:46.675433 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:46.675433 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:46.675433 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:46.675433 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:46.675433 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:46.675433 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:46.675433 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:46.675433 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:46.675433 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:46.676473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:46.676473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:46.676473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:46.676473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:46.676473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:46.676473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:46.676473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:46.676473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:46.676473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:46.676473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:46.676473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:46.676473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:46.676473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:46.676473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:46.676473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:46.676473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:46.676473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:46.678002 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:46.678002 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:46.678002 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:46.684489 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 382/757] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:46.685610 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df66a2-2ca6-4e84-86a5-4f9bfbe63d87 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:46.700804 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81358682-12f7-45e7-b20b-cf57aee5ab28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:46.710835 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81358682-12f7-45e7-b20b-cf57aee5ab28 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:46.710835 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81358682-12f7-45e7-b20b-cf57aee5ab28 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:46.710835 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81358682-12f7-45e7-b20b-cf57aee5ab28 None admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:46.710835 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81358682-12f7-45e7-b20b-cf57aee5ab28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:46.710835 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81358682-12f7-45e7-b20b-cf57aee5ab28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:46.710835 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81358682-12f7-45e7-b20b-cf57aee5ab28 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:46.728366 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 376/758] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:46.729637 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81358682-12f7-45e7-b20b-cf57aee5ab28 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:46.851867 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df66a2-2ca6-4e84-86a5-4f9bfbe63d87 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:46.858793 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81358682-12f7-45e7-b20b-cf57aee5ab28 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:46.873780 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:46.905309 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f8700-97ea-4b07-a3ea-5b0167be89b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:46.905864 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f8700-97ea-4b07-a3ea-5b0167be89b0 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:46.906141 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f8700-97ea-4b07-a3ea-5b0167be89b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:46.906498 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f8700-97ea-4b07-a3ea-5b0167be89b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:46.907138 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f8700-97ea-4b07-a3ea-5b0167be89b0 None admin] RBAC: Adding query filter params (role.id=9c76f398c9e04caeab83842e70eb824b, scope.project.id=88de9f1470c6415b97866ad5a3256ef2, user.id=fa9b97592a6840c3865d7dcf886221e0) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:46.907446 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f8700-97ea-4b07-a3ea-5b0167be89b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:46.909064 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f8700-97ea-4b07-a3ea-5b0167be89b0 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:46.911995 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4501d462-a639-4367-8465-43f7c87cc932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:46.913515 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501d462-a639-4367-8465-43f7c87cc932 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:46.914080 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501d462-a639-4367-8465-43f7c87cc932 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:46.914844 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4501d462-a639-4367-8465-43f7c87cc932 None admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:46.915707 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4501d462-a639-4367-8465-43f7c87cc932 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:46.916276 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4501d462-a639-4367-8465-43f7c87cc932 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:46.918024 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4501d462-a639-4367-8465-43f7c87cc932 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:46.921681 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 383/759] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 8 13:35:46 2022] GET /identity/v3/role_assignments?user.id=fa9b97592a6840c3865d7dcf886221e0&scope.project.id=88de9f1470c6415b97866ad5a3256ef2&role.id=9c76f398c9e04caeab83842e70eb824b => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:46.922696 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f8700-97ea-4b07-a3ea-5b0167be89b0 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:46.934561 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 377/760] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:46.941399 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4501d462-a639-4367-8465-43f7c87cc932 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:46.954268 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:47.117269 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f8700-97ea-4b07-a3ea-5b0167be89b0 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:47.141400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4501d462-a639-4367-8465-43f7c87cc932 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:47.172619 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed8582-9530-460b-9501-257c2af4c08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:47.172943 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed8582-9530-460b-9501-257c2af4c08b None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:47.173150 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed8582-9530-460b-9501-257c2af4c08b None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:47.173455 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed8582-9530-460b-9501-257c2af4c08b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:47.183891 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ed8582-9530-460b-9501-257c2af4c08b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:47.185748 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ed8582-9530-460b-9501-257c2af4c08b None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:47.186961 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c6a74-e199-4ca4-b9f3-f5760a04ae5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:47.187521 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c6a74-e199-4ca4-b9f3-f5760a04ae5c None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:47.188370 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c6a74-e199-4ca4-b9f3-f5760a04ae5c None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:47.188370 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c6a74-e199-4ca4-b9f3-f5760a04ae5c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:47.197973 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2c6a74-e199-4ca4-b9f3-f5760a04ae5c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:47.199497 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2c6a74-e199-4ca4-b9f3-f5760a04ae5c None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:47.203415 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-c6ed8582-9530-460b-9501-257c2af4c08b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:35:47.203415 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:47.203415 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:47.203415 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:47.203415 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:47.203415 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:47.203415 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:47.203415 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:47.203415 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:47.203415 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:47.203415 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:47.203415 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:47.203415 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:35:47.203415 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:35:47.203415 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:35:47.204360 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:35:47.204360 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:47.204360 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:47.204360 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:47.204360 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:47.204360 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:47.204360 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:47.204360 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:47.204360 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:47.204360 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:47.204360 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:47.204360 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:47.204360 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:47.204360 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:47.204360 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:47.204360 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:47.204360 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:47.206003 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:35:47.206003 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:35:47.206003 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:35:47.206003 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:35:47.206003 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:35:47.206003 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:35:47.206003 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:35:47.206003 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:47.206003 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 384/761] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:35:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:47.206502 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75c277-2c81-4656-bef2-2ad8a4e364ca None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:47.206502 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75c277-2c81-4656-bef2-2ad8a4e364ca None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:47.206985 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75c277-2c81-4656-bef2-2ad8a4e364ca None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:47.209155 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 385/762] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:35:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:35:47.214243 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75c277-2c81-4656-bef2-2ad8a4e364ca None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:47.220397 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-ca2c6a74-e199-4ca4-b9f3-f5760a04ae5c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:35:47.220397 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:47.220397 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:47.220397 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:47.220397 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:47.220397 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:47.220397 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:47.220397 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:47.220397 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:47.220397 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:47.220397 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:47.220397 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:47.220397 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:35:47.220397 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:35:47.220397 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:35:47.222500 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:35:47.222500 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:47.222500 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:47.222500 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:47.222500 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:47.222500 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:47.222500 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:47.222500 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:47.222500 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:47.222500 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:47.222500 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:47.222500 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:47.222500 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:47.222500 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:47.222500 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:47.222500 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:47.222500 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:47.225827 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:35:47.225827 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:35:47.225827 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:35:47.225827 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:35:47.225827 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:35:47.225827 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:35:47.225827 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:35:47.225827 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:47.225827 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 378/763] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:35:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:47.226955 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c52ed-828f-4bf7-9bce-19fe5a0f2ece None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:47.226955 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c52ed-828f-4bf7-9bce-19fe5a0f2ece None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:47.226955 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c52ed-828f-4bf7-9bce-19fe5a0f2ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:47.265966 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-a30c52ed-828f-4bf7-9bce-19fe5a0f2ece None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:35:47.269679 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-a30c52ed-828f-4bf7-9bce-19fe5a0f2ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:35:47.298024 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:47.325041 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:47.360211 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75c277-2c81-4656-bef2-2ad8a4e364ca None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:47.396252 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 379/764] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:35:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:35:47.396252 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c52ed-828f-4bf7-9bce-19fe5a0f2ece None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:47.437430 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23405f93-fd77-4522-9bb4-f6261c98c849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:47.439257 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23405f93-fd77-4522-9bb4-f6261c98c849 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:47.441327 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23405f93-fd77-4522-9bb4-f6261c98c849 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:47.441867 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23405f93-fd77-4522-9bb4-f6261c98c849 None admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:47.443303 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23405f93-fd77-4522-9bb4-f6261c98c849 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:47.444215 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23405f93-fd77-4522-9bb4-f6261c98c849 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:47.447159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23405f93-fd77-4522-9bb4-f6261c98c849 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:47.479246 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 386/765] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 8 13:35:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:47.484426 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23405f93-fd77-4522-9bb4-f6261c98c849 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:47.561115 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c52ed-828f-4bf7-9bce-19fe5a0f2ece None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:47.658142 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc533caf-09de-4add-aaa2-d71252745327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:47.658810 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc533caf-09de-4add-aaa2-d71252745327 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:47.659114 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc533caf-09de-4add-aaa2-d71252745327 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:47.659363 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc533caf-09de-4add-aaa2-d71252745327 None admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:47.660066 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc533caf-09de-4add-aaa2-d71252745327 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:47.660370 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc533caf-09de-4add-aaa2-d71252745327 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:47.662768 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc533caf-09de-4add-aaa2-d71252745327 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:47.664736 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23405f93-fd77-4522-9bb4-f6261c98c849 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:47.691780 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 380/766] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 8 13:35:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:47.697032 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc533caf-09de-4add-aaa2-d71252745327 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:47.711634 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:47.713460 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08318c0a-1772-4ca2-8e26-977cfc1c1642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:47.714193 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08318c0a-1772-4ca2-8e26-977cfc1c1642 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:47.714471 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08318c0a-1772-4ca2-8e26-977cfc1c1642 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:47.714740 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08318c0a-1772-4ca2-8e26-977cfc1c1642 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:47.715678 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08318c0a-1772-4ca2-8e26-977cfc1c1642 None admin] RBAC: Adding query filter params (role.id=e5f27e532c9d4bc7a57e31856ecee597, scope.project.id=88de9f1470c6415b97866ad5a3256ef2, user.id=6d2dd101d1a14e5ab95f272ab1bbeb94) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:47.716454 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08318c0a-1772-4ca2-8e26-977cfc1c1642 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:47.720339 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08318c0a-1772-4ca2-8e26-977cfc1c1642 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:47.720339 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:47.727540 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 387/767] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 8 13:35:47 2022] GET /identity/v3/role_assignments?user.id=6d2dd101d1a14e5ab95f272ab1bbeb94&scope.project.id=88de9f1470c6415b97866ad5a3256ef2&role.id=e5f27e532c9d4bc7a57e31856ecee597 => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:47.729267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08318c0a-1772-4ca2-8e26-977cfc1c1642 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:47.825587 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc533caf-09de-4add-aaa2-d71252745327 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:47.877492 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08318c0a-1772-4ca2-8e26-977cfc1c1642 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:47.893275 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c599e-b46d-48b0-95aa-be7705f351c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:47.894282 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c599e-b46d-48b0-95aa-be7705f351c7 None admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:47.894608 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c599e-b46d-48b0-95aa-be7705f351c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:47.894979 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c599e-b46d-48b0-95aa-be7705f351c7 None admin] PATH_INFO: `/v3/projects/88de9f1470c6415b97866ad5a3256ef2/users/c95448c1b8b1466cae37fda5c713d53f/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:47.898236 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0c599e-b46d-48b0-95aa-be7705f351c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=88de9f1470c6415b97866ad5a3256ef2, user_id=c95448c1b8b1466cae37fda5c713d53f, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:47.900045 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0c599e-b46d-48b0-95aa-be7705f351c7 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:47.927541 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db42cfd-9c36-4aaa-8d1f-e1443d4b779f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:47.928615 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db42cfd-9c36-4aaa-8d1f-e1443d4b779f None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:47.929143 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db42cfd-9c36-4aaa-8d1f-e1443d4b779f None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:47.929674 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db42cfd-9c36-4aaa-8d1f-e1443d4b779f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:47.930498 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db42cfd-9c36-4aaa-8d1f-e1443d4b779f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:47.932180 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db42cfd-9c36-4aaa-8d1f-e1443d4b779f None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:47.933866 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 381/768] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Sep 8 13:35:47 2022] PUT /identity/v3/projects/88de9f1470c6415b97866ad5a3256ef2/users/c95448c1b8b1466cae37fda5c713d53f/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:35:47.942959 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-2db42cfd-9c36-4aaa-8d1f-e1443d4b779f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 13:35:47.942959 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:47.942959 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:35:47.942959 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:35:47.942959 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:35:47.942959 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:35:47.942959 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:35:47.942959 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:35:47.942959 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 13:35:47.942959 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:47.942959 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:35:47.942959 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:47.942959 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:47.942959 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:47.942959 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:47.942959 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:47.942959 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:47.944061 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:47.944061 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:47.944061 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:47.944061 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:47.944061 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:47.944061 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:47.944061 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:35:47.944061 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:35:47.944061 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:35:47.944061 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:35:47.944061 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:47.944061 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:47.944061 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:47.944061 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:47.944061 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:47.944061 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:47.944933 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:47.944933 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:47.944933 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:47.944933 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:47.944933 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:47.944933 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:47.944933 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:47.944933 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:47.944933 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:47.944933 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:47.944933 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:35:47.944933 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:35:47.944933 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 13:35:47.944933 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:47.947968 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 388/769] 10.222.0.69 () {56 vars in 1129 bytes} [Thu Sep 8 13:35:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:47.957416 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c599e-b46d-48b0-95aa-be7705f351c7 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:48.038157 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:48.076933 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c599e-b46d-48b0-95aa-be7705f351c7 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:48.115671 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45d558-c18c-472a-9a0d-27e5fe0fa1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:48.116383 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45d558-c18c-472a-9a0d-27e5fe0fa1aa None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:48.116665 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45d558-c18c-472a-9a0d-27e5fe0fa1aa None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:48.116934 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45d558-c18c-472a-9a0d-27e5fe0fa1aa None admin] PATH_INFO: `/v3/services` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:48.117604 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c45d558-c18c-472a-9a0d-27e5fe0fa1aa None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:48.117908 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c45d558-c18c-472a-9a0d-27e5fe0fa1aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:48.119290 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c45d558-c18c-472a-9a0d-27e5fe0fa1aa None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:48.125089 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 382/770] 10.222.0.69 () {56 vars in 1124 bytes} [Thu Sep 8 13:35:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:48.131373 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db42cfd-9c36-4aaa-8d1f-e1443d4b779f None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:48.211132 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:48.261821 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db42cfd-9c36-4aaa-8d1f-e1443d4b779f None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:48.308202 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1dac62-98b1-4405-bdd1-cfc252a7c8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:48.308655 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1dac62-98b1-4405-bdd1-cfc252a7c8b8 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:48.308928 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1dac62-98b1-4405-bdd1-cfc252a7c8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:48.309197 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1dac62-98b1-4405-bdd1-cfc252a7c8b8 None admin] PATH_INFO: `/v3/services` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:48.309865 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1dac62-98b1-4405-bdd1-cfc252a7c8b8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:48.310165 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1dac62-98b1-4405-bdd1-cfc252a7c8b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:48.311535 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1dac62-98b1-4405-bdd1-cfc252a7c8b8 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:48.318554 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 389/771] 10.222.0.69 () {56 vars in 1124 bytes} [Thu Sep 8 13:35:48 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:48.326585 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45d558-c18c-472a-9a0d-27e5fe0fa1aa None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:48.476390 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45d558-c18c-472a-9a0d-27e5fe0fa1aa None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:48.511096 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3579e3-6632-45a3-9d14-8c7184b3b74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:48.511706 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3579e3-6632-45a3-9d14-8c7184b3b74d None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:48.511984 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3579e3-6632-45a3-9d14-8c7184b3b74d None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:48.512252 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3579e3-6632-45a3-9d14-8c7184b3b74d None admin] PATH_INFO: `/v3/endpoints` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:48.512946 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3579e3-6632-45a3-9d14-8c7184b3b74d None admin] RBAC: Adding query filter params (interface=public, service_id=c5711b071ee343ef9eeebe362236c4f8, region_id=RegionOne) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:48.513248 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3579e3-6632-45a3-9d14-8c7184b3b74d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:48.514648 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3579e3-6632-45a3-9d14-8c7184b3b74d None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:48.516626 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:48.524811 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 383/772] 10.222.0.69 () {56 vars in 1251 bytes} [Thu Sep 8 13:35:48 2022] GET /identity/v3/endpoints?service_id=c5711b071ee343ef9eeebe362236c4f8&interface=public®ion_id=RegionOne => generated 194 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:48.530492 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1dac62-98b1-4405-bdd1-cfc252a7c8b8 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:48.661335 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1dac62-98b1-4405-bdd1-cfc252a7c8b8 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:48.698475 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:48.708383 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24e895-fe5a-4f2d-8a52-5a99664c8a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:48.708990 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24e895-fe5a-4f2d-8a52-5a99664c8a19 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:48.709268 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24e895-fe5a-4f2d-8a52-5a99664c8a19 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:48.709564 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24e895-fe5a-4f2d-8a52-5a99664c8a19 None admin] PATH_INFO: `/v3/services` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:48.710172 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f24e895-fe5a-4f2d-8a52-5a99664c8a19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:48.711533 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f24e895-fe5a-4f2d-8a52-5a99664c8a19 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:48.723013 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 390/773] 10.222.0.69 () {56 vars in 1087 bytes} [Thu Sep 8 13:35:48 2022] GET /identity/v3/services => generated 772 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:35:48.858263 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d25ef-e775-4216-81fc-731ea64e2a0f None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:48.858461 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d25ef-e775-4216-81fc-731ea64e2a0f None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:48.858729 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d25ef-e775-4216-81fc-731ea64e2a0f None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:48.860263 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 384/774] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:35:48.875264 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240330e-2793-4a26-b4e2-33fd46f03065 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:48.875594 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240330e-2793-4a26-b4e2-33fd46f03065 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:48.875812 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240330e-2793-4a26-b4e2-33fd46f03065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:48.901680 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-1240330e-2793-4a26-b4e2-33fd46f03065 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:35:48.902983 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-1240330e-2793-4a26-b4e2-33fd46f03065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:35:49.019431 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 391/775] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:35:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:35:49.460309 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d25ef-e775-4216-81fc-731ea64e2a0f None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:49.601928 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d25ef-e775-4216-81fc-731ea64e2a0f None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:49.643774 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa5347-3441-416d-a290-8848bf6f68ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:49.644532 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa5347-3441-416d-a290-8848bf6f68ad None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:49.644808 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa5347-3441-416d-a290-8848bf6f68ad None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:49.645189 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa5347-3441-416d-a290-8848bf6f68ad None admin] PATH_INFO: `/v3/services/network` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:49.646561 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa5347-3441-416d-a290-8848bf6f68ad None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:49.647927 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa5347-3441-416d-a290-8848bf6f68ad None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:49.651863 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0ba40-cc82-49e0-9ecd-254395dfb4cf None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:49.652446 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0ba40-cc82-49e0-9ecd-254395dfb4cf None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:49.653020 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0ba40-cc82-49e0-9ecd-254395dfb4cf None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:49.654958 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 392/776] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:35:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:35:49.661398 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-afaa5347-3441-416d-a290-8848bf6f68ad None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 13:35:49.661398 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:49.661398 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:35:49.661398 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:35:49.661398 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:35:49.661398 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:35:49.661398 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:35:49.661398 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:35:49.661398 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 13:35:49.661398 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:49.661398 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:35:49.661398 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:49.661398 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:49.661398 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:49.661398 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:49.661398 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:49.661398 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:49.662660 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:49.662660 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:49.662660 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:49.662660 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:49.662660 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:49.662660 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:49.662660 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:35:49.662660 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:35:49.662660 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:35:49.662660 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:35:49.662660 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:49.662660 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:49.662660 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:49.662660 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:49.662660 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:49.662660 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:49.664388 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:49.664388 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:49.664388 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:49.664388 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:49.664388 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:49.664388 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:49.664388 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:49.664388 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:49.664388 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:49.664388 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:49.664388 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:35:49.664388 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:35:49.664388 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 13:35:49.664388 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:49.664388 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 385/777] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:35:49 2022] GET /identity/v3/services/network => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:49.667750 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b0ba40-cc82-49e0-9ecd-254395dfb4cf None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:49.668100 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac7a8e-5855-441a-a149-149035be5ced None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:49.668383 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac7a8e-5855-441a-a149-149035be5ced None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:49.668728 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac7a8e-5855-441a-a149-149035be5ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:49.703684 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-39ac7a8e-5855-441a-a149-149035be5ced None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:35:49.704875 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-39ac7a8e-5855-441a-a149-149035be5ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:35:49.821013 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:49.853565 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 386/778] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:35:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:35:49.870093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b0ba40-cc82-49e0-9ecd-254395dfb4cf None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:49.897792 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:49.917013 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca1597-cd4e-4896-b936-a8675cee7436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:49.917664 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca1597-cd4e-4896-b936-a8675cee7436 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:49.918027 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca1597-cd4e-4896-b936-a8675cee7436 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:49.918197 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca1597-cd4e-4896-b936-a8675cee7436 None admin] PATH_INFO: `/v3/services` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:49.918807 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ca1597-cd4e-4896-b936-a8675cee7436 None admin] RBAC: Adding query filter params (name=network) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:49.919108 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ca1597-cd4e-4896-b936-a8675cee7436 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:49.920463 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ca1597-cd4e-4896-b936-a8675cee7436 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:49.928984 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 393/779] 10.222.0.69 () {56 vars in 1112 bytes} [Thu Sep 8 13:35:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:49.934348 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac7a8e-5855-441a-a149-149035be5ced None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:50.050071 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac7a8e-5855-441a-a149-149035be5ced None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:50.088163 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fdd80f-7b0a-41d0-bcbc-ad16943673cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:50.088767 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdd80f-7b0a-41d0-bcbc-ad16943673cf None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:50.089042 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdd80f-7b0a-41d0-bcbc-ad16943673cf None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:50.089306 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdd80f-7b0a-41d0-bcbc-ad16943673cf None admin] PATH_INFO: `/v3/services` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:50.090055 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fdd80f-7b0a-41d0-bcbc-ad16943673cf None admin] RBAC: Adding query filter params (type=network) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:50.090353 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fdd80f-7b0a-41d0-bcbc-ad16943673cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:50.091840 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fdd80f-7b0a-41d0-bcbc-ad16943673cf None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:50.097690 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 387/780] 10.222.0.69 () {56 vars in 1112 bytes} [Thu Sep 8 13:35:49 2022] GET /identity/v3/services?type=network => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:50.103541 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca1597-cd4e-4896-b936-a8675cee7436 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:50.230496 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca1597-cd4e-4896-b936-a8675cee7436 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:50.297676 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c1c2ee-7f42-431b-b2d4-4f99abb49396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:50.298357 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1c2ee-7f42-431b-b2d4-4f99abb49396 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:50.298629 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1c2ee-7f42-431b-b2d4-4f99abb49396 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:50.298890 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c1c2ee-7f42-431b-b2d4-4f99abb49396 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:50.299598 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c1c2ee-7f42-431b-b2d4-4f99abb49396 None admin] RBAC: Adding query filter params (interface=public, service_id=31cbd26c1b0c43bab3dd09ba86bbb6d0, region_id=RegionOne) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:50.299899 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c1c2ee-7f42-431b-b2d4-4f99abb49396 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:50.301261 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c1c2ee-7f42-431b-b2d4-4f99abb49396 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:50.315200 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 394/781] 10.222.0.69 () {56 vars in 1251 bytes} [Thu Sep 8 13:35:50 2022] GET /identity/v3/endpoints?service_id=31cbd26c1b0c43bab3dd09ba86bbb6d0&interface=public®ion_id=RegionOne => generated 194 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:35:50.321678 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fdd80f-7b0a-41d0-bcbc-ad16943673cf None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:50.365996 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c1c2ee-7f42-431b-b2d4-4f99abb49396 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:50.407534 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:50.444341 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:50.510829 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fdd80f-7b0a-41d0-bcbc-ad16943673cf None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:50.530255 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c1c2ee-7f42-431b-b2d4-4f99abb49396 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:50.576504 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676734b-1a26-4d7f-badd-f664d80fea93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:50.577116 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676734b-1a26-4d7f-badd-f664d80fea93 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:50.577416 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676734b-1a26-4d7f-badd-f664d80fea93 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:50.577690 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676734b-1a26-4d7f-badd-f664d80fea93 None admin] PATH_INFO: `/v3/services` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:50.578289 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0676734b-1a26-4d7f-badd-f664d80fea93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:50.579791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0676734b-1a26-4d7f-badd-f664d80fea93 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:50.590986 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 388/782] 10.222.0.69 () {56 vars in 1087 bytes} [Thu Sep 8 13:35:50 2022] GET /identity/v3/services => generated 772 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:50.596156 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141d681-6cb3-4ed7-a93e-82f43b4547b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:50.596808 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141d681-6cb3-4ed7-a93e-82f43b4547b9 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:50.597084 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141d681-6cb3-4ed7-a93e-82f43b4547b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:50.597351 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141d681-6cb3-4ed7-a93e-82f43b4547b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:50.618185 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7141d681-6cb3-4ed7-a93e-82f43b4547b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:35:50.623916 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-7141d681-6cb3-4ed7-a93e-82f43b4547b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:35:50.623916 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:50.623916 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:50.623916 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:50.623916 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:50.623916 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:50.623916 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:50.623916 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:50.623916 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:50.623916 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:50.623916 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:50.623916 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:50.623916 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:35:50.623916 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:35:50.623916 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:35:50.623916 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:35:50.625692 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:35:50.625692 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:35:50.625692 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:35:50.625692 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:35:50.625692 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:50.625692 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:50.625692 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:50.625692 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:50.625692 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:50.625692 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:50.625692 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:50.625692 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:50.625692 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:50.625692 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:50.625692 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:50.625692 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:50.627677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:50.627677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:50.627677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:50.627677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:50.627677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:35:50.627677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:35:50.627677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:35:50.627677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:35:50.627677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:35:50.627677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:35:50.627677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:35:50.627677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:50.637115 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 395/783] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 8 13:35:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:35:50.638787 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676734b-1a26-4d7f-badd-f664d80fea93 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:50.772722 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676734b-1a26-4d7f-badd-f664d80fea93 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:50.796482 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:50.814680 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425327b4-d7e5-4e31-9cdc-81f5b1af4f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:50.815346 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425327b4-d7e5-4e31-9cdc-81f5b1af4f74 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:50.815623 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425327b4-d7e5-4e31-9cdc-81f5b1af4f74 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:50.815911 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425327b4-d7e5-4e31-9cdc-81f5b1af4f74 None admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:50.816558 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425327b4-d7e5-4e31-9cdc-81f5b1af4f74 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:50.816855 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425327b4-d7e5-4e31-9cdc-81f5b1af4f74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:50.819038 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425327b4-d7e5-4e31-9cdc-81f5b1af4f74 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:50.833651 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 389/784] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:35:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:50.836029 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141d681-6cb3-4ed7-a93e-82f43b4547b9 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:50.909406 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63acd7a1-bed8-40cd-b683-518582539ae1 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:50.909694 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63acd7a1-bed8-40cd-b683-518582539ae1 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:50.910019 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63acd7a1-bed8-40cd-b683-518582539ae1 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:50.918509 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 390/785] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:35:50 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:35:50.924726 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84ee30-b298-4f93-96d8-ab0b34cd5552 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:50.925456 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84ee30-b298-4f93-96d8-ab0b34cd5552 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:50.925932 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84ee30-b298-4f93-96d8-ab0b34cd5552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:50.948081 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-bc84ee30-b298-4f93-96d8-ab0b34cd5552 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:35:50.949781 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-bc84ee30-b298-4f93-96d8-ab0b34cd5552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:35:50.987934 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141d681-6cb3-4ed7-a93e-82f43b4547b9 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:51.002557 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:51.040146 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 391/786] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:35:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:35:51.047366 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b224a1d-0607-48d3-bae3-57266c419633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:51.048281 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b224a1d-0607-48d3-bae3-57266c419633 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:51.048735 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b224a1d-0607-48d3-bae3-57266c419633 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:51.049162 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b224a1d-0607-48d3-bae3-57266c419633 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:51.064753 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b224a1d-0607-48d3-bae3-57266c419633 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:51.066638 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b224a1d-0607-48d3-bae3-57266c419633 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:51.073179 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431b25b-d6cb-4749-b2ce-79f00deb078c None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:51.073786 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431b25b-d6cb-4749-b2ce-79f00deb078c None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:51.074370 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a431b25b-d6cb-4749-b2ce-79f00deb078c None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:51.076060 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 392/787] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:35:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:35:51.081950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431c469-fb01-4874-bc26-06d40cd77c7c None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:51.082557 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431c469-fb01-4874-bc26-06d40cd77c7c None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:51.083554 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431c469-fb01-4874-bc26-06d40cd77c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:51.091193 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-3b224a1d-0607-48d3-bae3-57266c419633 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:51.091193 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:51.091193 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:51.091193 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:51.091193 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:51.091193 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:51.091193 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:51.091193 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:51.091193 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:51.091193 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:51.091193 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:51.091193 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:51.091193 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:51.091193 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:51.091193 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:51.091193 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:51.092288 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:51.092288 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:51.092288 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:51.092288 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:51.092288 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:51.092288 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:51.092288 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:51.092288 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:51.092288 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:51.092288 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:51.092288 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:51.092288 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:51.092288 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:51.092288 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:51.092288 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:51.092288 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:51.092288 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:51.093215 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:51.093215 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:51.093215 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:51.093215 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 396/788] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:35:51.099368 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b224a1d-0607-48d3-bae3-57266c419633 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:51.123108 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-8431c469-fb01-4874-bc26-06d40cd77c7c None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:35:51.124569 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-8431c469-fb01-4874-bc26-06d40cd77c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:35:51.299409 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 393/789] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:35:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:35:51.347271 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8431c469-fb01-4874-bc26-06d40cd77c7c None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:51.366028 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b224a1d-0607-48d3-bae3-57266c419633 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:51.404312 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a31c3d-4678-4f39-9117-23ffdf29a370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:51.405297 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a31c3d-4678-4f39-9117-23ffdf29a370 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:51.405807 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a31c3d-4678-4f39-9117-23ffdf29a370 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:51.406311 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a31c3d-4678-4f39-9117-23ffdf29a370 None admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:51.407153 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a31c3d-4678-4f39-9117-23ffdf29a370 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:51.407653 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a31c3d-4678-4f39-9117-23ffdf29a370 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:51.409231 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a31c3d-4678-4f39-9117-23ffdf29a370 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:51.425276 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 397/790] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:51.432573 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a31c3d-4678-4f39-9117-23ffdf29a370 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:51.454998 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:51.474005 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:51.561646 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8431c469-fb01-4874-bc26-06d40cd77c7c None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:51.617123 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a31c3d-4678-4f39-9117-23ffdf29a370 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:51.631925 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb1ce7-9419-43c8-b503-6c064882c3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:51.632596 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb1ce7-9419-43c8-b503-6c064882c3bc None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:51.632876 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb1ce7-9419-43c8-b503-6c064882c3bc None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:51.633144 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb1ce7-9419-43c8-b503-6c064882c3bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:51.646221 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb1ce7-9419-43c8-b503-6c064882c3bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:35:51.651281 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-32cb1ce7-9419-43c8-b503-6c064882c3bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:35:51.651281 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:51.651281 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:51.651281 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:51.651281 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:51.651281 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:51.651281 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:51.651281 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:51.651281 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:51.651281 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:51.651281 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:51.651281 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:51.651281 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:35:51.651281 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:35:51.651281 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:35:51.651281 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:35:51.652234 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:35:51.652234 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:35:51.652234 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:35:51.652234 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:35:51.652234 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:51.652234 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:51.652234 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:51.652234 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:51.652234 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:51.652234 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:51.652234 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:51.652234 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:51.652234 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:51.652234 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:51.652234 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:51.652234 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:51.653331 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:51.653331 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:51.653331 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:51.653331 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:51.653331 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:35:51.653331 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:35:51.653331 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:35:51.653331 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:35:51.653331 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:35:51.653331 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:35:51.653331 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:35:51.653331 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:51.653331 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 394/791] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 8 13:35:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:35:51.654107 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb1ce7-9419-43c8-b503-6c064882c3bc None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:51.678468 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491ea41-4b65-4975-a2a5-a28f12d40e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:51.679504 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491ea41-4b65-4975-a2a5-a28f12d40e75 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:51.679958 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491ea41-4b65-4975-a2a5-a28f12d40e75 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:51.680400 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491ea41-4b65-4975-a2a5-a28f12d40e75 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:51.689215 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4491ea41-4b65-4975-a2a5-a28f12d40e75 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:51.691259 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4491ea41-4b65-4975-a2a5-a28f12d40e75 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:51.704734 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-4491ea41-4b65-4975-a2a5-a28f12d40e75 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 08 13:35:51.704734 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:51.704734 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:51.704734 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:51.704734 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:51.704734 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:51.704734 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:51.704734 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:51.704734 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:51.704734 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:51.704734 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:51.704734 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:51.704734 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:35:51.704734 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:35:51.704734 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:35:51.704734 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:35:51.705793 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:51.705793 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:51.705793 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:35:51.705793 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:35:51.705793 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:35:51.705793 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:35:51.705793 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:51.705793 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:51.705793 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:51.705793 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:51.705793 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:51.705793 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:51.705793 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:51.705793 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:51.705793 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:51.705793 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:51.705793 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:51.705793 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:51.706767 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:51.706767 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:51.706767 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:35:51.706767 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:35:51.706767 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:35:51.706767 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:35:51.706767 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:35:51.706767 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:35:51.706767 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 08 13:35:51.706767 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:51.714859 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 398/792] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 8 13:35:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:51.716148 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491ea41-4b65-4975-a2a5-a28f12d40e75 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:51.781768 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb1ce7-9419-43c8-b503-6c064882c3bc None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:51.783538 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:51.817880 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:51.826146 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98775322-9218-4a39-8051-884b80341d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:51.826801 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98775322-9218-4a39-8051-884b80341d8f None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:51.827081 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98775322-9218-4a39-8051-884b80341d8f None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:51.827358 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98775322-9218-4a39-8051-884b80341d8f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:51.840768 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98775322-9218-4a39-8051-884b80341d8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:35:51.844549 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491ea41-4b65-4975-a2a5-a28f12d40e75 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:51.846472 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-98775322-9218-4a39-8051-884b80341d8f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:35:51.846472 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:51.846472 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:51.846472 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:51.846472 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:51.846472 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:51.846472 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:51.846472 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:51.846472 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:51.846472 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:51.846472 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:51.846472 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:51.846472 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:35:51.846472 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:35:51.846472 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:35:51.846472 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:35:51.847547 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:35:51.847547 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:35:51.847547 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:35:51.847547 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:35:51.847547 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:51.847547 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:51.847547 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:51.847547 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:51.847547 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:51.847547 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:51.847547 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:51.847547 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:51.847547 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:51.847547 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:51.847547 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:51.847547 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:51.853907 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:51.853907 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:51.853907 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:51.853907 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:51.853907 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:35:51.853907 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:35:51.853907 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:35:51.853907 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:35:51.853907 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:35:51.853907 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:35:51.853907 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:35:51.853907 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:51.853907 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 395/793] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Sep 8 13:35:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:51.853907 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98775322-9218-4a39-8051-884b80341d8f None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:51.896476 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21018c40-e8f0-4bb8-b75e-b792571abb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:51.897648 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21018c40-e8f0-4bb8-b75e-b792571abb47 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:51.898099 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21018c40-e8f0-4bb8-b75e-b792571abb47 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:51.898514 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21018c40-e8f0-4bb8-b75e-b792571abb47 None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:51.899367 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21018c40-e8f0-4bb8-b75e-b792571abb47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:51.899882 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21018c40-e8f0-4bb8-b75e-b792571abb47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:51.901555 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21018c40-e8f0-4bb8-b75e-b792571abb47 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:51.917867 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 399/794] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:35:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:51.919185 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21018c40-e8f0-4bb8-b75e-b792571abb47 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:51.982963 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98775322-9218-4a39-8051-884b80341d8f None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:52.030909 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c746523-05ed-4abd-92a0-db089d1b6825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:52.031516 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c746523-05ed-4abd-92a0-db089d1b6825 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:52.031818 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c746523-05ed-4abd-92a0-db089d1b6825 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:52.032087 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c746523-05ed-4abd-92a0-db089d1b6825 None admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:52.032834 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c746523-05ed-4abd-92a0-db089d1b6825 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:52.033135 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c746523-05ed-4abd-92a0-db089d1b6825 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:52.034646 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c746523-05ed-4abd-92a0-db089d1b6825 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:52.053240 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21018c40-e8f0-4bb8-b75e-b792571abb47 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:52.064065 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 396/795] 10.222.0.69 () {56 vars in 1135 bytes} [Thu Sep 8 13:35:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:52.064065 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba541c0-da25-456b-9c91-8af150f43e7d None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:52.064065 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba541c0-da25-456b-9c91-8af150f43e7d None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:52.064065 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba541c0-da25-456b-9c91-8af150f43e7d None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:52.065750 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 397/796] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:35:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:35:52.068187 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba541c0-da25-456b-9c91-8af150f43e7d None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:52.100369 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:52.105239 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb23e7-e92c-4b35-8731-5c98b47d078a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:52.105887 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb23e7-e92c-4b35-8731-5c98b47d078a None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:52.106166 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb23e7-e92c-4b35-8731-5c98b47d078a None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:52.106435 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb23e7-e92c-4b35-8731-5c98b47d078a None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:52.107260 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb23e7-e92c-4b35-8731-5c98b47d078a None admin] RBAC: Adding query filter params (name=service) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:52.107564 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb23e7-e92c-4b35-8731-5c98b47d078a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:52.108924 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb23e7-e92c-4b35-8731-5c98b47d078a None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:52.123517 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 400/797] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Sep 8 13:35:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:52.124172 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb23e7-e92c-4b35-8731-5c98b47d078a None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:52.129173 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:52.203231 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba541c0-da25-456b-9c91-8af150f43e7d None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:52.246625 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76cf49-d792-4dfc-9975-875a1dc85582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:52.247379 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76cf49-d792-4dfc-9975-875a1dc85582 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:52.247667 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76cf49-d792-4dfc-9975-875a1dc85582 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:52.247944 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76cf49-d792-4dfc-9975-875a1dc85582 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:52.255316 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb23e7-e92c-4b35-8731-5c98b47d078a None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:52.260834 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c76cf49-d792-4dfc-9975-875a1dc85582 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:52.262671 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c76cf49-d792-4dfc-9975-875a1dc85582 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:52.281548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-2c76cf49-d792-4dfc-9975-875a1dc85582 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:52.281548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:52.281548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:52.281548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:52.281548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:52.281548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:52.281548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:52.281548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:52.281548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:52.281548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:52.281548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:52.281548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:52.281548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:52.281548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:52.281548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:52.281548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:52.282791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:52.282791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:52.282791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:52.282791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:52.282791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:52.282791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:52.282791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:52.282791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:52.282791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:52.282791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:52.282791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:52.282791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:52.282791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:52.282791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:52.282791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:52.282791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:52.282791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:52.283927 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:52.283927 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:52.283927 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:52.287420 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 398/798] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:52.288714 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75192816-b8a2-4c34-9d69-6bc8f274888b None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:52.288988 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75192816-b8a2-4c34-9d69-6bc8f274888b None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:52.289258 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75192816-b8a2-4c34-9d69-6bc8f274888b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:52.306425 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc1a4e-c37d-4e9c-b7ca-ffa3d30bcd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:52.307072 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc1a4e-c37d-4e9c-b7ca-ffa3d30bcd2c None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:52.307350 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc1a4e-c37d-4e9c-b7ca-ffa3d30bcd2c None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:52.307626 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc1a4e-c37d-4e9c-b7ca-ffa3d30bcd2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:52.309800 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-75192816-b8a2-4c34-9d69-6bc8f274888b None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:35:52.311177 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-75192816-b8a2-4c34-9d69-6bc8f274888b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:35:52.322848 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc1a4e-c37d-4e9c-b7ca-ffa3d30bcd2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:52.324622 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc1a4e-c37d-4e9c-b7ca-ffa3d30bcd2c None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:52.340601 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-dcfc1a4e-c37d-4e9c-b7ca-ffa3d30bcd2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:52.340601 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:52.340601 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:52.340601 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:52.340601 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:52.340601 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:52.340601 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:52.340601 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:52.340601 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:52.340601 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:52.340601 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:52.340601 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:52.340601 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:52.340601 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:52.340601 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:52.340601 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:52.341922 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:52.341922 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:52.341922 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:52.341922 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:52.341922 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:52.341922 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:52.341922 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:52.341922 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:52.341922 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:52.341922 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:52.341922 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:52.341922 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:52.341922 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:52.341922 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:52.341922 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:52.341922 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:52.341922 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:52.343137 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:52.343137 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:52.343137 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:52.343137 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 401/799] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:52.343137 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc1a4e-c37d-4e9c-b7ca-ffa3d30bcd2c None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:52.392801 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 399/800] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:35:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:35:52.394214 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75192816-b8a2-4c34-9d69-6bc8f274888b None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:52.396954 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:52.420584 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:52.475462 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc1a4e-c37d-4e9c-b7ca-ffa3d30bcd2c None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:52.518126 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064c9fb-b2df-432b-9b73-b5c7f92de045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:52.519155 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064c9fb-b2df-432b-9b73-b5c7f92de045 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:52.519596 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064c9fb-b2df-432b-9b73-b5c7f92de045 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:52.520016 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6064c9fb-b2df-432b-9b73-b5c7f92de045 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:52.533212 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6064c9fb-b2df-432b-9b73-b5c7f92de045 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:52.535108 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6064c9fb-b2df-432b-9b73-b5c7f92de045 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:52.546923 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75192816-b8a2-4c34-9d69-6bc8f274888b None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:52.558125 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-6064c9fb-b2df-432b-9b73-b5c7f92de045 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:52.558125 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:52.558125 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:52.558125 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:52.558125 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:52.558125 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:52.558125 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:52.558125 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:52.558125 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:52.558125 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:52.558125 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:52.558125 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:52.558125 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:52.558125 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:52.558125 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:52.558125 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:52.560219 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:52.560219 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:52.560219 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:52.560219 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:52.560219 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:52.560219 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:52.560219 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:52.560219 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:52.560219 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:52.560219 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:52.560219 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:52.560219 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:52.560219 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:52.560219 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:52.560219 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:52.560219 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:52.560219 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:52.562325 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:52.562325 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:52.562325 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:52.572658 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 402/801] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:52.574851 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064c9fb-b2df-432b-9b73-b5c7f92de045 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:52.586820 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f11e5-0b48-47af-bb4f-5aab2c1d3b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:52.587432 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f11e5-0b48-47af-bb4f-5aab2c1d3b97 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:52.587720 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f11e5-0b48-47af-bb4f-5aab2c1d3b97 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:52.587990 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f11e5-0b48-47af-bb4f-5aab2c1d3b97 None admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:52.588644 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f11e5-0b48-47af-bb4f-5aab2c1d3b97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:52.588944 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f11e5-0b48-47af-bb4f-5aab2c1d3b97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:52.591214 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f11e5-0b48-47af-bb4f-5aab2c1d3b97 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:52.606842 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 400/802] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:52.608026 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f11e5-0b48-47af-bb4f-5aab2c1d3b97 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:52.680205 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:52.725531 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f11e5-0b48-47af-bb4f-5aab2c1d3b97 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:52.731325 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6064c9fb-b2df-432b-9b73-b5c7f92de045 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:52.744309 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:52.765248 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a787c912-dfc6-4bb9-96ba-9a1391ffdfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:52.766093 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a787c912-dfc6-4bb9-96ba-9a1391ffdfa5 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:52.766493 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a787c912-dfc6-4bb9-96ba-9a1391ffdfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:52.766876 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a787c912-dfc6-4bb9-96ba-9a1391ffdfa5 None admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:52.767637 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a787c912-dfc6-4bb9-96ba-9a1391ffdfa5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:52.768067 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a787c912-dfc6-4bb9-96ba-9a1391ffdfa5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:52.769615 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a787c912-dfc6-4bb9-96ba-9a1391ffdfa5 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:52.789536 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 401/803] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:52.789536 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a787c912-dfc6-4bb9-96ba-9a1391ffdfa5 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:52.791678 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31b69e-f2d2-4b13-923d-196a45cba9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:52.792366 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31b69e-f2d2-4b13-923d-196a45cba9d5 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:52.792654 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31b69e-f2d2-4b13-923d-196a45cba9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:52.792935 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31b69e-f2d2-4b13-923d-196a45cba9d5 None admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:52.793666 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a31b69e-f2d2-4b13-923d-196a45cba9d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:52.793983 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a31b69e-f2d2-4b13-923d-196a45cba9d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:52.795431 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a31b69e-f2d2-4b13-923d-196a45cba9d5 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:52.809419 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 403/804] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:52.814865 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31b69e-f2d2-4b13-923d-196a45cba9d5 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:52.902079 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a787c912-dfc6-4bb9-96ba-9a1391ffdfa5 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:52.930374 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:52.935541 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31b69e-f2d2-4b13-923d-196a45cba9d5 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:52.944686 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac913613-7d3d-483d-a34d-637990a05ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:52.945327 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac913613-7d3d-483d-a34d-637990a05ce6 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:52.945631 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac913613-7d3d-483d-a34d-637990a05ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:52.945903 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac913613-7d3d-483d-a34d-637990a05ce6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:52.954648 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac913613-7d3d-483d-a34d-637990a05ce6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:52.956237 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac913613-7d3d-483d-a34d-637990a05ce6 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:52.970847 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-ac913613-7d3d-483d-a34d-637990a05ce6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:35:52.970847 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:52.970847 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:52.970847 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:52.970847 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:52.970847 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:52.970847 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:52.970847 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:52.970847 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:52.970847 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:52.970847 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:52.970847 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:52.970847 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:35:52.970847 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:35:52.970847 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:35:52.970847 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:35:52.972700 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:52.972700 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:52.972700 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:35:52.972700 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:35:52.972700 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:35:52.972700 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:35:52.972700 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:52.972700 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:52.972700 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:52.972700 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:52.972700 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:52.972700 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:52.972700 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:52.972700 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:52.972700 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:52.972700 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:52.972700 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:52.972700 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:52.975564 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:52.975564 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:52.975564 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:35:52.975564 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:35:52.975564 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:35:52.975564 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:35:52.975564 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:35:52.975564 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:35:52.975564 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:35:52.975564 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:52.975564 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 402/805] 10.222.0.69 () {56 vars in 1093 bytes} [Thu Sep 8 13:35:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:52.975564 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac913613-7d3d-483d-a34d-637990a05ce6 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:52.989640 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d17e01-c6fa-4005-a7fb-ac60703d1852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:52.990637 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d17e01-c6fa-4005-a7fb-ac60703d1852 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:52.991076 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d17e01-c6fa-4005-a7fb-ac60703d1852 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:52.991352 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d17e01-c6fa-4005-a7fb-ac60703d1852 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:52.991941 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d17e01-c6fa-4005-a7fb-ac60703d1852 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:52.993309 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d17e01-c6fa-4005-a7fb-ac60703d1852 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:53.003083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-c4d17e01-c6fa-4005-a7fb-ac60703d1852 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 13:35:53.003083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:53.003083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:35:53.003083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:35:53.003083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:35:53.003083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:35:53.003083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:35:53.003083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:35:53.003083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 13:35:53.003083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:53.003083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:35:53.003083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:53.003083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:53.003083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:53.003083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:53.003083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:53.003083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:53.004472 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:53.004472 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:53.004472 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:53.004472 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:53.004472 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:53.004472 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:53.004472 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:35:53.004472 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:35:53.004472 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:35:53.004472 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:35:53.004472 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:53.004472 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:53.004472 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:53.004472 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:53.004472 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:53.004472 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:53.006359 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:53.006359 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:53.006359 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:53.006359 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:53.006359 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:53.006359 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:53.006359 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:53.006359 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:53.006359 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:53.006359 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:53.006359 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:35:53.006359 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:35:53.006359 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 08 13:35:53.006359 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:53.006359 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 404/806] 10.222.0.69 () {56 vars in 1129 bytes} [Thu Sep 8 13:35:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:53.007161 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d17e01-c6fa-4005-a7fb-ac60703d1852 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:53.049640 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:53.148583 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d17e01-c6fa-4005-a7fb-ac60703d1852 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:53.160182 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac913613-7d3d-483d-a34d-637990a05ce6 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:53.192927 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1be0eb-ca6c-41e4-84e2-03cdf60ca6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:53.193978 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1be0eb-ca6c-41e4-84e2-03cdf60ca6d3 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:53.194286 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1be0eb-ca6c-41e4-84e2-03cdf60ca6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:53.194563 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1be0eb-ca6c-41e4-84e2-03cdf60ca6d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:53.203710 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78debeac-4ea5-449e-af96-ce3f70280f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:53.203946 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1be0eb-ca6c-41e4-84e2-03cdf60ca6d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:53.204360 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78debeac-4ea5-449e-af96-ce3f70280f0b None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:53.204632 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78debeac-4ea5-449e-af96-ce3f70280f0b None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:53.204900 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78debeac-4ea5-449e-af96-ce3f70280f0b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:53.205281 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1be0eb-ca6c-41e4-84e2-03cdf60ca6d3 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:53.213942 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78debeac-4ea5-449e-af96-ce3f70280f0b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:53.215549 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78debeac-4ea5-449e-af96-ce3f70280f0b None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:53.220692 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-ca1be0eb-ca6c-41e4-84e2-03cdf60ca6d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:35:53.220692 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:53.220692 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:53.220692 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:53.220692 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:53.220692 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:53.220692 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:53.220692 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:53.220692 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:53.220692 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:53.220692 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:53.220692 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:53.220692 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:35:53.220692 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:35:53.220692 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:35:53.221818 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:35:53.221818 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:53.221818 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:53.221818 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:53.221818 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:53.221818 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:53.221818 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:53.221818 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:53.221818 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:53.221818 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:53.221818 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:53.221818 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:53.221818 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:53.221818 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:53.221818 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:53.221818 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:53.221818 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:53.222879 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:35:53.222879 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:35:53.222879 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:35:53.222879 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:35:53.222879 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:35:53.222879 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:35:53.222879 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:35:53.222879 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:53.225549 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 405/807] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:35:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:53.226815 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1be0eb-ca6c-41e4-84e2-03cdf60ca6d3 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:53.231381 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-78debeac-4ea5-449e-af96-ce3f70280f0b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 13:35:53.231381 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:53.231381 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:53.231381 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:53.231381 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:53.231381 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:53.231381 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:53.231381 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:53.231381 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:53.231381 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:53.231381 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:53.231381 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:53.231381 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:35:53.231381 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:35:53.231381 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:35:53.231381 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:35:53.232400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:53.232400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:53.232400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:35:53.232400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:35:53.232400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:35:53.232400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:35:53.232400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:53.232400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:53.232400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:53.232400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:53.232400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:53.232400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:53.232400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:53.232400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:53.232400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:53.232400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:53.232400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:53.232400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:53.234159 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:53.234159 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:53.234159 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:35:53.234159 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:35:53.234159 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:35:53.234159 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:35:53.234159 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:35:53.234159 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:35:53.234159 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 13:35:53.234159 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:53.234159 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 403/808] 10.222.0.69 () {56 vars in 1117 bytes} [Thu Sep 8 13:35:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:53.234159 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78debeac-4ea5-449e-af96-ce3f70280f0b None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:53.299026 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:53.371384 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:53.381373 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1be0eb-ca6c-41e4-84e2-03cdf60ca6d3 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:53.383106 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78debeac-4ea5-449e-af96-ce3f70280f0b None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:53.422795 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b36a2-c8fd-4d29-a6e8-56a18bc402f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:53.423350 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b36a2-c8fd-4d29-a6e8-56a18bc402f5 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:53.423591 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b36a2-c8fd-4d29-a6e8-56a18bc402f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:53.423865 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b36a2-c8fd-4d29-a6e8-56a18bc402f5 None admin] PATH_INFO: `/v3/services` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:53.424497 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b36a2-c8fd-4d29-a6e8-56a18bc402f5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:53.425759 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b36a2-c8fd-4d29-a6e8-56a18bc402f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:53.425917 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762aee4-0d3d-46a6-a9fd-3a1a7e8e1417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:53.425917 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762aee4-0d3d-46a6-a9fd-3a1a7e8e1417 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:53.426182 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762aee4-0d3d-46a6-a9fd-3a1a7e8e1417 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:53.426423 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762aee4-0d3d-46a6-a9fd-3a1a7e8e1417 None admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:53.427078 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b36a2-c8fd-4d29-a6e8-56a18bc402f5 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:53.427948 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762aee4-0d3d-46a6-a9fd-3a1a7e8e1417 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:53.428257 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762aee4-0d3d-46a6-a9fd-3a1a7e8e1417 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:53.429704 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762aee4-0d3d-46a6-a9fd-3a1a7e8e1417 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:53.432210 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 404/809] 10.222.0.69 () {56 vars in 1124 bytes} [Thu Sep 8 13:35:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:53.433135 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b36a2-c8fd-4d29-a6e8-56a18bc402f5 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:53.456840 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 406/810] 10.222.0.69 () {56 vars in 1133 bytes} [Thu Sep 8 13:35:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:53.457905 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762aee4-0d3d-46a6-a9fd-3a1a7e8e1417 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:53.542922 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b36a2-c8fd-4d29-a6e8-56a18bc402f5 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:53.550640 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:53.566106 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762aee4-0d3d-46a6-a9fd-3a1a7e8e1417 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:53.582373 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea20a25-fd4d-4ec9-82a5-da66c42d02db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:53.583524 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea20a25-fd4d-4ec9-82a5-da66c42d02db None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:53.583939 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea20a25-fd4d-4ec9-82a5-da66c42d02db None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:53.584099 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea20a25-fd4d-4ec9-82a5-da66c42d02db None admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:53.584817 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea20a25-fd4d-4ec9-82a5-da66c42d02db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:53.585123 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea20a25-fd4d-4ec9-82a5-da66c42d02db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:53.586681 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea20a25-fd4d-4ec9-82a5-da66c42d02db None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:53.599483 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 405/811] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 8 13:35:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:53.600729 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29059349-7b0c-48d1-9f0c-5b4a44a8e8d5 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:53.601012 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29059349-7b0c-48d1-9f0c-5b4a44a8e8d5 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:53.601281 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29059349-7b0c-48d1-9f0c-5b4a44a8e8d5 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:53.602550 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 406/812] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:35:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:35:53.603249 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29059349-7b0c-48d1-9f0c-5b4a44a8e8d5 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:53.610057 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc43630-a321-475d-b6c1-2542e838424d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:53.610673 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc43630-a321-475d-b6c1-2542e838424d None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:53.610953 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc43630-a321-475d-b6c1-2542e838424d None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:53.611226 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc43630-a321-475d-b6c1-2542e838424d None admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:53.611959 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc43630-a321-475d-b6c1-2542e838424d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:53.612294 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc43630-a321-475d-b6c1-2542e838424d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:53.613741 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc43630-a321-475d-b6c1-2542e838424d None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:53.636468 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 407/813] 10.222.0.69 () {56 vars in 1149 bytes} [Thu Sep 8 13:35:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:53.637324 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc43630-a321-475d-b6c1-2542e838424d None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:53.649232 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:53.722614 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29059349-7b0c-48d1-9f0c-5b4a44a8e8d5 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:53.756395 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc43630-a321-475d-b6c1-2542e838424d None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:53.762130 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526194a3-3dba-4e78-bc04-e579b83b3397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:53.762749 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526194a3-3dba-4e78-bc04-e579b83b3397 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:53.763215 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526194a3-3dba-4e78-bc04-e579b83b3397 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:53.763620 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526194a3-3dba-4e78-bc04-e579b83b3397 None admin] PATH_INFO: `/v3/services` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:53.764254 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526194a3-3dba-4e78-bc04-e579b83b3397 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:53.764559 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526194a3-3dba-4e78-bc04-e579b83b3397 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:53.765974 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526194a3-3dba-4e78-bc04-e579b83b3397 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:53.771518 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 407/814] 10.222.0.69 () {56 vars in 1124 bytes} [Thu Sep 8 13:35:53 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:53.772897 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526194a3-3dba-4e78-bc04-e579b83b3397 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:53.801960 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7568d48e-1a4d-4ef1-aca6-3b29cf578599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:53.802582 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568d48e-1a4d-4ef1-aca6-3b29cf578599 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:53.803058 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568d48e-1a4d-4ef1-aca6-3b29cf578599 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:53.803338 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568d48e-1a4d-4ef1-aca6-3b29cf578599 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:53.809872 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:53.882152 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7568d48e-1a4d-4ef1-aca6-3b29cf578599 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:53.883616 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7568d48e-1a4d-4ef1-aca6-3b29cf578599 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:53.884863 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526194a3-3dba-4e78-bc04-e579b83b3397 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:53.895065 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:53.929094 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a19620-c2f1-4aae-a310-193859478055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:53.929780 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a19620-c2f1-4aae-a310-193859478055 None admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:53.930056 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a19620-c2f1-4aae-a310-193859478055 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:53.930327 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a19620-c2f1-4aae-a310-193859478055 None admin] PATH_INFO: `/v3/projects/88de9f1470c6415b97866ad5a3256ef2/users/fa9b97592a6840c3865d7dcf886221e0/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:53.932208 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a19620-c2f1-4aae-a310-193859478055 None admin] RBAC: Authorizing `identity:create_grant(project_id=88de9f1470c6415b97866ad5a3256ef2, user_id=fa9b97592a6840c3865d7dcf886221e0, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:53.933687 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a19620-c2f1-4aae-a310-193859478055 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:53.948894 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 408/815] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Sep 8 13:35:53 2022] PUT /identity/v3/projects/88de9f1470c6415b97866ad5a3256ef2/users/fa9b97592a6840c3865d7dcf886221e0/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:35:53.950232 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0789057-c675-41bd-95db-220c83661163 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:53.950793 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0789057-c675-41bd-95db-220c83661163 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:53.950793 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0789057-c675-41bd-95db-220c83661163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:53.978732 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-c0789057-c675-41bd-95db-220c83661163 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:35:53.979890 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-c0789057-c675-41bd-95db-220c83661163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:35:54.010514 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 408/816] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:35:53 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 13:35:54.011766 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7568d48e-1a4d-4ef1-aca6-3b29cf578599 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:54.076000 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 409/817] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:35:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:35:54.076917 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0789057-c675-41bd-95db-220c83661163 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:54.123554 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:54.158115 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7568d48e-1a4d-4ef1-aca6-3b29cf578599 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:54.172273 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:54.200251 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac3d49-f875-4656-b372-71d385ed3bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:54.200886 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac3d49-f875-4656-b372-71d385ed3bbb None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:54.201164 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac3d49-f875-4656-b372-71d385ed3bbb None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:54.201459 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac3d49-f875-4656-b372-71d385ed3bbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:54.212814 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac3d49-f875-4656-b372-71d385ed3bbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:54.214304 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac3d49-f875-4656-b372-71d385ed3bbb None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:54.231200 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-00ac3d49-f875-4656-b372-71d385ed3bbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:54.231200 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:54.231200 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:54.231200 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:54.231200 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:54.231200 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:54.231200 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:54.231200 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:54.231200 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:54.231200 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:54.231200 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:54.231200 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:54.231200 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:54.231200 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:54.231200 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:54.231200 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:54.233731 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:54.233731 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:54.233731 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:54.233731 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:54.233731 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:54.233731 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:54.233731 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:54.233731 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:54.233731 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:54.233731 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:54.233731 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:54.233731 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:54.233731 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:54.233731 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:54.233731 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:54.233731 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:54.233731 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:54.234974 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:54.234974 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:54.234974 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:54.234974 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 409/818] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:54.237885 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac3d49-f875-4656-b372-71d385ed3bbb None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:54.254964 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0789057-c675-41bd-95db-220c83661163 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:54.294734 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43569234-d184-47e0-bd63-a3eba573531f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:54.295742 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43569234-d184-47e0-bd63-a3eba573531f None admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:54.296201 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43569234-d184-47e0-bd63-a3eba573531f None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:54.296691 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43569234-d184-47e0-bd63-a3eba573531f None admin] PATH_INFO: `/v3/endpoints` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:54.297686 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43569234-d184-47e0-bd63-a3eba573531f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:54.299449 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43569234-d184-47e0-bd63-a3eba573531f None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:54.326191 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 410/819] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:35:54 2022] POST /identity/v3/endpoints => generated 346 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:35:54.327428 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43569234-d184-47e0-bd63-a3eba573531f None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:54.365726 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac3d49-f875-4656-b372-71d385ed3bbb None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:54.421662 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727af9a2-6939-4458-8810-1b27f96682d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:54.422307 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727af9a2-6939-4458-8810-1b27f96682d8 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:54.422645 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727af9a2-6939-4458-8810-1b27f96682d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:54.422926 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727af9a2-6939-4458-8810-1b27f96682d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:54.425806 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:54.437709 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727af9a2-6939-4458-8810-1b27f96682d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:54.439247 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727af9a2-6939-4458-8810-1b27f96682d8 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:54.455850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-727af9a2-6939-4458-8810-1b27f96682d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:54.455850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:54.455850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:54.455850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:54.455850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:54.455850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:54.455850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:54.455850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:54.455850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:54.455850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:54.455850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:54.455850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:54.455850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:54.455850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:54.455850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:54.455850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:54.457107 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:54.457107 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:54.457107 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:54.457107 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:54.457107 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:54.457107 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:54.457107 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:54.457107 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:54.457107 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:54.457107 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:54.457107 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:54.457107 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:54.457107 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:54.457107 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:54.457107 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:54.457107 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:54.457107 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:54.459157 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:54.459157 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:54.459157 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:54.459157 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 410/820] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:54.463984 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727af9a2-6939-4458-8810-1b27f96682d8 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:54.464327 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43569234-d184-47e0-bd63-a3eba573531f None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:54.504900 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:54.515925 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418e979-0f24-4a69-a306-f8c431bbf7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:54.515925 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418e979-0f24-4a69-a306-f8c431bbf7f8 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:54.516291 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418e979-0f24-4a69-a306-f8c431bbf7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:54.516395 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418e979-0f24-4a69-a306-f8c431bbf7f8 None admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:54.517653 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6418e979-0f24-4a69-a306-f8c431bbf7f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:54.520903 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6418e979-0f24-4a69-a306-f8c431bbf7f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:54.520903 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6418e979-0f24-4a69-a306-f8c431bbf7f8 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:54.540332 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 411/821] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:54.542174 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418e979-0f24-4a69-a306-f8c431bbf7f8 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:54.589154 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727af9a2-6939-4458-8810-1b27f96682d8 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:54.644416 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44dc705-e40a-49af-ad90-11b34cee23c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:54.645123 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44dc705-e40a-49af-ad90-11b34cee23c5 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:54.646473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44dc705-e40a-49af-ad90-11b34cee23c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:54.646473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44dc705-e40a-49af-ad90-11b34cee23c5 None admin] PATH_INFO: `/v3/services/network` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:54.646473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44dc705-e40a-49af-ad90-11b34cee23c5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:54.647782 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44dc705-e40a-49af-ad90-11b34cee23c5 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:54.662818 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-e44dc705-e40a-49af-ad90-11b34cee23c5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 13:35:54.662818 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:54.662818 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:35:54.662818 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:35:54.662818 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:35:54.662818 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:35:54.662818 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:35:54.662818 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:35:54.662818 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 13:35:54.662818 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:54.662818 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:35:54.662818 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:54.662818 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:54.662818 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:54.662818 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:54.662818 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:54.662818 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:54.663908 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:54.663908 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:54.663908 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:54.663908 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:54.663908 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:54.663908 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:54.663908 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:35:54.663908 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:35:54.663908 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:35:54.663908 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:35:54.663908 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:54.663908 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:54.663908 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:54.663908 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:54.663908 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:54.663908 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:54.664785 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:54.664785 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:54.664785 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:54.664785 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:54.664785 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:54.664785 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:54.664785 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:54.664785 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:54.664785 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:54.664785 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:54.664785 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:35:54.664785 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:35:54.664785 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 08 13:35:54.664785 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:54.665666 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 411/822] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:35:54 2022] GET /identity/v3/services/network => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:54.666496 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44dc705-e40a-49af-ad90-11b34cee23c5 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:54.686788 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418e979-0f24-4a69-a306-f8c431bbf7f8 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:54.736172 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc115e6-a70f-4b53-8206-70a2d1665171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:54.737823 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc115e6-a70f-4b53-8206-70a2d1665171 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:54.738311 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc115e6-a70f-4b53-8206-70a2d1665171 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:54.739275 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc115e6-a70f-4b53-8206-70a2d1665171 None admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:54.740503 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc115e6-a70f-4b53-8206-70a2d1665171 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:54.741154 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc115e6-a70f-4b53-8206-70a2d1665171 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:54.743607 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc115e6-a70f-4b53-8206-70a2d1665171 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:54.747531 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:54.763421 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 412/823] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:54.764757 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc115e6-a70f-4b53-8206-70a2d1665171 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:54.765835 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:54.784765 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44dc705-e40a-49af-ad90-11b34cee23c5 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:54.824778 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d5eb2-974a-47e2-9557-912eecbf6172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:54.825352 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d5eb2-974a-47e2-9557-912eecbf6172 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:54.825732 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d5eb2-974a-47e2-9557-912eecbf6172 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:54.826073 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d5eb2-974a-47e2-9557-912eecbf6172 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:54.834330 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d5eb2-974a-47e2-9557-912eecbf6172 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:54.835878 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d5eb2-974a-47e2-9557-912eecbf6172 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:54.850281 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-556d5eb2-974a-47e2-9557-912eecbf6172 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:35:54.850281 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:54.850281 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:54.850281 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:54.850281 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:54.850281 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:54.850281 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:54.850281 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:54.850281 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:54.850281 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:54.850281 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:54.850281 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:54.850281 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:35:54.850281 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:35:54.850281 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:35:54.851294 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:35:54.851294 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:54.851294 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:54.851294 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:54.851294 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:54.851294 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:54.851294 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:54.851294 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:54.851294 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:54.851294 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:54.851294 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:54.851294 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:54.851294 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:54.851294 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:54.851294 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:54.851294 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:54.851294 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:54.852241 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:35:54.852241 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:35:54.852241 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:35:54.852241 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:35:54.852241 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:35:54.852241 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:35:54.852241 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:35:54.852241 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:54.856265 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 412/824] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:35:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:54.857405 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d5eb2-974a-47e2-9557-912eecbf6172 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:54.906556 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc115e6-a70f-4b53-8206-70a2d1665171 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:54.954504 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c408b6-3ae2-49a1-ae44-9ec82c035b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:54.955567 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c408b6-3ae2-49a1-ae44-9ec82c035b08 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:54.956078 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c408b6-3ae2-49a1-ae44-9ec82c035b08 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:54.956614 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c408b6-3ae2-49a1-ae44-9ec82c035b08 None admin] PATH_INFO: `/v3/services` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:54.957675 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c408b6-3ae2-49a1-ae44-9ec82c035b08 None admin] RBAC: Adding query filter params (name=network) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:54.959347 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c408b6-3ae2-49a1-ae44-9ec82c035b08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:54.961763 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c408b6-3ae2-49a1-ae44-9ec82c035b08 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:54.969914 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 413/825] 10.222.0.69 () {56 vars in 1112 bytes} [Thu Sep 8 13:35:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:54.971310 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c408b6-3ae2-49a1-ae44-9ec82c035b08 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:54.991545 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d5eb2-974a-47e2-9557-912eecbf6172 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:55.031820 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:55.039760 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5de42-57f0-4f4b-854c-77f49502e1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:55.040995 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5de42-57f0-4f4b-854c-77f49502e1d2 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:55.041491 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5de42-57f0-4f4b-854c-77f49502e1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:55.042212 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5de42-57f0-4f4b-854c-77f49502e1d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:55.059786 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:55.061478 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a5de42-57f0-4f4b-854c-77f49502e1d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:55.065402 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a5de42-57f0-4f4b-854c-77f49502e1d2 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:55.084117 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-84a5de42-57f0-4f4b-854c-77f49502e1d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:35:55.084117 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:55.084117 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:55.084117 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:55.084117 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:55.084117 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:55.084117 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:55.084117 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:55.084117 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:55.084117 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:55.084117 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:55.084117 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:55.084117 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:35:55.084117 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:35:55.084117 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:35:55.085296 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:35:55.085296 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:55.085296 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:55.085296 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:55.085296 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:55.085296 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:55.085296 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:55.085296 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:55.085296 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:55.085296 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:55.085296 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:55.085296 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:55.085296 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:55.085296 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:55.085296 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:55.085296 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:55.085296 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:55.086460 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:35:55.086460 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:35:55.086460 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:35:55.086460 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:35:55.086460 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:35:55.086460 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:35:55.086460 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:35:55.086460 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:55.088778 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 413/826] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:35:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:55.089998 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5de42-57f0-4f4b-854c-77f49502e1d2 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:55.133896 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c408b6-3ae2-49a1-ae44-9ec82c035b08 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:55.180558 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5973536-c787-4f8f-8521-ef425ebd642b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:55.181284 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5973536-c787-4f8f-8521-ef425ebd642b None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:55.181640 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5973536-c787-4f8f-8521-ef425ebd642b None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:55.181978 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5973536-c787-4f8f-8521-ef425ebd642b None admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:55.183428 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5973536-c787-4f8f-8521-ef425ebd642b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:55.183773 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5973536-c787-4f8f-8521-ef425ebd642b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:55.185808 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5973536-c787-4f8f-8521-ef425ebd642b None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:55.210743 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 414/827] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 8 13:35:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:55.210743 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5973536-c787-4f8f-8521-ef425ebd642b None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:55.219970 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5de42-57f0-4f4b-854c-77f49502e1d2 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:55.281199 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2774530-bc1c-41a6-a98f-3abab608eacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:55.282133 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2774530-bc1c-41a6-a98f-3abab608eacc None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:55.282470 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2774530-bc1c-41a6-a98f-3abab608eacc None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:55.282873 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2774530-bc1c-41a6-a98f-3abab608eacc None admin] PATH_INFO: `/v3/services` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:55.283699 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2774530-bc1c-41a6-a98f-3abab608eacc None admin] RBAC: Adding query filter params (type=network) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:55.284132 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2774530-bc1c-41a6-a98f-3abab608eacc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:55.286398 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2774530-bc1c-41a6-a98f-3abab608eacc None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:55.293258 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 414/828] 10.222.0.69 () {56 vars in 1112 bytes} [Thu Sep 8 13:35:55 2022] GET /identity/v3/services?type=network => generated 350 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:55.299824 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2774530-bc1c-41a6-a98f-3abab608eacc None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:55.372343 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:55.412103 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5973536-c787-4f8f-8521-ef425ebd642b None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:55.432698 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2774530-bc1c-41a6-a98f-3abab608eacc None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:55.456246 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:55.488108 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94246a54-6963-456e-aa40-074d8112b076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:55.489588 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94246a54-6963-456e-aa40-074d8112b076 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:55.490082 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94246a54-6963-456e-aa40-074d8112b076 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:55.490573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94246a54-6963-456e-aa40-074d8112b076 None admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:55.491860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94246a54-6963-456e-aa40-074d8112b076 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:55.492416 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94246a54-6963-456e-aa40-074d8112b076 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:55.495096 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94246a54-6963-456e-aa40-074d8112b076 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:55.496015 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b2866-3813-4162-b245-f29723e9acab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:55.496966 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b2866-3813-4162-b245-f29723e9acab None admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:55.497534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b2866-3813-4162-b245-f29723e9acab None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:55.498309 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b2866-3813-4162-b245-f29723e9acab None admin] PATH_INFO: `/v3/projects/88de9f1470c6415b97866ad5a3256ef2/users/6d2dd101d1a14e5ab95f272ab1bbeb94/roles/e5f27e532c9d4bc7a57e31856ecee597` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:55.517261 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 415/829] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 8 13:35:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:55.518740 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45b2866-3813-4162-b245-f29723e9acab None admin] RBAC: Authorizing `identity:create_grant(project_id=88de9f1470c6415b97866ad5a3256ef2, user_id=6d2dd101d1a14e5ab95f272ab1bbeb94, role_id=e5f27e532c9d4bc7a57e31856ecee597)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:55.519084 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94246a54-6963-456e-aa40-074d8112b076 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:55.521724 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45b2866-3813-4162-b245-f29723e9acab None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:55.540371 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 415/830] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Sep 8 13:35:55 2022] PUT /identity/v3/projects/88de9f1470c6415b97866ad5a3256ef2/users/6d2dd101d1a14e5ab95f272ab1bbeb94/roles/e5f27e532c9d4bc7a57e31856ecee597 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:35:55.541836 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b2866-3813-4162-b245-f29723e9acab None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:55.684563 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b2866-3813-4162-b245-f29723e9acab None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:55.695799 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:55.736828 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674e5cb-c445-40be-93f3-689c8f540bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:55.737972 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674e5cb-c445-40be-93f3-689c8f540bdb None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:55.738472 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674e5cb-c445-40be-93f3-689c8f540bdb None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:55.739013 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674e5cb-c445-40be-93f3-689c8f540bdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:55.740409 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f674e5cb-c445-40be-93f3-689c8f540bdb None admin] RBAC: Adding query filter params (role.id=9c76f398c9e04caeab83842e70eb824b, scope.project.id=88de9f1470c6415b97866ad5a3256ef2, user.id=c95448c1b8b1466cae37fda5c713d53f) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:55.741005 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f674e5cb-c445-40be-93f3-689c8f540bdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:55.742827 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f674e5cb-c445-40be-93f3-689c8f540bdb None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:55.751179 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 416/831] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 8 13:35:55 2022] GET /identity/v3/role_assignments?user.id=c95448c1b8b1466cae37fda5c713d53f&scope.project.id=88de9f1470c6415b97866ad5a3256ef2&role.id=9c76f398c9e04caeab83842e70eb824b => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:55.782643 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94246a54-6963-456e-aa40-074d8112b076 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:55.828561 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b6817-3a72-4851-ba65-a4de7bb0a964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:55.828754 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b6817-3a72-4851-ba65-a4de7bb0a964 None admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:55.829084 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b6817-3a72-4851-ba65-a4de7bb0a964 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:55.829606 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b6817-3a72-4851-ba65-a4de7bb0a964 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:55.831565 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172b6817-3a72-4851-ba65-a4de7bb0a964 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:55.834024 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172b6817-3a72-4851-ba65-a4de7bb0a964 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:55.861269 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 416/832] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:35:55 2022] POST /identity/v3/endpoints => generated 337 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:35:56.577742 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22f714-db29-4450-99ac-3fc1c3f9bd8c None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:56.578310 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22f714-db29-4450-99ac-3fc1c3f9bd8c None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:56.578310 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22f714-db29-4450-99ac-3fc1c3f9bd8c None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:56.579763 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 417/833] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:35:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:35:56.585551 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5909d-c368-43f3-a371-2cf61b51246d None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:56.585837 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5909d-c368-43f3-a371-2cf61b51246d None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:56.586113 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5909d-c368-43f3-a371-2cf61b51246d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:56.606435 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-3ae5909d-c368-43f3-a371-2cf61b51246d None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:35:56.607625 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-3ae5909d-c368-43f3-a371-2cf61b51246d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:35:56.639400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:56.695196 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 417/834] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:35:56 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:35:56.918897 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784665b-107b-4206-81f1-223b8b059a97 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:56.919094 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784665b-107b-4206-81f1-223b8b059a97 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:56.919333 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784665b-107b-4206-81f1-223b8b059a97 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:56.921461 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 418/835] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:35:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:35:56.927595 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39febe6-052d-46d1-a5ff-b9a9325a86ca None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:56.928078 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39febe6-052d-46d1-a5ff-b9a9325a86ca None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:56.928183 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39febe6-052d-46d1-a5ff-b9a9325a86ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:56.947593 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-f39febe6-052d-46d1-a5ff-b9a9325a86ca None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:35:56.948815 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-f39febe6-052d-46d1-a5ff-b9a9325a86ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:35:57.011548 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5784665b-107b-4206-81f1-223b8b059a97 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:57.037621 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 418/836] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:35:56 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:35:57.143940 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5784665b-107b-4206-81f1-223b8b059a97 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:57.185943 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da083c01-599f-41ea-b678-30a48ff1daf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:57.186935 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da083c01-599f-41ea-b678-30a48ff1daf2 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:57.187452 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da083c01-599f-41ea-b678-30a48ff1daf2 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:57.187918 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da083c01-599f-41ea-b678-30a48ff1daf2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:57.200977 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da083c01-599f-41ea-b678-30a48ff1daf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:35:57.206097 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-da083c01-599f-41ea-b678-30a48ff1daf2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:35:57.206097 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:57.206097 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:57.206097 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:57.206097 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:57.206097 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:57.206097 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:57.206097 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:57.206097 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:57.206097 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:57.206097 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:57.206097 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:57.206097 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:35:57.206097 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:35:57.206097 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:35:57.206097 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:35:57.207021 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:35:57.207021 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:35:57.207021 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:35:57.207021 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:35:57.207021 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:57.207021 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:57.207021 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:57.207021 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:57.207021 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:57.207021 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:57.207021 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:57.207021 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:57.207021 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:57.207021 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:57.207021 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:57.207021 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:57.208130 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:57.208130 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:57.208130 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:57.208130 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:57.208130 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:35:57.208130 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:35:57.208130 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:35:57.208130 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:35:57.208130 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:35:57.208130 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:35:57.208130 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:35:57.208130 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:57.211190 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 419/837] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 8 13:35:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:35:57.216776 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39febe6-052d-46d1-a5ff-b9a9325a86ca None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:57.317278 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:57.326695 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39febe6-052d-46d1-a5ff-b9a9325a86ca None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:57.331889 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da083c01-599f-41ea-b678-30a48ff1daf2 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:57.364937 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02bde3-d97d-4c68-ae75-1ac7697691cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:57.365734 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02bde3-d97d-4c68-ae75-1ac7697691cf None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:57.366010 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02bde3-d97d-4c68-ae75-1ac7697691cf None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:57.366278 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02bde3-d97d-4c68-ae75-1ac7697691cf None admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:57.366943 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac02bde3-d97d-4c68-ae75-1ac7697691cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:57.367242 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac02bde3-d97d-4c68-ae75-1ac7697691cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:57.368611 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac02bde3-d97d-4c68-ae75-1ac7697691cf None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:57.371466 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:57.377839 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 419/838] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:35:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:35:57.384122 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02bde3-d97d-4c68-ae75-1ac7697691cf None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:57.458873 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da083c01-599f-41ea-b678-30a48ff1daf2 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:57.490162 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02bde3-d97d-4c68-ae75-1ac7697691cf None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:57.497875 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b38d9-87a8-43e1-9dde-681e22fcc5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:57.498560 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b38d9-87a8-43e1-9dde-681e22fcc5cb None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:57.498840 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b38d9-87a8-43e1-9dde-681e22fcc5cb None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:57.499106 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b38d9-87a8-43e1-9dde-681e22fcc5cb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:57.499788 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b38d9-87a8-43e1-9dde-681e22fcc5cb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:57.501268 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b38d9-87a8-43e1-9dde-681e22fcc5cb None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:57.511805 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-391b38d9-87a8-43e1-9dde-681e22fcc5cb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 13:35:57.511805 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:57.511805 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:35:57.511805 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:35:57.511805 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:35:57.511805 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:35:57.511805 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:35:57.511805 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:35:57.511805 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 13:35:57.511805 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:57.511805 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:35:57.511805 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:57.511805 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:57.511805 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:57.511805 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:57.511805 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:57.511805 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:57.512823 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:57.512823 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:57.512823 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:57.512823 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:57.512823 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:57.512823 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:57.512823 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:35:57.512823 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:35:57.512823 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:35:57.512823 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:35:57.512823 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:57.512823 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:57.512823 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:57.512823 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:57.512823 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:57.512823 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:57.513702 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:57.513702 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:57.513702 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:57.513702 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:57.513702 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:57.513702 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:57.513702 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:57.513702 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:57.513702 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:57.513702 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:57.513702 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:35:57.513702 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:35:57.513702 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 13:35:57.513702 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:57.517873 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 420/839] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Sep 8 13:35:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:35:57.519172 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b38d9-87a8-43e1-9dde-681e22fcc5cb None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:57.526623 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c584058-05a6-4296-bca3-5aab6153334e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:57.527250 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c584058-05a6-4296-bca3-5aab6153334e None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:57.527524 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c584058-05a6-4296-bca3-5aab6153334e None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:57.527796 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c584058-05a6-4296-bca3-5aab6153334e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:57.539232 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c584058-05a6-4296-bca3-5aab6153334e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:57.540687 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c584058-05a6-4296-bca3-5aab6153334e None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:57.556123 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-2c584058-05a6-4296-bca3-5aab6153334e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:57.556123 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:57.556123 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:57.556123 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:57.556123 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:57.556123 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:57.556123 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:57.556123 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:57.556123 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:57.556123 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:57.556123 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:57.556123 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:57.556123 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:57.556123 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:57.556123 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:57.556123 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:57.558423 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:57.558423 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:57.558423 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:57.558423 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:57.558423 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:57.558423 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:57.558423 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:57.558423 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:57.558423 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:57.558423 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:57.558423 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:57.558423 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:57.558423 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:57.558423 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:57.558423 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:57.558423 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:57.558423 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:57.560604 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:57.560604 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:57.560604 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:57.567959 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 420/840] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:35:57.567959 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c584058-05a6-4296-bca3-5aab6153334e None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:57.573202 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:57.638144 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:57.649718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b38d9-87a8-43e1-9dde-681e22fcc5cb None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:57.671187 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c584058-05a6-4296-bca3-5aab6153334e None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:57.695734 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e12ca3-702f-4dbc-8782-f03ae7b0ac65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:57.696632 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e12ca3-702f-4dbc-8782-f03ae7b0ac65 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:57.697059 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e12ca3-702f-4dbc-8782-f03ae7b0ac65 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:57.697614 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e12ca3-702f-4dbc-8782-f03ae7b0ac65 None admin] PATH_INFO: `/v3/services` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:57.698577 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e12ca3-702f-4dbc-8782-f03ae7b0ac65 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:57.699031 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e12ca3-702f-4dbc-8782-f03ae7b0ac65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:57.700745 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e12ca3-702f-4dbc-8782-f03ae7b0ac65 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:57.712325 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 421/841] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Sep 8 13:35:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:35:57.714183 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e12ca3-702f-4dbc-8782-f03ae7b0ac65 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:57.715359 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3644f6c-bf78-44be-8980-8255e153f199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:57.715982 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3644f6c-bf78-44be-8980-8255e153f199 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:57.716260 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3644f6c-bf78-44be-8980-8255e153f199 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:57.716533 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3644f6c-bf78-44be-8980-8255e153f199 None admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:57.717187 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3644f6c-bf78-44be-8980-8255e153f199 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:57.717642 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3644f6c-bf78-44be-8980-8255e153f199 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:57.719033 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3644f6c-bf78-44be-8980-8255e153f199 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:57.737468 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 421/842] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:35:57.740269 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3644f6c-bf78-44be-8980-8255e153f199 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:57.814786 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:57.858124 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3644f6c-bf78-44be-8980-8255e153f199 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:57.884238 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e12ca3-702f-4dbc-8782-f03ae7b0ac65 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:57.897178 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff6a5f-613b-42a4-ae0b-66e913e2d699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:57.897860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff6a5f-613b-42a4-ae0b-66e913e2d699 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:57.898138 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff6a5f-613b-42a4-ae0b-66e913e2d699 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:57.898422 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff6a5f-613b-42a4-ae0b-66e913e2d699 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:57.906919 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff6a5f-613b-42a4-ae0b-66e913e2d699 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:57.908389 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff6a5f-613b-42a4-ae0b-66e913e2d699 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:57.921901 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-fdff6a5f-613b-42a4-ae0b-66e913e2d699 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 08 13:35:57.921901 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:57.921901 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:57.921901 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:57.921901 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:57.921901 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:57.921901 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:57.921901 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:57.921901 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:57.921901 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:57.921901 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:57.921901 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:57.921901 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:35:57.921901 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:35:57.921901 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:35:57.921901 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:35:57.923049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:57.923049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:57.923049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:35:57.923049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:35:57.923049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:35:57.923049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:35:57.923049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:57.923049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:57.923049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:57.923049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:57.923049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:57.923049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:57.923049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:57.923049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:57.923049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:57.923049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:57.923049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:57.923049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:57.924699 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:57.924699 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:57.924699 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:35:57.924699 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:35:57.924699 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:35:57.924699 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:35:57.924699 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:35:57.924699 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:35:57.924699 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 08 13:35:57.924699 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:57.927997 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 422/843] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 8 13:35:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:57.929062 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff6a5f-613b-42a4-ae0b-66e913e2d699 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:57.948139 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd45d0-be13-4464-90a0-1941077b3fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:57.949117 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd45d0-be13-4464-90a0-1941077b3fbb None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:57.949645 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd45d0-be13-4464-90a0-1941077b3fbb None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:57.950147 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd45d0-be13-4464-90a0-1941077b3fbb None admin] PATH_INFO: `/v3/services` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:57.951077 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd45d0-be13-4464-90a0-1941077b3fbb None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:57.951891 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd45d0-be13-4464-90a0-1941077b3fbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:57.953599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd45d0-be13-4464-90a0-1941077b3fbb None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:57.966636 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 422/844] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Sep 8 13:35:57 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:35:58.069218 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff6a5f-613b-42a4-ae0b-66e913e2d699 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:58.119582 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:58.136684 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8bc5ae-42cf-489d-beea-3af7600f9904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:58.137679 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8bc5ae-42cf-489d-beea-3af7600f9904 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:58.138133 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8bc5ae-42cf-489d-beea-3af7600f9904 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:58.138579 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8bc5ae-42cf-489d-beea-3af7600f9904 None admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:58.139864 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8bc5ae-42cf-489d-beea-3af7600f9904 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:58.140351 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8bc5ae-42cf-489d-beea-3af7600f9904 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:58.144096 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8bc5ae-42cf-489d-beea-3af7600f9904 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:58.172095 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 423/845] 10.222.0.69 () {56 vars in 1135 bytes} [Thu Sep 8 13:35:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:58.179654 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd45d0-be13-4464-90a0-1941077b3fbb None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:58.214987 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:58.329205 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd45d0-be13-4464-90a0-1941077b3fbb None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:58.356142 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d055f7e-a2d5-47ad-b47c-c22a37f386c1 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:58.356461 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d055f7e-a2d5-47ad-b47c-c22a37f386c1 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:58.356850 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d055f7e-a2d5-47ad-b47c-c22a37f386c1 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:58.359297 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 424/846] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:35:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:35:58.365731 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54bbf58-6702-4f3b-80a1-d6ee3db102ff None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:58.366027 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54bbf58-6702-4f3b-80a1-d6ee3db102ff None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:58.366309 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54bbf58-6702-4f3b-80a1-d6ee3db102ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:58.372688 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c7e9b-03f0-46eb-9fa5-ae84044af17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:58.373716 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c7e9b-03f0-46eb-9fa5-ae84044af17f None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:58.374172 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c7e9b-03f0-46eb-9fa5-ae84044af17f None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:58.374607 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045c7e9b-03f0-46eb-9fa5-ae84044af17f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:58.388618 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-c54bbf58-6702-4f3b-80a1-d6ee3db102ff None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:35:58.390131 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-c54bbf58-6702-4f3b-80a1-d6ee3db102ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:35:58.462681 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c7e9b-03f0-46eb-9fa5-ae84044af17f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:58.465076 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045c7e9b-03f0-46eb-9fa5-ae84044af17f None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:58.481357 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 425/847] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:35:58 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:35:58.482993 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa5370-75bb-454f-9416-2dfa00cb2578 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:58.483278 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa5370-75bb-454f-9416-2dfa00cb2578 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:58.484076 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa5370-75bb-454f-9416-2dfa00cb2578 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:58.485357 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 426/848] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:35:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:35:58.491794 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af913c-79b6-463c-983b-853c826d6787 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:58.492076 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af913c-79b6-463c-983b-853c826d6787 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:58.492407 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af913c-79b6-463c-983b-853c826d6787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:58.501696 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:58.515188 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-49af913c-79b6-463c-983b-853c826d6787 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:35:58.516468 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-49af913c-79b6-463c-983b-853c826d6787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:35:58.611774 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 423/849] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:35:58 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 13:35:58.615427 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c7e9b-03f0-46eb-9fa5-ae84044af17f None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:58.645598 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 427/850] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:35:58 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:35:58.735425 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045c7e9b-03f0-46eb-9fa5-ae84044af17f None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:58.762139 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:58.779437 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f43cd-77ea-48e2-ab93-9e8c51251833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:58.780132 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f43cd-77ea-48e2-ab93-9e8c51251833 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:58.780406 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f43cd-77ea-48e2-ab93-9e8c51251833 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:58.780675 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f43cd-77ea-48e2-ab93-9e8c51251833 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:58.793012 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315f43cd-77ea-48e2-ab93-9e8c51251833 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:58.794636 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315f43cd-77ea-48e2-ab93-9e8c51251833 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:58.796627 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af913c-79b6-463c-983b-853c826d6787 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:58.812050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-315f43cd-77ea-48e2-ab93-9e8c51251833 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:58.812050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:58.812050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:58.812050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:58.812050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:58.812050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:58.812050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:58.812050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:58.812050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:58.812050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:58.812050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:58.812050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:58.812050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:58.812050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:58.812050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:58.812050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:58.813552 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:58.813552 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:58.813552 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:58.813552 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:58.813552 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:58.813552 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:58.813552 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:58.813552 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:58.813552 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:58.813552 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:58.813552 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:58.813552 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:58.813552 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:58.813552 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:58.813552 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:58.813552 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:58.813552 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:58.814687 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:58.814687 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:58.814687 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:35:58.816674 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 424/851] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:58.823048 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f43cd-77ea-48e2-ab93-9e8c51251833 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:58.858083 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:58.924346 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af913c-79b6-463c-983b-853c826d6787 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:58.960215 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f43cd-77ea-48e2-ab93-9e8c51251833 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:58.963715 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ddf95-ea4b-4c0e-bd76-195853743e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:58.964274 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ddf95-ea4b-4c0e-bd76-195853743e11 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:58.964721 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ddf95-ea4b-4c0e-bd76-195853743e11 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:58.965007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ddf95-ea4b-4c0e-bd76-195853743e11 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:58.978546 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8ddf95-ea4b-4c0e-bd76-195853743e11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:35:58.983584 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-ea8ddf95-ea4b-4c0e-bd76-195853743e11 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:35:58.983584 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:58.983584 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:58.983584 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:58.983584 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:58.983584 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:58.983584 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:58.983584 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:58.983584 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:58.983584 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:58.983584 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:58.983584 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:58.983584 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:35:58.983584 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:35:58.983584 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:35:58.983584 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:35:58.984975 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:35:58.984975 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:35:58.984975 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:35:58.984975 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:35:58.984975 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:58.984975 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:58.984975 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:58.984975 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:58.984975 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:58.984975 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:58.984975 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:58.984975 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:58.984975 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:58.984975 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:58.984975 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:58.984975 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:58.986400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:58.986400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:58.986400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:58.986400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:58.986400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:35:58.986400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:35:58.986400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:35:58.986400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:35:58.986400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:35:58.986400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:35:58.986400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:35:58.986400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:58.986400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 428/852] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Sep 8 13:35:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:35:58.986400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ddf95-ea4b-4c0e-bd76-195853743e11 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:59.008772 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b4e2a-f56f-4fdb-b1a0-ee51ffcf6f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:59.009438 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b4e2a-f56f-4fdb-b1a0-ee51ffcf6f4a None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:59.009722 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b4e2a-f56f-4fdb-b1a0-ee51ffcf6f4a None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:59.009993 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b4e2a-f56f-4fdb-b1a0-ee51ffcf6f4a None admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:59.010649 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b4e2a-f56f-4fdb-b1a0-ee51ffcf6f4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:59.010948 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b4e2a-f56f-4fdb-b1a0-ee51ffcf6f4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:59.012358 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b4e2a-f56f-4fdb-b1a0-ee51ffcf6f4a None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:59.033977 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 425/853] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:35:59.033977 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b4e2a-f56f-4fdb-b1a0-ee51ffcf6f4a None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:59.073119 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:59.111895 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8ddf95-ea4b-4c0e-bd76-195853743e11 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:59.115631 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:59.153026 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b4e2a-f56f-4fdb-b1a0-ee51ffcf6f4a None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:59.155842 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0562916-90be-4dae-8af5-50a39b478c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:59.156570 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0562916-90be-4dae-8af5-50a39b478c9b None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:59.156849 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0562916-90be-4dae-8af5-50a39b478c9b None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:59.157136 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0562916-90be-4dae-8af5-50a39b478c9b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:59.157758 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0562916-90be-4dae-8af5-50a39b478c9b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:59.159149 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0562916-90be-4dae-8af5-50a39b478c9b None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:59.169449 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-a0562916-90be-4dae-8af5-50a39b478c9b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 13:35:59.169449 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:59.169449 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:35:59.169449 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:35:59.169449 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:35:59.169449 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:35:59.169449 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:35:59.169449 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:35:59.169449 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 13:35:59.169449 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:59.169449 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:35:59.169449 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:59.169449 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:59.169449 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:59.169449 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:59.169449 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:59.170453 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:59.170453 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:59.170453 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:59.170453 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:59.170453 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:59.170453 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:59.170453 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:59.170453 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:35:59.170453 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:35:59.170453 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:35:59.170453 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:35:59.170453 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:59.170453 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:59.170453 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:59.170453 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:59.170453 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:59.170453 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:59.171366 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:59.171366 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:59.171366 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:59.171366 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:59.171366 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:59.171366 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:59.171366 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:59.171366 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:59.171366 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:59.171366 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:59.171366 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:35:59.171366 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:35:59.171366 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 13:35:59.171366 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:59.171366 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 429/854] 10.222.0.69 () {56 vars in 1132 bytes} [Thu Sep 8 13:35:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:59.172152 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0562916-90be-4dae-8af5-50a39b478c9b None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:59.211127 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96415ab0-da32-4737-acca-370aa9001f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:59.211740 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96415ab0-da32-4737-acca-370aa9001f4c None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:59.212019 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96415ab0-da32-4737-acca-370aa9001f4c None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:59.212287 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96415ab0-da32-4737-acca-370aa9001f4c None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:59.212958 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96415ab0-da32-4737-acca-370aa9001f4c None admin] RBAC: Adding query filter params (name=service) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:59.213261 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96415ab0-da32-4737-acca-370aa9001f4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:59.214652 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96415ab0-da32-4737-acca-370aa9001f4c None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:59.228491 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 426/855] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Sep 8 13:35:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:59.228491 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96415ab0-da32-4737-acca-370aa9001f4c None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:59.301776 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0562916-90be-4dae-8af5-50a39b478c9b None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:59.346652 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9168e1-513b-4413-8f3c-fff82f94adc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:59.347395 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9168e1-513b-4413-8f3c-fff82f94adc6 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:59.347747 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9168e1-513b-4413-8f3c-fff82f94adc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:59.348175 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9168e1-513b-4413-8f3c-fff82f94adc6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:59.356845 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9168e1-513b-4413-8f3c-fff82f94adc6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:59.357827 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:59.359001 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9168e1-513b-4413-8f3c-fff82f94adc6 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:59.364830 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96415ab0-da32-4737-acca-370aa9001f4c None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:59.373316 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-dc9168e1-513b-4413-8f3c-fff82f94adc6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:35:59.373316 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:59.373316 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:59.373316 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:59.373316 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:59.373316 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:59.373316 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:59.373316 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:59.373316 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:59.373316 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:59.373316 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:59.373316 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:59.373316 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:35:59.373316 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:35:59.373316 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:35:59.374678 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:35:59.374678 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:59.374678 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:59.374678 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:59.374678 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:59.374678 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:59.374678 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:59.374678 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:59.374678 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:59.374678 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:59.374678 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:59.374678 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:59.374678 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:59.374678 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:59.374678 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:59.374678 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:59.374678 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:59.376206 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:35:59.376206 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:35:59.376206 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:35:59.376206 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:35:59.376206 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:35:59.376206 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:35:59.376206 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:35:59.376206 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:59.376206 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 430/856] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:35:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:59.376206 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9168e1-513b-4413-8f3c-fff82f94adc6 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:59.413731 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:59.427037 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad012a3-a84a-41b5-949c-81d0f90e1dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:59.427645 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad012a3-a84a-41b5-949c-81d0f90e1dc0 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:59.427915 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad012a3-a84a-41b5-949c-81d0f90e1dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:59.428182 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad012a3-a84a-41b5-949c-81d0f90e1dc0 None admin] PATH_INFO: `/v3/services` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:59.428813 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad012a3-a84a-41b5-949c-81d0f90e1dc0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:59.429111 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad012a3-a84a-41b5-949c-81d0f90e1dc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:59.430555 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad012a3-a84a-41b5-949c-81d0f90e1dc0 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:59.440301 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 427/857] 10.222.0.69 () {56 vars in 1126 bytes} [Thu Sep 8 13:35:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:59.440301 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad012a3-a84a-41b5-949c-81d0f90e1dc0 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:59.531271 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9168e1-513b-4413-8f3c-fff82f94adc6 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:59.563961 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad012a3-a84a-41b5-949c-81d0f90e1dc0 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:59.571142 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d970b08-0bc5-4161-9b9f-aafc4fc4e6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:59.571914 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d970b08-0bc5-4161-9b9f-aafc4fc4e6f0 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:59.572683 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d970b08-0bc5-4161-9b9f-aafc4fc4e6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:59.572958 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d970b08-0bc5-4161-9b9f-aafc4fc4e6f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:59.585951 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d970b08-0bc5-4161-9b9f-aafc4fc4e6f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:59.587444 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d970b08-0bc5-4161-9b9f-aafc4fc4e6f0 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:59.603173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-0d970b08-0bc5-4161-9b9f-aafc4fc4e6f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:59.603173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:35:59.603173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:35:59.603173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:35:59.603173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:35:59.603173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:35:59.603173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:35:59.603173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:35:59.603173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:35:59.603173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:35:59.603173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:35:59.603173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:35:59.603173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:35:59.603173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:35:59.603173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:35:59.603173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:35:59.604229 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:35:59.604229 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:35:59.604229 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:35:59.604229 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:35:59.604229 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:35:59.604229 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:35:59.604229 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:35:59.604229 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:35:59.604229 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:35:59.604229 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:35:59.604229 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:35:59.604229 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:35:59.604229 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:35:59.604229 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:35:59.604229 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:35:59.604229 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:35:59.604229 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:35:59.605128 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:35:59.605128 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:35:59.605128 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:35:59.605128 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 431/858] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:35:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:35:59.605128 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d970b08-0bc5-4161-9b9f-aafc4fc4e6f0 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:59.605960 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58626c5-1752-4308-9e40-ae53fca6c1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:59.606671 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58626c5-1752-4308-9e40-ae53fca6c1c7 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:59.607020 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58626c5-1752-4308-9e40-ae53fca6c1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:59.607360 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58626c5-1752-4308-9e40-ae53fca6c1c7 None admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:59.608139 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58626c5-1752-4308-9e40-ae53fca6c1c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:59.608517 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58626c5-1752-4308-9e40-ae53fca6c1c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:59.610063 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58626c5-1752-4308-9e40-ae53fca6c1c7 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:59.631483 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 428/859] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 8 13:35:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:59.631483 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58626c5-1752-4308-9e40-ae53fca6c1c7 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:59.682398 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:59.701060 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:59.722843 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d970b08-0bc5-4161-9b9f-aafc4fc4e6f0 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:59.759529 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b55fda-fff7-41b9-b75d-a07cd579e80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:59.760287 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b55fda-fff7-41b9-b75d-a07cd579e80c None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:59.760700 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b55fda-fff7-41b9-b75d-a07cd579e80c None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:59.760926 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b55fda-fff7-41b9-b75d-a07cd579e80c None admin] PATH_INFO: `/v3/services` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:59.761679 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b55fda-fff7-41b9-b75d-a07cd579e80c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:59.761978 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b55fda-fff7-41b9-b75d-a07cd579e80c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:59.763344 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b55fda-fff7-41b9-b75d-a07cd579e80c None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:59.773396 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 432/860] 10.222.0.69 () {56 vars in 1126 bytes} [Thu Sep 8 13:35:59 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:59.773396 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b55fda-fff7-41b9-b75d-a07cd579e80c None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:59.796185 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58626c5-1752-4308-9e40-ae53fca6c1c7 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:35:59.848355 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d1fc5a-b0d3-49c4-912a-67f6d5fe8127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:35:59.849390 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1fc5a-b0d3-49c4-912a-67f6d5fe8127 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:35:59.849778 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1fc5a-b0d3-49c4-912a-67f6d5fe8127 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:35:59.850121 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1fc5a-b0d3-49c4-912a-67f6d5fe8127 None admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:35:59.850872 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d1fc5a-b0d3-49c4-912a-67f6d5fe8127 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:35:59.852005 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d1fc5a-b0d3-49c4-912a-67f6d5fe8127 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:35:59.853567 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d1fc5a-b0d3-49c4-912a-67f6d5fe8127 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:35:59.873381 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 429/861] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:35:59.878741 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d1fc5a-b0d3-49c4-912a-67f6d5fe8127 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:35:59.936018 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b55fda-fff7-41b9-b75d-a07cd579e80c None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:00.001333 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:00.001948 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68e5b8-b8c2-4f12-a754-b84999d37a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:00.004062 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68e5b8-b8c2-4f12-a754-b84999d37a15 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:00.004062 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68e5b8-b8c2-4f12-a754-b84999d37a15 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:00.004959 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68e5b8-b8c2-4f12-a754-b84999d37a15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:00.006381 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c68e5b8-b8c2-4f12-a754-b84999d37a15 None admin] RBAC: Adding query filter params (role.id=9c76f398c9e04caeab83842e70eb824b, scope.project.id=88de9f1470c6415b97866ad5a3256ef2, user.id=fa9b97592a6840c3865d7dcf886221e0) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:00.006893 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c68e5b8-b8c2-4f12-a754-b84999d37a15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:00.009318 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c68e5b8-b8c2-4f12-a754-b84999d37a15 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:00.017269 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 433/862] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 8 13:35:59 2022] GET /identity/v3/role_assignments?user.id=fa9b97592a6840c3865d7dcf886221e0&scope.project.id=88de9f1470c6415b97866ad5a3256ef2&role.id=9c76f398c9e04caeab83842e70eb824b => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:00.025483 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d1fc5a-b0d3-49c4-912a-67f6d5fe8127 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:00.071371 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194f52f-15d7-4175-8ec5-fdf2a8bcff76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:00.071941 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194f52f-15d7-4175-8ec5-fdf2a8bcff76 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:00.072216 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194f52f-15d7-4175-8ec5-fdf2a8bcff76 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:00.072492 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194f52f-15d7-4175-8ec5-fdf2a8bcff76 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:00.082008 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9194f52f-15d7-4175-8ec5-fdf2a8bcff76 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:00.084025 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9194f52f-15d7-4175-8ec5-fdf2a8bcff76 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:00.097188 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-9194f52f-15d7-4175-8ec5-fdf2a8bcff76 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 13:36:00.097188 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:00.097188 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:00.097188 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:00.097188 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:00.097188 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:00.097188 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:00.097188 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:00.097188 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:00.097188 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:00.097188 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:00.097188 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:00.097188 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:36:00.097188 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:36:00.097188 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:36:00.097188 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:36:00.099051 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:00.099051 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:00.099051 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:36:00.099051 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:36:00.099051 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:36:00.099051 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:36:00.099051 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:00.099051 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:00.099051 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:00.099051 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:00.099051 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:00.099051 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:00.099051 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:00.099051 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:00.099051 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:00.099051 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:00.099051 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:00.099051 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:00.100121 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:00.100121 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:00.100121 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:36:00.100121 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:36:00.100121 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:36:00.100121 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:36:00.100121 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:36:00.100121 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:36:00.100121 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 13:36:00.100121 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:36:00.100121 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 430/863] 10.222.0.69 () {56 vars in 1117 bytes} [Thu Sep 8 13:35:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:36:00.105128 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68e5b8-b8c2-4f12-a754-b84999d37a15 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:00.120796 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:00.231308 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68e5b8-b8c2-4f12-a754-b84999d37a15 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:00.273720 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de0cdb-3b04-4ecf-9303-fcfda034c1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:00.274338 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de0cdb-3b04-4ecf-9303-fcfda034c1b4 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:00.274704 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de0cdb-3b04-4ecf-9303-fcfda034c1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:00.274871 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de0cdb-3b04-4ecf-9303-fcfda034c1b4 None admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:00.275594 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de0cdb-3b04-4ecf-9303-fcfda034c1b4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:00.275895 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de0cdb-3b04-4ecf-9303-fcfda034c1b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:00.277324 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de0cdb-3b04-4ecf-9303-fcfda034c1b4 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:00.298327 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 434/864] 10.222.0.69 () {56 vars in 1149 bytes} [Thu Sep 8 13:36:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:00.305025 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194f52f-15d7-4175-8ec5-fdf2a8bcff76 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:00.472403 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194f52f-15d7-4175-8ec5-fdf2a8bcff76 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:00.486769 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb130f84-8a35-4b11-8611-871f8bb613a7 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:00.487216 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb130f84-8a35-4b11-8611-871f8bb613a7 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:00.487688 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb130f84-8a35-4b11-8611-871f8bb613a7 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:00.490314 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 435/865] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:36:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:36:00.496609 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da678bb0-cce8-4893-b0d6-babf7f8101b7 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:00.497089 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da678bb0-cce8-4893-b0d6-babf7f8101b7 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:00.497734 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da678bb0-cce8-4893-b0d6-babf7f8101b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:00.520654 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadc808-da19-4bcc-a2ff-27bf0667f659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:00.521662 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadc808-da19-4bcc-a2ff-27bf0667f659 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:00.522185 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadc808-da19-4bcc-a2ff-27bf0667f659 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:00.522661 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadc808-da19-4bcc-a2ff-27bf0667f659 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:00.529222 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-da678bb0-cce8-4893-b0d6-babf7f8101b7 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:36:00.531367 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-da678bb0-cce8-4893-b0d6-babf7f8101b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:36:00.539717 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:00.607478 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:00.608518 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fadc808-da19-4bcc-a2ff-27bf0667f659 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:00.610126 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fadc808-da19-4bcc-a2ff-27bf0667f659 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:00.618403 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 436/866] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:36:00 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:36:00.717399 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 431/867] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:36:00 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 13:36:00.723438 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da678bb0-cce8-4893-b0d6-babf7f8101b7 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:00.843443 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da678bb0-cce8-4893-b0d6-babf7f8101b7 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:00.883670 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2181624-683a-4aaa-abb8-b35c93f349a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:00.884300 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2181624-683a-4aaa-abb8-b35c93f349a6 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:00.884577 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2181624-683a-4aaa-abb8-b35c93f349a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:00.884846 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2181624-683a-4aaa-abb8-b35c93f349a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:00.897160 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2181624-683a-4aaa-abb8-b35c93f349a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:00.898672 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2181624-683a-4aaa-abb8-b35c93f349a6 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:00.902612 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadc808-da19-4bcc-a2ff-27bf0667f659 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:00.915687 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-b2181624-683a-4aaa-abb8-b35c93f349a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:36:00.915687 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:00.915687 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:00.915687 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:00.915687 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:00.915687 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:00.915687 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:00.915687 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:00.915687 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:00.915687 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:00.915687 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:00.915687 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:00.915687 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:36:00.915687 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:36:00.915687 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:36:00.915687 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:36:00.916809 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:00.916809 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:00.916809 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:00.916809 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:00.916809 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:00.916809 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:00.916809 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:00.916809 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:00.916809 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:00.916809 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:00.916809 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:00.916809 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:00.916809 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:00.916809 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:00.916809 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:00.916809 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:00.916809 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:36:00.917833 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:36:00.917833 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:36:00.917833 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:00.917833 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 437/868] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:36:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:36:00.924233 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2181624-683a-4aaa-abb8-b35c93f349a6 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:00.950951 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:00.987856 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:01.017651 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadc808-da19-4bcc-a2ff-27bf0667f659 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:01.061625 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aed24e-4cbb-49a3-a5e8-1680feeaad82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:01.069999 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2181624-683a-4aaa-abb8-b35c93f349a6 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:01.070576 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aed24e-4cbb-49a3-a5e8-1680feeaad82 None admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:01.070576 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aed24e-4cbb-49a3-a5e8-1680feeaad82 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:01.070576 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aed24e-4cbb-49a3-a5e8-1680feeaad82 None admin] PATH_INFO: `/v3/services` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:01.070576 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aed24e-4cbb-49a3-a5e8-1680feeaad82 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:01.071441 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aed24e-4cbb-49a3-a5e8-1680feeaad82 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:01.093396 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 432/869] 10.222.0.69 () {60 vars in 1141 bytes} [Thu Sep 8 13:36:00 2022] POST /identity/v3/services => generated 251 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:36:01.125070 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb487dd2-e4b8-46eb-b870-74f65291ba23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:01.125996 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb487dd2-e4b8-46eb-b870-74f65291ba23 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:01.126310 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb487dd2-e4b8-46eb-b870-74f65291ba23 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:01.126644 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb487dd2-e4b8-46eb-b870-74f65291ba23 None admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:01.127366 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb487dd2-e4b8-46eb-b870-74f65291ba23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:01.127730 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb487dd2-e4b8-46eb-b870-74f65291ba23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:01.129889 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb487dd2-e4b8-46eb-b870-74f65291ba23 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:01.144654 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 438/870] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:36:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:36:01.151953 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aed24e-4cbb-49a3-a5e8-1680feeaad82 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:01.277399 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:01.282529 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aed24e-4cbb-49a3-a5e8-1680feeaad82 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:01.326606 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc7f57-c79d-45e0-a411-d0ed7b9783db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:01.327241 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc7f57-c79d-45e0-a411-d0ed7b9783db None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:01.327585 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc7f57-c79d-45e0-a411-d0ed7b9783db None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:01.327865 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc7f57-c79d-45e0-a411-d0ed7b9783db None admin] PATH_INFO: `/v3/projects/service` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:01.336554 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc7f57-c79d-45e0-a411-d0ed7b9783db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:01.338139 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc7f57-c79d-45e0-a411-d0ed7b9783db None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:01.352202 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-56bc7f57-c79d-45e0-a411-d0ed7b9783db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:36:01.352202 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:01.352202 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:01.352202 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:01.352202 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:01.352202 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:01.352202 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:01.352202 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:01.352202 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:01.352202 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:01.352202 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:01.352202 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:01.352202 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:36:01.352202 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:36:01.352202 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:36:01.353217 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:36:01.353217 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:01.353217 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:01.353217 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:01.353217 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:01.353217 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:01.353217 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:01.353217 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:01.353217 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:01.353217 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:01.353217 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:01.353217 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:01.353217 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:01.353217 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:01.353217 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:01.353217 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:01.353217 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:01.354234 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:36:01.354234 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:36:01.354234 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:36:01.354234 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:36:01.354234 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:36:01.354234 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:36:01.354234 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:36:01.354234 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:36:01.354234 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 433/871] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:36:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:36:01.359824 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb487dd2-e4b8-46eb-b870-74f65291ba23 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:01.502795 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb487dd2-e4b8-46eb-b870-74f65291ba23 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:01.505515 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:01.552534 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6e49f-3fc8-4730-acfa-bed057552ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:01.555339 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6e49f-3fc8-4730-acfa-bed057552ec1 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:01.555630 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6e49f-3fc8-4730-acfa-bed057552ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:01.555901 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6e49f-3fc8-4730-acfa-bed057552ec1 None admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:01.556823 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da6e49f-3fc8-4730-acfa-bed057552ec1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:01.557393 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da6e49f-3fc8-4730-acfa-bed057552ec1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:01.558859 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da6e49f-3fc8-4730-acfa-bed057552ec1 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:01.575027 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 439/872] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 8 13:36:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:01.585267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc7f57-c79d-45e0-a411-d0ed7b9783db None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:01.713345 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc7f57-c79d-45e0-a411-d0ed7b9783db None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:01.756317 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef3364-9b2d-457e-a1f2-c48707e8e328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:01.757344 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef3364-9b2d-457e-a1f2-c48707e8e328 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:01.757875 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef3364-9b2d-457e-a1f2-c48707e8e328 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:01.758363 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef3364-9b2d-457e-a1f2-c48707e8e328 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:01.759361 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ef3364-9b2d-457e-a1f2-c48707e8e328 None admin] RBAC: Adding query filter params (role.id=e5f27e532c9d4bc7a57e31856ecee597, scope.project.id=88de9f1470c6415b97866ad5a3256ef2, user.id=6d2dd101d1a14e5ab95f272ab1bbeb94) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:01.759960 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ef3364-9b2d-457e-a1f2-c48707e8e328 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:01.761701 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ef3364-9b2d-457e-a1f2-c48707e8e328 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:01.768921 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 434/873] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 8 13:36:01 2022] GET /identity/v3/role_assignments?user.id=6d2dd101d1a14e5ab95f272ab1bbeb94&scope.project.id=88de9f1470c6415b97866ad5a3256ef2&role.id=e5f27e532c9d4bc7a57e31856ecee597 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:02.404458 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba014f1e-769e-411b-8052-f6cf47377b32 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:02.405009 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba014f1e-769e-411b-8052-f6cf47377b32 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:02.405009 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba014f1e-769e-411b-8052-f6cf47377b32 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:02.406635 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 440/874] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:36:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:36:02.413110 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d736ea-ef69-4282-81f2-43b9640f6aaa None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:02.413619 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d736ea-ef69-4282-81f2-43b9640f6aaa None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:02.413699 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d736ea-ef69-4282-81f2-43b9640f6aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:02.434041 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-79d736ea-ef69-4282-81f2-43b9640f6aaa None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:36:02.435242 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-79d736ea-ef69-4282-81f2-43b9640f6aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:36:02.455224 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:02.502364 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1468f62-c823-45e1-aeb2-d45986df6e15 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:02.502711 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1468f62-c823-45e1-aeb2-d45986df6e15 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:02.502943 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1468f62-c823-45e1-aeb2-d45986df6e15 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:02.504988 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 441/875] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:36:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:36:02.512216 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a67a0-b472-4789-b7f7-2bdda7076d40 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:02.512624 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a67a0-b472-4789-b7f7-2bdda7076d40 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:02.513109 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a67a0-b472-4789-b7f7-2bdda7076d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:02.515373 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 435/876] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:36:02 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:36:02.536443 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-858a67a0-b472-4789-b7f7-2bdda7076d40 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:36:02.537877 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-858a67a0-b472-4789-b7f7-2bdda7076d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:36:02.624390 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 442/877] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:36:02 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:36:02.810936 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d736ea-ef69-4282-81f2-43b9640f6aaa None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:02.921735 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d736ea-ef69-4282-81f2-43b9640f6aaa None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:02.936964 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a67a0-b472-4789-b7f7-2bdda7076d40 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:02.964319 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f6ec5-fb33-49e6-bee8-61f6180aa1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:02.965444 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f6ec5-fb33-49e6-bee8-61f6180aa1db None admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:02.965961 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f6ec5-fb33-49e6-bee8-61f6180aa1db None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:02.966486 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f6ec5-fb33-49e6-bee8-61f6180aa1db None admin] PATH_INFO: `/v3/services` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:02.967336 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f6ec5-fb33-49e6-bee8-61f6180aa1db None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:02.969098 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f6ec5-fb33-49e6-bee8-61f6180aa1db None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:02.991015 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 436/878] 10.222.0.69 () {60 vars in 1141 bytes} [Thu Sep 8 13:36:02 2022] POST /identity/v3/services => generated 269 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:36:03.067640 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:03.076923 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a67a0-b472-4789-b7f7-2bdda7076d40 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:03.126101 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f1074-5ee5-42bb-af53-9dc7dac34591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:03.126758 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f1074-5ee5-42bb-af53-9dc7dac34591 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:03.127031 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f1074-5ee5-42bb-af53-9dc7dac34591 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:03.127297 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f1074-5ee5-42bb-af53-9dc7dac34591 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:03.127968 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f1074-5ee5-42bb-af53-9dc7dac34591 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:03.130000 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f1074-5ee5-42bb-af53-9dc7dac34591 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:03.140258 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-4a6f1074-5ee5-42bb-af53-9dc7dac34591 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 13:36:03.140258 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:03.140258 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:36:03.140258 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:36:03.140258 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:36:03.140258 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:36:03.140258 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:36:03.140258 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:36:03.140258 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 13:36:03.140258 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:03.140258 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:36:03.140258 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:03.140258 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:03.140258 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:03.140258 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:03.140258 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:03.140258 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:03.141408 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:03.141408 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:03.141408 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:03.141408 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:03.141408 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:03.141408 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:03.141408 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:36:03.141408 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:36:03.141408 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:36:03.141408 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:36:03.141408 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:03.141408 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:03.141408 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:03.141408 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:03.141408 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:03.141408 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:03.142315 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:03.142315 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:03.142315 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:03.142315 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:03.142315 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:03.142315 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:03.142315 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:03.142315 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:03.142315 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:03.142315 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:03.142315 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:36:03.142315 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:36:03.142315 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 13:36:03.142315 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:03.142315 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 443/879] 10.222.0.69 () {56 vars in 1126 bytes} [Thu Sep 8 13:36:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:36:03.151057 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f6ec5-fb33-49e6-bee8-61f6180aa1db None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:03.170075 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:03.276490 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f6ec5-fb33-49e6-bee8-61f6180aa1db None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:03.314540 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf76c2-219c-4890-9711-2620b9752c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:03.315145 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf76c2-219c-4890-9711-2620b9752c40 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:03.315418 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf76c2-219c-4890-9711-2620b9752c40 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:03.315686 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf76c2-219c-4890-9711-2620b9752c40 None admin] PATH_INFO: `/v3/services` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:03.316312 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdf76c2-219c-4890-9711-2620b9752c40 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:03.316608 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdf76c2-219c-4890-9711-2620b9752c40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:03.318196 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdf76c2-219c-4890-9711-2620b9752c40 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:03.323677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 437/880] 10.222.0.69 () {56 vars in 1122 bytes} [Thu Sep 8 13:36:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:03.329225 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f1074-5ee5-42bb-af53-9dc7dac34591 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:03.447288 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f1074-5ee5-42bb-af53-9dc7dac34591 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:03.486614 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee847a42-3b89-48ad-9c09-fd7eb172a95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:03.487220 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee847a42-3b89-48ad-9c09-fd7eb172a95e None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:03.487494 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee847a42-3b89-48ad-9c09-fd7eb172a95e None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:03.487760 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee847a42-3b89-48ad-9c09-fd7eb172a95e None admin] PATH_INFO: `/v3/services` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:03.488409 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee847a42-3b89-48ad-9c09-fd7eb172a95e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:03.489739 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee847a42-3b89-48ad-9c09-fd7eb172a95e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:03.491252 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee847a42-3b89-48ad-9c09-fd7eb172a95e None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:03.497321 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 444/881] 10.222.0.69 () {56 vars in 1122 bytes} [Thu Sep 8 13:36:03 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:03.619989 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75da9d-6b56-4874-a59f-4bf1f4def563 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:03.620545 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75da9d-6b56-4874-a59f-4bf1f4def563 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:03.620545 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75da9d-6b56-4874-a59f-4bf1f4def563 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:03.622229 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 438/882] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:36:03.627938 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e42d14-2147-457f-a57c-3520b31c14ef None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:03.628247 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e42d14-2147-457f-a57c-3520b31c14ef None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:03.628485 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e42d14-2147-457f-a57c-3520b31c14ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:03.649340 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-59e42d14-2147-457f-a57c-3520b31c14ef None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:36:03.650583 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-59e42d14-2147-457f-a57c-3520b31c14ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:36:03.666600 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:03.727958 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 445/883] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:36:03 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:36:03.999027 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75da9d-6b56-4874-a59f-4bf1f4def563 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:04.096254 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:04.121953 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75da9d-6b56-4874-a59f-4bf1f4def563 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:04.160177 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38de2ba-aadf-40ec-873f-6a25535361de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:04.160947 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38de2ba-aadf-40ec-873f-6a25535361de None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:04.161228 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38de2ba-aadf-40ec-873f-6a25535361de None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:04.161531 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38de2ba-aadf-40ec-873f-6a25535361de None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:04.162131 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38de2ba-aadf-40ec-873f-6a25535361de None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:04.163489 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38de2ba-aadf-40ec-873f-6a25535361de None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:04.173820 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-c38de2ba-aadf-40ec-873f-6a25535361de None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 13:36:04.173820 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:04.173820 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:36:04.173820 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:36:04.173820 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:36:04.173820 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:36:04.173820 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:36:04.173820 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:36:04.173820 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 13:36:04.173820 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:36:04.173820 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:36:04.173820 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:36:04.173820 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:04.173820 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:04.173820 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:04.173820 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:04.173820 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:04.174879 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:04.174879 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:04.174879 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:04.174879 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:04.174879 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:04.174879 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:04.174879 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:36:04.174879 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:36:04.174879 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:36:04.174879 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:36:04.174879 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:04.174879 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:04.174879 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:04.174879 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:04.174879 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:04.174879 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:04.175714 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:04.175714 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:04.175714 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:04.175714 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:04.175714 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:04.175714 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:04.175714 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:04.175714 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:04.175714 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:04.175714 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:04.175714 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:36:04.175714 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:36:04.175714 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 13:36:04.175714 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:36:04.175714 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 439/884] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Sep 8 13:36:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:36:04.181646 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e42d14-2147-457f-a57c-3520b31c14ef None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:04.206971 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0b527-bf6c-44c9-84ff-cc151953d306 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:04.207362 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0b527-bf6c-44c9-84ff-cc151953d306 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:04.207676 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0b527-bf6c-44c9-84ff-cc151953d306 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:04.209151 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 440/885] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:36:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:36:04.215024 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9078b5-9c3d-449e-9bdb-72cb104431b1 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:04.215446 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9078b5-9c3d-449e-9bdb-72cb104431b1 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:04.215782 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9078b5-9c3d-449e-9bdb-72cb104431b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:04.234425 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-3a9078b5-9c3d-449e-9bdb-72cb104431b1 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:36:04.235708 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-3a9078b5-9c3d-449e-9bdb-72cb104431b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:36:04.309032 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e42d14-2147-457f-a57c-3520b31c14ef None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:04.352572 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63153793-72ae-4cc5-a6a9-824b8255c241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:04.353186 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63153793-72ae-4cc5-a6a9-824b8255c241 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:04.353506 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63153793-72ae-4cc5-a6a9-824b8255c241 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:04.353779 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63153793-72ae-4cc5-a6a9-824b8255c241 None admin] PATH_INFO: `/v3/services` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:04.354413 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63153793-72ae-4cc5-a6a9-824b8255c241 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:04.354712 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63153793-72ae-4cc5-a6a9-824b8255c241 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:04.356038 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 441/886] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:36:04 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:36:04.361923 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63153793-72ae-4cc5-a6a9-824b8255c241 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:04.368984 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 446/887] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Sep 8 13:36:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:04.379034 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9078b5-9c3d-449e-9bdb-72cb104431b1 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:04.461702 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:04.499871 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9078b5-9c3d-449e-9bdb-72cb104431b1 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:04.538787 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2534c93e-1302-4e6e-9c57-867e7316ad6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:04.539778 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534c93e-1302-4e6e-9c57-867e7316ad6c None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:04.540293 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534c93e-1302-4e6e-9c57-867e7316ad6c None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:04.540773 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534c93e-1302-4e6e-9c57-867e7316ad6c None admin] PATH_INFO: `/v3/services` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:04.541667 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2534c93e-1302-4e6e-9c57-867e7316ad6c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:04.542179 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2534c93e-1302-4e6e-9c57-867e7316ad6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:04.543754 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2534c93e-1302-4e6e-9c57-867e7316ad6c None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:04.549917 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 442/888] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Sep 8 13:36:04 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:04.556685 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63153793-72ae-4cc5-a6a9-824b8255c241 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:04.573542 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:04.655272 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2534c93e-1302-4e6e-9c57-867e7316ad6c None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:04.684387 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63153793-72ae-4cc5-a6a9-824b8255c241 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:04.733615 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e81c20-24ba-461a-9e98-8ddc5f09d0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:04.735495 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e81c20-24ba-461a-9e98-8ddc5f09d0a4 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:04.736000 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e81c20-24ba-461a-9e98-8ddc5f09d0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:04.736502 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e81c20-24ba-461a-9e98-8ddc5f09d0a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:04.737487 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e81c20-24ba-461a-9e98-8ddc5f09d0a4 None admin] RBAC: Adding query filter params (interface=public, service_id=e216f6b86a1f4ef4add886479f9bc5fe, region_id=RegionOne) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:04.738037 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e81c20-24ba-461a-9e98-8ddc5f09d0a4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:04.741105 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e81c20-24ba-461a-9e98-8ddc5f09d0a4 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:04.749660 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 447/889] 10.222.0.69 () {56 vars in 1251 bytes} [Thu Sep 8 13:36:04 2022] GET /identity/v3/endpoints?service_id=e216f6b86a1f4ef4add886479f9bc5fe&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:04.755749 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e81c20-24ba-461a-9e98-8ddc5f09d0a4 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:04.770656 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2534c93e-1302-4e6e-9c57-867e7316ad6c None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:04.818602 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159f041-b7a6-4dd8-b896-86e6c8cd884d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:04.819392 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159f041-b7a6-4dd8-b896-86e6c8cd884d None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:04.819676 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159f041-b7a6-4dd8-b896-86e6c8cd884d None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:04.819974 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159f041-b7a6-4dd8-b896-86e6c8cd884d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:04.823727 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:04.836917 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f159f041-b7a6-4dd8-b896-86e6c8cd884d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:36:04.843443 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-f159f041-b7a6-4dd8-b896-86e6c8cd884d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 13:36:04.843443 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:04.843443 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:04.843443 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:04.843443 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:04.843443 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:04.843443 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:04.843443 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:04.843443 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:04.843443 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:04.843443 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:04.843443 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:04.843443 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:36:04.843443 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:36:04.843443 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:36:04.843443 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:36:04.844433 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:36:04.844433 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:36:04.844433 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:36:04.844433 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:36:04.844433 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:04.844433 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:04.844433 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:04.844433 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:04.844433 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:04.844433 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:04.844433 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:04.844433 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:04.844433 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:04.844433 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:04.844433 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:04.844433 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:04.845285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:04.845285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:04.845285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:04.845285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:04.845285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:36:04.845285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:36:04.845285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:36:04.845285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:36:04.845285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:36:04.845285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:36:04.845285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 13:36:04.845285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:36:04.849442 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 443/890] 10.222.0.69 () {56 vars in 1120 bytes} [Thu Sep 8 13:36:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:36:04.852361 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159f041-b7a6-4dd8-b896-86e6c8cd884d None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:04.865254 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:04.892087 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e81c20-24ba-461a-9e98-8ddc5f09d0a4 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:04.931611 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04740644-6f08-413d-abf9-bede68f1a531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:04.932367 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04740644-6f08-413d-abf9-bede68f1a531 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:04.932647 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04740644-6f08-413d-abf9-bede68f1a531 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:04.932963 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04740644-6f08-413d-abf9-bede68f1a531 None admin] PATH_INFO: `/v3/services` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:04.933929 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04740644-6f08-413d-abf9-bede68f1a531 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:04.935081 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04740644-6f08-413d-abf9-bede68f1a531 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:04.948005 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 448/891] 10.222.0.69 () {56 vars in 1087 bytes} [Thu Sep 8 13:36:04 2022] GET /identity/v3/services => generated 1268 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 13:36:04.991075 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159f041-b7a6-4dd8-b896-86e6c8cd884d None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:05.037616 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbb646-e937-4634-bc2e-6abf11fd4b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:05.038806 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbb646-e937-4634-bc2e-6abf11fd4b83 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:05.039606 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbb646-e937-4634-bc2e-6abf11fd4b83 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:05.040135 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbb646-e937-4634-bc2e-6abf11fd4b83 None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:05.041229 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bbb646-e937-4634-bc2e-6abf11fd4b83 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:05.041845 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bbb646-e937-4634-bc2e-6abf11fd4b83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:05.043567 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bbb646-e937-4634-bc2e-6abf11fd4b83 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:05.060173 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 444/892] 10.222.0.69 () {56 vars in 1115 bytes} [Thu Sep 8 13:36:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:05.062214 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04740644-6f08-413d-abf9-bede68f1a531 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:05.200210 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04740644-6f08-413d-abf9-bede68f1a531 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:05.247287 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c685aa-80d3-4a31-a08a-c8b17072700f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:05.247287 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c685aa-80d3-4a31-a08a-c8b17072700f None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:05.247287 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c685aa-80d3-4a31-a08a-c8b17072700f None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:05.247287 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c685aa-80d3-4a31-a08a-c8b17072700f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:05.258768 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:05.262097 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c685aa-80d3-4a31-a08a-c8b17072700f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:05.264301 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c685aa-80d3-4a31-a08a-c8b17072700f None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:05.288509 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-b1c685aa-80d3-4a31-a08a-c8b17072700f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:36:05.288509 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:05.288509 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:05.288509 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:05.288509 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:05.288509 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:05.288509 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:05.288509 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:05.288509 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:05.288509 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:05.288509 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:05.288509 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:05.288509 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:36:05.288509 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:36:05.288509 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:36:05.288509 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:36:05.289620 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:05.289620 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:05.289620 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:05.289620 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:05.289620 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:05.289620 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:05.289620 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:05.289620 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:05.289620 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:05.289620 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:05.289620 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:05.289620 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:05.289620 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:05.289620 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:05.289620 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:05.289620 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:05.289620 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:36:05.290545 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:36:05.290545 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:36:05.290545 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:05.293469 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 449/893] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:36:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:36:05.296505 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbb646-e937-4634-bc2e-6abf11fd4b83 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:05.367746 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc6c6b-753a-4f1b-90df-4317155fd2fc None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:05.368205 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc6c6b-753a-4f1b-90df-4317155fd2fc None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:05.368646 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc6c6b-753a-4f1b-90df-4317155fd2fc None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:05.369785 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:05.370277 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 450/894] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:36:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:36:05.377111 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab5000-499a-4f26-a7a8-6e6dd17836cf None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:05.377439 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab5000-499a-4f26-a7a8-6e6dd17836cf None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:05.377688 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab5000-499a-4f26-a7a8-6e6dd17836cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:05.398270 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-c0ab5000-499a-4f26-a7a8-6e6dd17836cf None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:36:05.399472 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-c0ab5000-499a-4f26-a7a8-6e6dd17836cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:36:05.431459 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbb646-e937-4634-bc2e-6abf11fd4b83 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:05.480884 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291c3b2-fb37-422e-a724-61bbf7bb02f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:05.482021 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291c3b2-fb37-422e-a724-61bbf7bb02f0 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:05.482226 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291c3b2-fb37-422e-a724-61bbf7bb02f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:05.482501 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291c3b2-fb37-422e-a724-61bbf7bb02f0 None admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:05.483152 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4291c3b2-fb37-422e-a724-61bbf7bb02f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:05.483450 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4291c3b2-fb37-422e-a724-61bbf7bb02f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:05.484805 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4291c3b2-fb37-422e-a724-61bbf7bb02f0 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:05.487542 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 451/895] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:36:05 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:36:05.503272 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 445/896] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:05.505327 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ab5000-499a-4f26-a7a8-6e6dd17836cf None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:05.617541 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ab5000-499a-4f26-a7a8-6e6dd17836cf None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:05.643887 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:05.658400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4569e-f626-4f72-9dc5-0849cc238add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:05.659359 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4569e-f626-4f72-9dc5-0849cc238add None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:05.659862 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4569e-f626-4f72-9dc5-0849cc238add None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:05.660345 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4569e-f626-4f72-9dc5-0849cc238add None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:05.668667 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4569e-f626-4f72-9dc5-0849cc238add None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:05.670483 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4569e-f626-4f72-9dc5-0849cc238add None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:05.685014 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-1dc4569e-f626-4f72-9dc5-0849cc238add None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 13:36:05.685014 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:05.685014 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:05.685014 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:05.685014 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:05.685014 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:05.685014 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:05.685014 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:05.685014 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:05.685014 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:05.685014 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:05.685014 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:05.685014 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:36:05.685014 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:36:05.685014 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:36:05.685014 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:36:05.686130 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:05.686130 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:05.686130 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:36:05.686130 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:36:05.686130 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:36:05.686130 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:36:05.686130 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:05.686130 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:05.686130 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:05.686130 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:05.686130 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:05.686130 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:05.686130 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:05.686130 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:05.686130 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:05.686130 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:05.686130 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:05.686130 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:05.687107 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:05.687107 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:05.687107 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:36:05.687107 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:36:05.687107 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:36:05.687107 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:36:05.687107 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:36:05.687107 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:36:05.687107 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 13:36:05.687107 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:05.693675 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 452/897] 10.222.0.69 () {56 vars in 1117 bytes} [Thu Sep 8 13:36:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:36:05.697211 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291c3b2-fb37-422e-a724-61bbf7bb02f0 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:05.781378 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4569e-f626-4f72-9dc5-0849cc238add None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:05.809673 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291c3b2-fb37-422e-a724-61bbf7bb02f0 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:05.828321 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:05.849129 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a6a74-01d9-4d84-92dd-993ff86367f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:05.849812 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a6a74-01d9-4d84-92dd-993ff86367f6 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:05.850117 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a6a74-01d9-4d84-92dd-993ff86367f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:05.850347 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a6a74-01d9-4d84-92dd-993ff86367f6 None admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:05.851070 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a6a74-01d9-4d84-92dd-993ff86367f6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:05.851381 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a6a74-01d9-4d84-92dd-993ff86367f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:05.852789 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a6a74-01d9-4d84-92dd-993ff86367f6 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:05.873008 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 446/898] 10.222.0.69 () {56 vars in 1149 bytes} [Thu Sep 8 13:36:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:05.874301 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3babd9-5b4c-462e-b636-7a3741bcc9b9 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:05.874584 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3babd9-5b4c-462e-b636-7a3741bcc9b9 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:05.874852 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3babd9-5b4c-462e-b636-7a3741bcc9b9 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:05.876232 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 447/899] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:36:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:36:05.880940 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3babd9-5b4c-462e-b636-7a3741bcc9b9 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:05.903972 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4569e-f626-4f72-9dc5-0849cc238add None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:05.945261 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455cd6e-d779-41a7-bf91-81cf8e43799a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:05.945913 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455cd6e-d779-41a7-bf91-81cf8e43799a None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:05.946187 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455cd6e-d779-41a7-bf91-81cf8e43799a None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:05.946454 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455cd6e-d779-41a7-bf91-81cf8e43799a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:05.947029 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a455cd6e-d779-41a7-bf91-81cf8e43799a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:05.948719 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a455cd6e-d779-41a7-bf91-81cf8e43799a None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:05.959127 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-a455cd6e-d779-41a7-bf91-81cf8e43799a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 13:36:05.959127 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:05.959127 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:36:05.959127 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:36:05.959127 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:36:05.959127 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:36:05.959127 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:36:05.959127 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:36:05.959127 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 13:36:05.959127 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:05.959127 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:36:05.959127 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:05.959127 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:05.959127 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:05.959127 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:05.959127 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:05.960126 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:05.960126 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:05.960126 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:05.960126 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:05.960126 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:05.960126 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:05.960126 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:05.960126 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:36:05.960126 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:36:05.960126 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:36:05.960126 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:36:05.960126 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:05.960126 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:05.960126 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:05.960126 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:05.960126 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:05.960126 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:05.961064 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:05.961064 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:05.961064 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:05.961064 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:05.961064 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:05.961064 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:05.961064 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:05.961064 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:05.961064 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:05.961064 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:05.961064 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:36:05.961064 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:36:05.961064 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 13:36:05.961064 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:05.961064 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 453/900] 10.222.0.69 () {56 vars in 1132 bytes} [Thu Sep 8 13:36:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:36:05.962622 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb2a69-e85c-4560-83fc-af6497ff3d79 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:05.962622 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb2a69-e85c-4560-83fc-af6497ff3d79 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:05.962622 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb2a69-e85c-4560-83fc-af6497ff3d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:05.982981 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-98eb2a69-e85c-4560-83fc-af6497ff3d79 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:36:05.984214 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-98eb2a69-e85c-4560-83fc-af6497ff3d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:36:06.022255 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3babd9-5b4c-462e-b636-7a3741bcc9b9 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:06.039258 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:06.062064 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a92c7-2169-46f4-9b87-3be232757d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:06.063333 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a92c7-2169-46f4-9b87-3be232757d7d None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:06.063614 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a92c7-2169-46f4-9b87-3be232757d7d None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:06.063895 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148a92c7-2169-46f4-9b87-3be232757d7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:06.069230 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 454/901] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:36:05 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:36:06.070033 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb2a69-e85c-4560-83fc-af6497ff3d79 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:06.140045 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:06.173464 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148a92c7-2169-46f4-9b87-3be232757d7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:06.175625 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148a92c7-2169-46f4-9b87-3be232757d7d None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:06.199833 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb2a69-e85c-4560-83fc-af6497ff3d79 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:06.244324 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b488e-3151-4fdc-b56c-484557152e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:06.245100 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b488e-3151-4fdc-b56c-484557152e8d None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:06.245586 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b488e-3151-4fdc-b56c-484557152e8d None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:06.245975 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b488e-3151-4fdc-b56c-484557152e8d None admin] PATH_INFO: `/v3/services` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:06.246880 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b488e-3151-4fdc-b56c-484557152e8d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:06.247045 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b488e-3151-4fdc-b56c-484557152e8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:06.248638 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b488e-3151-4fdc-b56c-484557152e8d None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:06.260355 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 455/902] 10.222.0.69 () {56 vars in 1126 bytes} [Thu Sep 8 13:36:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:06.261332 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b488e-3151-4fdc-b56c-484557152e8d None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:06.311805 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:06.318094 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 448/903] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:36:05 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 13:36:06.319206 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a92c7-2169-46f4-9b87-3be232757d7d None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:06.388417 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b488e-3151-4fdc-b56c-484557152e8d None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:06.410095 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:06.427320 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de3f4d-cdef-42bb-aa74-c82fed318af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:06.427937 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de3f4d-cdef-42bb-aa74-c82fed318af9 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:06.428220 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de3f4d-cdef-42bb-aa74-c82fed318af9 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:06.428495 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de3f4d-cdef-42bb-aa74-c82fed318af9 None admin] PATH_INFO: `/v3/services` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:06.429133 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de3f4d-cdef-42bb-aa74-c82fed318af9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:06.429465 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de3f4d-cdef-42bb-aa74-c82fed318af9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:06.430843 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de3f4d-cdef-42bb-aa74-c82fed318af9 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:06.438398 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 456/904] 10.222.0.69 () {56 vars in 1126 bytes} [Thu Sep 8 13:36:06 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:06.438786 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de3f4d-cdef-42bb-aa74-c82fed318af9 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:06.446607 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148a92c7-2169-46f4-9b87-3be232757d7d None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:06.487010 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfdcd85-a6ce-4c42-bd41-aec8f1d169f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:06.487638 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfdcd85-a6ce-4c42-bd41-aec8f1d169f8 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:06.487909 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfdcd85-a6ce-4c42-bd41-aec8f1d169f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:06.488173 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfdcd85-a6ce-4c42-bd41-aec8f1d169f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:06.500092 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfdcd85-a6ce-4c42-bd41-aec8f1d169f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:06.501449 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfdcd85-a6ce-4c42-bd41-aec8f1d169f8 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:06.523016 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-7cfdcd85-a6ce-4c42-bd41-aec8f1d169f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:36:06.523016 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:06.523016 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:06.523016 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:06.523016 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:06.523016 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:06.523016 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:06.523016 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:06.523016 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:06.523016 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:06.523016 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:06.523016 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:06.523016 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:36:06.523016 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:36:06.523016 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:36:06.523016 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:36:06.524064 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:06.524064 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:06.524064 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:06.524064 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:06.524064 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:06.524064 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:06.524064 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:06.524064 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:06.524064 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:06.524064 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:06.524064 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:06.524064 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:06.524064 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:06.524064 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:06.524064 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:06.524064 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:06.524064 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:36:06.524967 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:36:06.524967 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:36:06.524967 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:36:06.528814 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 449/905] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:36:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:36:06.529689 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfdcd85-a6ce-4c42-bd41-aec8f1d169f8 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:06.569479 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de3f4d-cdef-42bb-aa74-c82fed318af9 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:06.571924 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:06.608727 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98168f47-946d-48c3-a184-68ec42c72381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:06.609327 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98168f47-946d-48c3-a184-68ec42c72381 None admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:06.609633 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98168f47-946d-48c3-a184-68ec42c72381 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:06.609902 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98168f47-946d-48c3-a184-68ec42c72381 None admin] PATH_INFO: `/v3/services` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:06.610555 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98168f47-946d-48c3-a184-68ec42c72381 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:06.611921 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98168f47-946d-48c3-a184-68ec42c72381 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:06.629076 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 457/906] 10.222.0.69 () {60 vars in 1141 bytes} [Thu Sep 8 13:36:06 2022] POST /identity/v3/services => generated 241 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:36:06.629076 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98168f47-946d-48c3-a184-68ec42c72381 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:06.663918 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfdcd85-a6ce-4c42-bd41-aec8f1d169f8 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:06.704308 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:06.726483 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db707aa7-e781-4372-ab8c-04598cb3aad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:06.727494 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db707aa7-e781-4372-ab8c-04598cb3aad0 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:06.728005 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db707aa7-e781-4372-ab8c-04598cb3aad0 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:06.728682 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db707aa7-e781-4372-ab8c-04598cb3aad0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:06.730178 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db707aa7-e781-4372-ab8c-04598cb3aad0 None admin] RBAC: Adding query filter params (interface=public, service_id=5a2b73d5159e44409d0db0c44e6609ee, region_id=RegionOne) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:06.730944 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db707aa7-e781-4372-ab8c-04598cb3aad0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:06.732563 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db707aa7-e781-4372-ab8c-04598cb3aad0 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:06.740549 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 450/907] 10.222.0.69 () {56 vars in 1251 bytes} [Thu Sep 8 13:36:06 2022] GET /identity/v3/endpoints?service_id=5a2b73d5159e44409d0db0c44e6609ee&interface=public®ion_id=RegionOne => generated 194 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:06.745663 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db707aa7-e781-4372-ab8c-04598cb3aad0 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:06.797918 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98168f47-946d-48c3-a184-68ec42c72381 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:06.842129 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991b4b7-d50a-4f32-93ef-b803034558ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:06.842660 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991b4b7-d50a-4f32-93ef-b803034558ae None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:06.842938 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991b4b7-d50a-4f32-93ef-b803034558ae None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:06.843211 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991b4b7-d50a-4f32-93ef-b803034558ae None admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:06.843866 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1991b4b7-d50a-4f32-93ef-b803034558ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:06.844173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1991b4b7-d50a-4f32-93ef-b803034558ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:06.845624 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1991b4b7-d50a-4f32-93ef-b803034558ae None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:06.860769 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 458/908] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:36:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:06.867397 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991b4b7-d50a-4f32-93ef-b803034558ae None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:06.886307 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db707aa7-e781-4372-ab8c-04598cb3aad0 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:06.903059 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:06.939794 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68897eda-4050-4042-a2a5-4f56780008d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:06.940832 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68897eda-4050-4042-a2a5-4f56780008d8 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:06.941320 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68897eda-4050-4042-a2a5-4f56780008d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:06.942489 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68897eda-4050-4042-a2a5-4f56780008d8 None admin] PATH_INFO: `/v3/services` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:06.943364 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68897eda-4050-4042-a2a5-4f56780008d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:06.944944 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68897eda-4050-4042-a2a5-4f56780008d8 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:06.954637 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 451/909] 10.222.0.69 () {56 vars in 1087 bytes} [Thu Sep 8 13:36:06 2022] GET /identity/v3/services => generated 1497 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 13:36:07.008796 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991b4b7-d50a-4f32-93ef-b803034558ae None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:07.059137 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68709b4a-427e-4b9b-9f4d-a8aba243110a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:07.060813 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68709b4a-427e-4b9b-9f4d-a8aba243110a None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:07.061427 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68709b4a-427e-4b9b-9f4d-a8aba243110a None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:07.062113 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68709b4a-427e-4b9b-9f4d-a8aba243110a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:07.072451 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68709b4a-427e-4b9b-9f4d-a8aba243110a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:07.074623 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68709b4a-427e-4b9b-9f4d-a8aba243110a None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:07.089861 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-68709b4a-427e-4b9b-9f4d-a8aba243110a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:36:07.089861 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:07.089861 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:07.089861 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:07.089861 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:07.089861 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:07.089861 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:07.089861 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:07.089861 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:07.089861 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:07.089861 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:07.089861 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:07.089861 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:36:07.089861 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:36:07.089861 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:36:07.090981 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:36:07.090981 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:07.090981 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:07.090981 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:07.090981 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:07.090981 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:07.090981 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:07.090981 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:07.090981 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:07.090981 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:07.090981 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:07.090981 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:07.090981 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:07.090981 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:07.090981 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:07.090981 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:07.090981 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:07.091946 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:36:07.091946 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:36:07.091946 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:36:07.091946 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:36:07.091946 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:36:07.091946 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:36:07.091946 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:36:07.091946 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:07.094666 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 459/910] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:36:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:36:07.101455 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68897eda-4050-4042-a2a5-4f56780008d8 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:07.172114 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:07.233490 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68897eda-4050-4042-a2a5-4f56780008d8 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:07.275083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f429d26-5127-4d74-9f79-833fbf03b2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:07.275700 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f429d26-5127-4d74-9f79-833fbf03b2a7 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:07.275976 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f429d26-5127-4d74-9f79-833fbf03b2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:07.276291 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f429d26-5127-4d74-9f79-833fbf03b2a7 None admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:07.277215 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f429d26-5127-4d74-9f79-833fbf03b2a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:07.277550 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f429d26-5127-4d74-9f79-833fbf03b2a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:07.279002 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f429d26-5127-4d74-9f79-833fbf03b2a7 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:07.293281 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 452/911] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 8 13:36:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:07.299445 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68709b4a-427e-4b9b-9f4d-a8aba243110a None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:07.364958 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e7945-c019-42be-afa8-3575602cd93f None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:07.365143 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e7945-c019-42be-afa8-3575602cd93f None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:07.365458 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e7945-c019-42be-afa8-3575602cd93f None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:07.367047 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 453/912] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:36:07.373321 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c51a1-a012-4c6a-9a67-e45745b8e638 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:07.373713 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c51a1-a012-4c6a-9a67-e45745b8e638 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:07.373883 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c51a1-a012-4c6a-9a67-e45745b8e638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:07.398161 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-833c51a1-a012-4c6a-9a67-e45745b8e638 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:36:07.399888 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-833c51a1-a012-4c6a-9a67-e45745b8e638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:36:07.408183 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:07.429991 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68709b4a-427e-4b9b-9f4d-a8aba243110a None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:07.474844 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218cefeb-1a9b-41d6-b63e-6328ad50c84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:07.475465 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cefeb-1a9b-41d6-b63e-6328ad50c84b None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:07.475835 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cefeb-1a9b-41d6-b63e-6328ad50c84b None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:07.476135 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cefeb-1a9b-41d6-b63e-6328ad50c84b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:07.477172 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218cefeb-1a9b-41d6-b63e-6328ad50c84b None admin] RBAC: Adding query filter params (role.id=2cc89a32b68046feacb991d263b7cb75, scope.project.id=88de9f1470c6415b97866ad5a3256ef2, user.id=6d2dd101d1a14e5ab95f272ab1bbeb94) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:07.477503 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218cefeb-1a9b-41d6-b63e-6328ad50c84b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:07.479138 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218cefeb-1a9b-41d6-b63e-6328ad50c84b None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:07.486199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 460/913] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 8 13:36:07 2022] GET /identity/v3/role_assignments?user.id=6d2dd101d1a14e5ab95f272ab1bbeb94&scope.project.id=88de9f1470c6415b97866ad5a3256ef2&role.id=2cc89a32b68046feacb991d263b7cb75 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:07.513650 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 454/914] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:36:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:36:07.830216 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218cefeb-1a9b-41d6-b63e-6328ad50c84b None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:07.943455 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218cefeb-1a9b-41d6-b63e-6328ad50c84b None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:07.983204 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f99ba-0a55-4cac-944b-90aab9cf76c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:07.984277 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f99ba-0a55-4cac-944b-90aab9cf76c4 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:07.985056 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f99ba-0a55-4cac-944b-90aab9cf76c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:07.985666 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f99ba-0a55-4cac-944b-90aab9cf76c4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:07.986508 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54f99ba-0a55-4cac-944b-90aab9cf76c4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:07.988995 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54f99ba-0a55-4cac-944b-90aab9cf76c4 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:08.000241 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-b54f99ba-0a55-4cac-944b-90aab9cf76c4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 13:36:08.000241 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:08.000241 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:36:08.000241 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:36:08.000241 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:36:08.000241 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:36:08.000241 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:36:08.000241 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:36:08.000241 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 13:36:08.000241 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:08.000241 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:36:08.000241 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:08.000241 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:08.000241 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:08.000241 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:08.000241 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:08.000241 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:08.001316 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:08.001316 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:08.001316 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:08.001316 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:08.001316 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:08.001316 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:08.001316 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:36:08.001316 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:36:08.001316 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:36:08.001316 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:36:08.001316 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:08.001316 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:08.001316 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:08.001316 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:08.001316 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:08.001316 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:08.002230 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:08.002230 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:08.002230 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:08.002230 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:08.002230 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:08.002230 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:08.002230 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:08.002230 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:08.002230 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:08.002230 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:08.002230 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:36:08.002230 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:36:08.002230 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 08 13:36:08.002230 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:08.005875 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 461/915] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Sep 8 13:36:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:36:08.012807 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c51a1-a012-4c6a-9a67-e45745b8e638 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:08.065387 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:08.133762 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c51a1-a012-4c6a-9a67-e45745b8e638 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:08.173325 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d298c0d-1259-4754-864f-367b87f3839a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:08.174356 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d298c0d-1259-4754-864f-367b87f3839a None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:08.174838 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d298c0d-1259-4754-864f-367b87f3839a None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:08.175390 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d298c0d-1259-4754-864f-367b87f3839a None admin] PATH_INFO: `/v3/services` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:08.176987 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d298c0d-1259-4754-864f-367b87f3839a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:08.177562 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d298c0d-1259-4754-864f-367b87f3839a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:08.179295 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d298c0d-1259-4754-864f-367b87f3839a None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:08.186281 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 455/916] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Sep 8 13:36:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:08.192492 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f99ba-0a55-4cac-944b-90aab9cf76c4 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:08.210309 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:08.312442 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f99ba-0a55-4cac-944b-90aab9cf76c4 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:08.351488 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706f1ed-7fee-482e-b14b-78e43e39c131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:08.352102 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706f1ed-7fee-482e-b14b-78e43e39c131 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:08.352377 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706f1ed-7fee-482e-b14b-78e43e39c131 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:08.352641 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706f1ed-7fee-482e-b14b-78e43e39c131 None admin] PATH_INFO: `/v3/services` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:08.353279 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706f1ed-7fee-482e-b14b-78e43e39c131 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:08.353606 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706f1ed-7fee-482e-b14b-78e43e39c131 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:08.355172 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706f1ed-7fee-482e-b14b-78e43e39c131 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:08.361335 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 462/917] 10.222.0.69 () {56 vars in 1114 bytes} [Thu Sep 8 13:36:08 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:08.367769 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d298c0d-1259-4754-864f-367b87f3839a None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:08.488042 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d298c0d-1259-4754-864f-367b87f3839a None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:08.497337 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:08.540020 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15f457-6f1e-419d-8508-7baf239e79da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:08.541278 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15f457-6f1e-419d-8508-7baf239e79da None admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:08.541834 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15f457-6f1e-419d-8508-7baf239e79da None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:08.542322 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15f457-6f1e-419d-8508-7baf239e79da None admin] PATH_INFO: `/v3/endpoints` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:08.543238 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c15f457-6f1e-419d-8508-7baf239e79da None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:08.544884 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c15f457-6f1e-419d-8508-7baf239e79da None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:08.571324 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 456/918] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:36:08 2022] POST /identity/v3/endpoints => generated 346 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:36:09.153339 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be2631-9fa7-4bee-b6fb-b8ac682707e0 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:09.153914 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be2631-9fa7-4bee-b6fb-b8ac682707e0 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:09.154199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be2631-9fa7-4bee-b6fb-b8ac682707e0 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:09.155814 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 463/919] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:36:09.161995 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2434c7-ac5c-473d-8f15-227d8df8d29a None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:09.162458 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2434c7-ac5c-473d-8f15-227d8df8d29a None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:09.162560 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2434c7-ac5c-473d-8f15-227d8df8d29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:09.182945 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-ce2434c7-ac5c-473d-8f15-227d8df8d29a None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:36:09.184173 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-ce2434c7-ac5c-473d-8f15-227d8df8d29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:36:09.311572 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 457/920] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:36:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:36:09.517865 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf9815-b141-4e18-b6f8-5a05796a36f7 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:09.518251 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf9815-b141-4e18-b6f8-5a05796a36f7 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:09.518432 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cf9815-b141-4e18-b6f8-5a05796a36f7 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:09.520530 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 464/921] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:36:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:36:09.526080 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d12aa1-5370-4d1a-88d8-df4e41ed0f6d None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:09.526365 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d12aa1-5370-4d1a-88d8-df4e41ed0f6d None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:09.526640 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d12aa1-5370-4d1a-88d8-df4e41ed0f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:09.545916 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-d4d12aa1-5370-4d1a-88d8-df4e41ed0f6d None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:36:09.547205 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-d4d12aa1-5370-4d1a-88d8-df4e41ed0f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:36:09.636184 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 458/922] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:36:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:36:09.692052 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf9815-b141-4e18-b6f8-5a05796a36f7 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:09.783389 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:09.811200 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cf9815-b141-4e18-b6f8-5a05796a36f7 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:09.849692 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97527eb9-4e23-4449-a9a5-91cfa44b3af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:09.850320 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97527eb9-4e23-4449-a9a5-91cfa44b3af4 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:09.850641 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97527eb9-4e23-4449-a9a5-91cfa44b3af4 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:09.850917 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97527eb9-4e23-4449-a9a5-91cfa44b3af4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:09.851544 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97527eb9-4e23-4449-a9a5-91cfa44b3af4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:09.853030 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97527eb9-4e23-4449-a9a5-91cfa44b3af4 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:09.862945 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-97527eb9-4e23-4449-a9a5-91cfa44b3af4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 13:36:09.862945 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:09.862945 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:36:09.862945 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:36:09.862945 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:36:09.862945 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:36:09.862945 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:36:09.862945 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:36:09.862945 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 13:36:09.862945 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:09.862945 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:36:09.862945 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:09.862945 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:09.862945 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:09.862945 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:09.862945 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:09.862945 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:09.864365 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:09.864365 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:09.864365 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:09.864365 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:09.864365 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:09.864365 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:09.864365 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:36:09.864365 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:36:09.864365 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:36:09.864365 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:36:09.864365 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:09.864365 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:09.864365 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:09.864365 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:09.864365 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:09.864365 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:09.865214 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:09.865214 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:09.865214 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:09.865214 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:09.865214 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:09.865214 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:09.865214 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:09.865214 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:09.865214 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:09.865214 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:09.865214 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:36:09.865214 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:36:09.865214 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 13:36:09.865214 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:09.865214 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 465/923] 10.222.0.69 () {56 vars in 1126 bytes} [Thu Sep 8 13:36:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:36:09.870822 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d12aa1-5370-4d1a-88d8-df4e41ed0f6d None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:09.890942 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:09.922451 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97527eb9-4e23-4449-a9a5-91cfa44b3af4 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:10.000542 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d12aa1-5370-4d1a-88d8-df4e41ed0f6d None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:10.043599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f512f9-1781-4c5e-ab10-96898358bcf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:10.044758 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f512f9-1781-4c5e-ab10-96898358bcf7 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:10.045480 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f512f9-1781-4c5e-ab10-96898358bcf7 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:10.045976 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f512f9-1781-4c5e-ab10-96898358bcf7 None admin] PATH_INFO: `/v3/services` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:10.046965 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f512f9-1781-4c5e-ab10-96898358bcf7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:10.047536 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f512f9-1781-4c5e-ab10-96898358bcf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:10.049128 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f512f9-1781-4c5e-ab10-96898358bcf7 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:10.060334 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 459/924] 10.222.0.69 () {56 vars in 1122 bytes} [Thu Sep 8 13:36:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:10.061851 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f512f9-1781-4c5e-ab10-96898358bcf7 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:10.062173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97527eb9-4e23-4449-a9a5-91cfa44b3af4 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:10.128440 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1dfd08-18ce-4fdd-8f3a-8374c863911b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:10.130039 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1dfd08-18ce-4fdd-8f3a-8374c863911b None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:10.130485 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1dfd08-18ce-4fdd-8f3a-8374c863911b None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:10.130926 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1dfd08-18ce-4fdd-8f3a-8374c863911b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:10.131953 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1dfd08-18ce-4fdd-8f3a-8374c863911b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:10.134525 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1dfd08-18ce-4fdd-8f3a-8374c863911b None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:10.155581 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-0d1dfd08-18ce-4fdd-8f3a-8374c863911b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 13:36:10.155581 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:10.155581 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:36:10.155581 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:36:10.155581 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:36:10.155581 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:36:10.155581 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:36:10.155581 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:36:10.155581 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 13:36:10.155581 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:10.155581 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:36:10.155581 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:10.155581 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:10.155581 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:10.155581 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:10.155581 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:10.157156 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:10.157156 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:10.157156 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:10.157156 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:10.157156 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:10.157156 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:10.157156 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:10.157156 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:36:10.157156 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:36:10.157156 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:36:10.157156 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:36:10.157156 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:10.157156 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:10.157156 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:10.157156 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:10.157156 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:10.157156 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:10.158140 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:10.158140 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:10.158140 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:10.158140 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:10.158140 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:10.158140 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:10.158140 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:10.158140 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:10.158140 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:10.158140 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:10.158140 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:36:10.158140 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:36:10.158140 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 08 13:36:10.158140 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:10.163468 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 466/925] 10.222.0.69 () {56 vars in 1132 bytes} [Thu Sep 8 13:36:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:36:10.168587 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:10.170233 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1dfd08-18ce-4fdd-8f3a-8374c863911b None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:10.191060 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f512f9-1781-4c5e-ab10-96898358bcf7 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:10.193396 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:10.232207 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb637261-336f-4188-8f2f-af2370b0c98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:10.233184 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb637261-336f-4188-8f2f-af2370b0c98a None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:10.233673 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb637261-336f-4188-8f2f-af2370b0c98a None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:10.234138 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb637261-336f-4188-8f2f-af2370b0c98a None admin] PATH_INFO: `/v3/services` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:10.235195 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb637261-336f-4188-8f2f-af2370b0c98a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:10.235714 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb637261-336f-4188-8f2f-af2370b0c98a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:10.238620 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb637261-336f-4188-8f2f-af2370b0c98a None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:10.252246 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 460/926] 10.222.0.69 () {56 vars in 1122 bytes} [Thu Sep 8 13:36:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:10.252246 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c7565-427a-481b-b490-5876f1227a2f None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:10.252246 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c7565-427a-481b-b490-5876f1227a2f None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:10.252246 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c7565-427a-481b-b490-5876f1227a2f None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:10.253525 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 461/927] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:36:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:36:10.254773 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c7565-427a-481b-b490-5876f1227a2f None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:10.337750 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1dfd08-18ce-4fdd-8f3a-8374c863911b None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:10.383729 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76966ed2-cff0-40e5-9802-3a6386578f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:10.384354 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76966ed2-cff0-40e5-9802-3a6386578f12 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:10.384636 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76966ed2-cff0-40e5-9802-3a6386578f12 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:10.384907 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76966ed2-cff0-40e5-9802-3a6386578f12 None admin] PATH_INFO: `/v3/services` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:10.385669 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76966ed2-cff0-40e5-9802-3a6386578f12 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:10.385976 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76966ed2-cff0-40e5-9802-3a6386578f12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:10.387580 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76966ed2-cff0-40e5-9802-3a6386578f12 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:10.400817 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 467/928] 10.222.0.69 () {56 vars in 1126 bytes} [Thu Sep 8 13:36:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:10.400817 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9c788-69f4-4817-baa0-115dabf64e82 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:10.400817 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9c788-69f4-4817-baa0-115dabf64e82 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:10.400817 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9c788-69f4-4817-baa0-115dabf64e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:10.413877 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c7565-427a-481b-b490-5876f1227a2f None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:10.429572 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-b2e9c788-69f4-4817-baa0-115dabf64e82 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:36:10.431606 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-b2e9c788-69f4-4817-baa0-115dabf64e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:36:10.479353 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1302c24-3024-4727-92b0-d1299d70bbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:10.480148 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1302c24-3024-4727-92b0-d1299d70bbe8 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:10.480601 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1302c24-3024-4727-92b0-d1299d70bbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:10.481058 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1302c24-3024-4727-92b0-d1299d70bbe8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:10.482335 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1302c24-3024-4727-92b0-d1299d70bbe8 None admin] RBAC: Adding query filter params (interface=public, service_id=65e3f7e7483a4f88914cf98de921f2e3, region_id=RegionOne) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:10.482848 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1302c24-3024-4727-92b0-d1299d70bbe8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:10.485237 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1302c24-3024-4727-92b0-d1299d70bbe8 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:10.494471 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 462/929] 10.222.0.69 () {56 vars in 1251 bytes} [Thu Sep 8 13:36:10 2022] GET /identity/v3/endpoints?service_id=65e3f7e7483a4f88914cf98de921f2e3&interface=public®ion_id=RegionOne => generated 194 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:10.495533 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1302c24-3024-4727-92b0-d1299d70bbe8 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:10.521276 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:10.556991 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:10.574236 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 468/930] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:36:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:36:10.574236 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9c788-69f4-4817-baa0-115dabf64e82 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:10.669668 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1302c24-3024-4727-92b0-d1299d70bbe8 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:10.731925 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f02aca1-03ba-46cf-855a-8b9b78ed0405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:10.732717 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02aca1-03ba-46cf-855a-8b9b78ed0405 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:10.733064 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02aca1-03ba-46cf-855a-8b9b78ed0405 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:10.733443 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f02aca1-03ba-46cf-855a-8b9b78ed0405 None admin] PATH_INFO: `/v3/services` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:10.734614 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f02aca1-03ba-46cf-855a-8b9b78ed0405 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:10.735023 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f02aca1-03ba-46cf-855a-8b9b78ed0405 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:10.736947 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f02aca1-03ba-46cf-855a-8b9b78ed0405 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:10.751586 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 463/931] 10.222.0.69 () {56 vars in 1126 bytes} [Thu Sep 8 13:36:10 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:10.753699 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f02aca1-03ba-46cf-855a-8b9b78ed0405 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:10.843211 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9c788-69f4-4817-baa0-115dabf64e82 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:10.901339 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:10.913930 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111079f-653a-4fce-b3d0-909d182e7065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:10.914835 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111079f-653a-4fce-b3d0-909d182e7065 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:10.915186 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111079f-653a-4fce-b3d0-909d182e7065 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:10.915609 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111079f-653a-4fce-b3d0-909d182e7065 None admin] PATH_INFO: `/v3/services` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:10.916594 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1111079f-653a-4fce-b3d0-909d182e7065 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:10.918168 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1111079f-653a-4fce-b3d0-909d182e7065 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:10.927448 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 469/932] 10.222.0.69 () {56 vars in 1087 bytes} [Thu Sep 8 13:36:10 2022] GET /identity/v3/services => generated 1497 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:36:10.937069 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f02aca1-03ba-46cf-855a-8b9b78ed0405 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:10.982706 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae69390-8c31-4506-8493-2208f6131849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:10.983704 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae69390-8c31-4506-8493-2208f6131849 None admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:10.984160 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae69390-8c31-4506-8493-2208f6131849 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:10.984702 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae69390-8c31-4506-8493-2208f6131849 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:10.985662 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae69390-8c31-4506-8493-2208f6131849 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:10.987326 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae69390-8c31-4506-8493-2208f6131849 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:10.991449 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111079f-653a-4fce-b3d0-909d182e7065 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:11.015441 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 464/933] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:36:10 2022] POST /identity/v3/endpoints => generated 347 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:36:11.017260 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d2ace-c995-44de-8a4a-0b61fb603651 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:11.017632 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d2ace-c995-44de-8a4a-0b61fb603651 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:11.017843 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d2ace-c995-44de-8a4a-0b61fb603651 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:11.019534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 465/934] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:36:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:36:11.027452 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4bb691-de5f-4d8f-8045-356220ad4d40 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:11.027452 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4bb691-de5f-4d8f-8045-356220ad4d40 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:11.027452 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4bb691-de5f-4d8f-8045-356220ad4d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:11.049357 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-ac4bb691-de5f-4d8f-8045-356220ad4d40 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:36:11.051673 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-ac4bb691-de5f-4d8f-8045-356220ad4d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:36:11.095065 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:11.146123 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111079f-653a-4fce-b3d0-909d182e7065 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:11.175109 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 466/935] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:36:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:36:11.205935 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba9382-5ba3-4acd-9047-2ebc5508d1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:11.206579 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba9382-5ba3-4acd-9047-2ebc5508d1f1 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:11.206857 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba9382-5ba3-4acd-9047-2ebc5508d1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:11.207168 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba9382-5ba3-4acd-9047-2ebc5508d1f1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:11.219507 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba9382-5ba3-4acd-9047-2ebc5508d1f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:36:11.225512 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-1dba9382-5ba3-4acd-9047-2ebc5508d1f1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 13:36:11.225512 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:11.225512 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:11.225512 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:11.225512 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:11.225512 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:11.225512 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:11.225512 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:11.225512 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:11.225512 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:11.225512 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:11.225512 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:11.225512 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:36:11.225512 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:36:11.225512 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:36:11.225512 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:36:11.226650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:36:11.226650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:36:11.226650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:36:11.226650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:36:11.226650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:11.226650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:11.226650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:11.226650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:11.226650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:11.226650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:11.226650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:11.226650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:11.226650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:11.226650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:11.226650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:11.226650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:11.227671 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:11.227671 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:11.227671 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:11.227671 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:11.227671 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:36:11.227671 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:36:11.227671 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:36:11.227671 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:36:11.227671 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:36:11.227671 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:36:11.227671 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 13:36:11.227671 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:11.227671 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 470/936] 10.222.0.69 () {56 vars in 1120 bytes} [Thu Sep 8 13:36:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:36:11.233150 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4bb691-de5f-4d8f-8045-356220ad4d40 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:11.296840 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:11.349196 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4bb691-de5f-4d8f-8045-356220ad4d40 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:11.388340 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919bb91-f444-4029-bb25-b113c230b946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:11.388966 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919bb91-f444-4029-bb25-b113c230b946 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:11.389252 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919bb91-f444-4029-bb25-b113c230b946 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:11.389559 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919bb91-f444-4029-bb25-b113c230b946 None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:11.390241 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b919bb91-f444-4029-bb25-b113c230b946 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:11.390544 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b919bb91-f444-4029-bb25-b113c230b946 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:11.391910 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b919bb91-f444-4029-bb25-b113c230b946 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:11.413565 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 467/937] 10.222.0.69 () {56 vars in 1115 bytes} [Thu Sep 8 13:36:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:11.415171 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba9382-5ba3-4acd-9047-2ebc5508d1f1 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:11.494298 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919bb91-f444-4029-bb25-b113c230b946 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:11.557026 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba9382-5ba3-4acd-9047-2ebc5508d1f1 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:11.591394 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:11.609939 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c66fe1a-a840-47f1-942c-187d6be08ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:11.610587 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66fe1a-a840-47f1-942c-187d6be08ef4 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:11.610872 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66fe1a-a840-47f1-942c-187d6be08ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:11.611146 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66fe1a-a840-47f1-942c-187d6be08ef4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:11.623834 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919bb91-f444-4029-bb25-b113c230b946 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:11.629072 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c66fe1a-a840-47f1-942c-187d6be08ef4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:11.630893 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c66fe1a-a840-47f1-942c-187d6be08ef4 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:11.662046 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:11.666589 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-2c66fe1a-a840-47f1-942c-187d6be08ef4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:36:11.666589 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:11.666589 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:11.666589 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:11.666589 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:11.666589 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:11.666589 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:11.666589 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:11.666589 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:11.666589 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:11.666589 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:11.666589 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:11.666589 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:36:11.666589 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:36:11.666589 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:36:11.666589 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:36:11.667949 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:11.667949 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:11.667949 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:11.667949 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:11.667949 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:11.667949 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:11.667949 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:11.667949 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:11.667949 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:11.667949 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:11.667949 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:11.667949 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:11.667949 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:11.667949 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:11.667949 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:11.667949 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:11.667949 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:36:11.668997 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:36:11.668997 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:36:11.668997 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:11.668997 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 471/938] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:36:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:36:11.675303 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c66fe1a-a840-47f1-942c-187d6be08ef4 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:11.692021 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2dcf8-0e54-47b7-8a40-eec0746614a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:11.693062 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2dcf8-0e54-47b7-8a40-eec0746614a5 None admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:11.693613 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2dcf8-0e54-47b7-8a40-eec0746614a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:11.694116 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2dcf8-0e54-47b7-8a40-eec0746614a5 None admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:11.695064 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd2dcf8-0e54-47b7-8a40-eec0746614a5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:11.697025 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd2dcf8-0e54-47b7-8a40-eec0746614a5 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:11.700391 dv-cinder-856463-2-smb devstack@keystone.service[88208]: WARNING keystone.server.flask.common [None req-7cd2dcf8-0e54-47b7-8a40-eec0746614a5 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 08 13:36:11.722616 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.sql.core [None req-7cd2dcf8-0e54-47b7-8a40-eec0746614a5 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 08 13:36:11.722616 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 08 13:36:11.722616 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [parameters: {'id': 'ed77373408ed4963b583de588b410054', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 08 13:36:11.722616 dv-cinder-856463-2-smb devstack@keystone.service[88208]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88208) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 08 13:36:11.732129 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-7cd2dcf8-0e54-47b7-8a40-eec0746614a5 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ed77373408ed4963b583de588b410054.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ed77373408ed4963b583de588b410054. Sep 08 13:36:11.732129 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:11.732129 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 13:36:11.732129 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 08 13:36:11.732129 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 13:36:11.732129 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 08 13:36:11.732129 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 13:36:11.732129 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application result = self._query(query) Sep 08 13:36:11.732129 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 13:36:11.732129 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application conn.query(q) Sep 08 13:36:11.732129 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 13:36:11.732129 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 13:36:11.732129 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 13:36:11.733017 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application result.read() Sep 08 13:36:11.733017 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 13:36:11.733017 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 08 13:36:11.733017 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 13:36:11.733017 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 08 13:36:11.733017 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 13:36:11.733017 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 08 13:36:11.733017 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 13:36:11.733017 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 08 13:36:11.733017 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 08 13:36:11.733017 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:36:11.733017 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 08 13:36:11.733017 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:36:11.733017 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:11.733017 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 08 13:36:11.733017 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 08 13:36:11.733017 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 08 13:36:11.733017 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 08 13:36:11.734388 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 08 13:36:11.734388 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application next(self.gen) Sep 08 13:36:11.734388 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 08 13:36:11.734388 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application yield resource Sep 08 13:36:11.734388 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 08 13:36:11.734388 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application next(self.gen) Sep 08 13:36:11.734388 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 08 13:36:11.734388 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application self.session.rollback() Sep 08 13:36:11.734388 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 13:36:11.734388 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application self.force_reraise() Sep 08 13:36:11.734388 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 13:36:11.734388 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise self.value Sep 08 13:36:11.734388 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 08 13:36:11.734388 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 08 13:36:11.734388 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 08 13:36:11.734388 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application session.commit() Sep 08 13:36:11.734388 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 08 13:36:11.735288 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 08 13:36:11.735288 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 08 13:36:11.735288 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application self._prepare_impl() Sep 08 13:36:11.735288 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 08 13:36:11.735288 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application self.session.flush() Sep 08 13:36:11.735288 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 08 13:36:11.735288 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application self._flush(objects) Sep 08 13:36:11.735288 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 08 13:36:11.735288 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 08 13:36:11.735288 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 08 13:36:11.735288 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application compat.raise_( Sep 08 13:36:11.735288 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 13:36:11.735288 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception Sep 08 13:36:11.735288 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 08 13:36:11.735288 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application flush_context.execute() Sep 08 13:36:11.735288 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 08 13:36:11.735288 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rec.execute(self) Sep 08 13:36:11.736735 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 08 13:36:11.736735 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 08 13:36:11.736735 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 08 13:36:11.736735 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 08 13:36:11.736735 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 08 13:36:11.736735 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 08 13:36:11.736735 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 08 13:36:11.736735 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 08 13:36:11.736735 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 08 13:36:11.736735 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 08 13:36:11.736735 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 08 13:36:11.736735 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 08 13:36:11.736735 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 08 13:36:11.736735 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 08 13:36:11.736735 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 08 13:36:11.738691 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 08 13:36:11.738691 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 13:36:11.738691 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception Sep 08 13:36:11.738691 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 13:36:11.738691 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 08 13:36:11.738691 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 13:36:11.738691 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 08 13:36:11.738691 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 13:36:11.738691 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application result = self._query(query) Sep 08 13:36:11.738691 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 13:36:11.738691 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application conn.query(q) Sep 08 13:36:11.738691 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 13:36:11.738691 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 13:36:11.738691 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 13:36:11.738691 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application result.read() Sep 08 13:36:11.738691 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 13:36:11.738691 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 08 13:36:11.740781 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 13:36:11.740781 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 08 13:36:11.740781 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 13:36:11.740781 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 08 13:36:11.740781 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 13:36:11.740781 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 08 13:36:11.740781 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 08 13:36:11.740781 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 08 13:36:11.740781 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [parameters: {'id': 'ed77373408ed4963b583de588b410054', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 08 13:36:11.740781 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 08 13:36:11.740781 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:36:11.740781 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:36:11.740781 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:36:11.740781 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:11.740781 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 08 13:36:11.742733 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 08 13:36:11.742733 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 08 13:36:11.742733 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 08 13:36:11.742733 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 08 13:36:11.742733 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:36:11.742733 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:36:11.742733 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:36:11.742733 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:11.742733 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:11.742733 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:11.742733 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:11.742733 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:11.742733 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:11.742733 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:11.742733 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:11.742733 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:11.742733 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:11.745012 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:11.745012 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 08 13:36:11.745012 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 08 13:36:11.745012 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:11.745012 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:11.745012 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 08 13:36:11.745012 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 08 13:36:11.745012 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ed77373408ed4963b583de588b410054. Sep 08 13:36:11.745012 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:36:11.748896 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 468/939] 10.222.0.69 () {60 vars in 1140 bytes} [Thu Sep 8 13:36:11 2022] POST /identity/v3/projects => generated 262 bytes in 255 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:36:11.757564 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2dcf8-0e54-47b7-8a40-eec0746614a5 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:11.793791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c66fe1a-a840-47f1-942c-187d6be08ef4 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:11.830889 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b7f22-d0cb-419a-b05b-2bdce55aec0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:11.831514 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b7f22-d0cb-419a-b05b-2bdce55aec0b None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:11.831792 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b7f22-d0cb-419a-b05b-2bdce55aec0b None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:11.832593 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b7f22-d0cb-419a-b05b-2bdce55aec0b None admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:11.833258 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914b7f22-d0cb-419a-b05b-2bdce55aec0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:11.833595 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914b7f22-d0cb-419a-b05b-2bdce55aec0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:11.834994 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914b7f22-d0cb-419a-b05b-2bdce55aec0b None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:11.853102 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 472/940] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:36:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:11.854120 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b7f22-d0cb-419a-b05b-2bdce55aec0b None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:11.872503 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2dcf8-0e54-47b7-8a40-eec0746614a5 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:11.891461 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:11.914693 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad7a35-7885-4262-abfa-2461a3824b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:11.915771 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad7a35-7885-4262-abfa-2461a3824b66 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:11.916066 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad7a35-7885-4262-abfa-2461a3824b66 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:11.916486 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad7a35-7885-4262-abfa-2461a3824b66 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:11.926104 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad7a35-7885-4262-abfa-2461a3824b66 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:11.927889 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad7a35-7885-4262-abfa-2461a3824b66 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:11.942895 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-71ad7a35-7885-4262-abfa-2461a3824b66 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:36:11.942895 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:11.942895 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:11.942895 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:11.942895 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:11.942895 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:11.942895 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:11.942895 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:11.942895 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:11.942895 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:11.942895 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:11.942895 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:11.942895 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:36:11.942895 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:36:11.942895 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:36:11.943993 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:36:11.943993 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:11.943993 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:11.943993 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:11.943993 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:11.943993 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:11.943993 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:11.943993 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:11.943993 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:11.943993 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:11.943993 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:11.943993 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:11.943993 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:11.943993 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:11.943993 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:11.943993 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:11.943993 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:11.945032 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:36:11.945032 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:36:11.945032 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:36:11.945032 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:36:11.945032 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:36:11.945032 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:36:11.945032 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:36:11.945032 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:36:11.950045 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 469/941] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:36:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:36:11.951745 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad7a35-7885-4262-abfa-2461a3824b66 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:11.974922 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b7f22-d0cb-419a-b05b-2bdce55aec0b None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:12.002099 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:12.016800 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923d7d9-7b9e-41e3-af2f-90a2eb87db41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:12.017525 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923d7d9-7b9e-41e3-af2f-90a2eb87db41 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:12.017824 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923d7d9-7b9e-41e3-af2f-90a2eb87db41 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:12.018371 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923d7d9-7b9e-41e3-af2f-90a2eb87db41 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:12.027124 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b923d7d9-7b9e-41e3-af2f-90a2eb87db41 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:12.028814 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b923d7d9-7b9e-41e3-af2f-90a2eb87db41 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:12.042513 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-b923d7d9-7b9e-41e3-af2f-90a2eb87db41 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 13:36:12.042513 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:12.042513 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:12.042513 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:12.042513 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:12.042513 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:12.042513 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:12.042513 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:12.042513 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:12.042513 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:12.042513 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:12.042513 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:12.042513 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:36:12.042513 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:36:12.042513 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:36:12.042513 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:36:12.043693 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:12.043693 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:12.043693 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:36:12.043693 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:36:12.043693 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:36:12.043693 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:36:12.043693 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:12.043693 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:12.043693 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:12.043693 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:12.043693 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:12.043693 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:12.043693 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:12.043693 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:12.043693 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:12.043693 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:12.043693 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:12.043693 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:12.045037 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:12.045037 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:12.045037 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:36:12.045037 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:36:12.045037 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:36:12.045037 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:36:12.045037 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:36:12.045037 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:36:12.045037 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 13:36:12.045037 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:12.049611 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 473/942] 10.222.0.69 () {56 vars in 1117 bytes} [Thu Sep 8 13:36:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:36:12.051388 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923d7d9-7b9e-41e3-af2f-90a2eb87db41 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:12.093236 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad7a35-7885-4262-abfa-2461a3824b66 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:12.133981 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602333f-122c-4ab0-9e0b-b0730a252b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:12.134883 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602333f-122c-4ab0-9e0b-b0730a252b6c None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:12.135336 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602333f-122c-4ab0-9e0b-b0730a252b6c None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:12.135757 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602333f-122c-4ab0-9e0b-b0730a252b6c None admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:12.136571 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602333f-122c-4ab0-9e0b-b0730a252b6c None admin] RBAC: Adding query filter params (name=service) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:12.137183 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602333f-122c-4ab0-9e0b-b0730a252b6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:12.139682 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602333f-122c-4ab0-9e0b-b0730a252b6c None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:12.164818 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:12.173644 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 470/943] 10.222.0.69 () {56 vars in 1112 bytes} [Thu Sep 8 13:36:11 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:12.182734 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923d7d9-7b9e-41e3-af2f-90a2eb87db41 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:12.225026 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e1488-4348-45f6-9e54-33003f79e4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:12.225698 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e1488-4348-45f6-9e54-33003f79e4f7 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:12.225971 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e1488-4348-45f6-9e54-33003f79e4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:12.226200 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e1488-4348-45f6-9e54-33003f79e4f7 None admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:12.226948 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e1488-4348-45f6-9e54-33003f79e4f7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:12.227256 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e1488-4348-45f6-9e54-33003f79e4f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:12.228745 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400e1488-4348-45f6-9e54-33003f79e4f7 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:12.250769 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 474/944] 10.222.0.69 () {56 vars in 1149 bytes} [Thu Sep 8 13:36:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:12.258615 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602333f-122c-4ab0-9e0b-b0730a252b6c None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:12.384965 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:12.396423 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602333f-122c-4ab0-9e0b-b0730a252b6c None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:12.449391 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73adb62-842c-4bc3-85c2-6b497081045a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:12.449391 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73adb62-842c-4bc3-85c2-6b497081045a None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:12.449391 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73adb62-842c-4bc3-85c2-6b497081045a None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:12.449391 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73adb62-842c-4bc3-85c2-6b497081045a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:12.460369 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73adb62-842c-4bc3-85c2-6b497081045a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:12.461964 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73adb62-842c-4bc3-85c2-6b497081045a None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:12.484580 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-c73adb62-842c-4bc3-85c2-6b497081045a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:36:12.484580 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:12.484580 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:12.484580 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:12.484580 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:12.484580 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:12.484580 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:12.484580 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:12.484580 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:12.484580 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:12.484580 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:12.484580 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:12.484580 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:36:12.484580 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:36:12.484580 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:36:12.484580 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:36:12.485676 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:12.485676 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:12.485676 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:12.485676 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:12.485676 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:12.485676 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:12.485676 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:12.485676 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:12.485676 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:12.485676 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:12.485676 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:12.485676 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:12.485676 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:12.485676 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:12.485676 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:12.485676 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:12.485676 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:36:12.486756 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:36:12.486756 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:36:12.486756 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:36:12.486756 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 471/945] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:36:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:36:12.492957 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e1488-4348-45f6-9e54-33003f79e4f7 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:12.616273 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e1488-4348-45f6-9e54-33003f79e4f7 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:12.653590 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25aacad-571b-40a5-ae59-6d0ab3e363de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:12.654205 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25aacad-571b-40a5-ae59-6d0ab3e363de None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:12.654485 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25aacad-571b-40a5-ae59-6d0ab3e363de None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:12.654758 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25aacad-571b-40a5-ae59-6d0ab3e363de None admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:12.655498 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25aacad-571b-40a5-ae59-6d0ab3e363de None admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:12.655806 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25aacad-571b-40a5-ae59-6d0ab3e363de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:12.657228 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25aacad-571b-40a5-ae59-6d0ab3e363de None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:12.671513 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 475/946] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:12.678418 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73adb62-842c-4bc3-85c2-6b497081045a None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:12.858455 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73adb62-842c-4bc3-85c2-6b497081045a None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:12.922384 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bca1d3-8e5b-4ef8-afcf-3e59ceb078c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:12.923371 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bca1d3-8e5b-4ef8-afcf-3e59ceb078c4 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:12.923870 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bca1d3-8e5b-4ef8-afcf-3e59ceb078c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:12.924363 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bca1d3-8e5b-4ef8-afcf-3e59ceb078c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:12.937387 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bca1d3-8e5b-4ef8-afcf-3e59ceb078c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:12.940123 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bca1d3-8e5b-4ef8-afcf-3e59ceb078c4 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:12.964581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-92bca1d3-8e5b-4ef8-afcf-3e59ceb078c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:36:12.964581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:12.964581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:12.964581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:12.964581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:12.964581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:12.964581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:12.964581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:12.964581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:12.964581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:12.964581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:12.964581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:12.964581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:36:12.964581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:36:12.964581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:36:12.965599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:36:12.965599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:12.965599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:12.965599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:12.965599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:12.965599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:12.965599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:12.965599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:12.965599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:12.965599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:12.965599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:12.965599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:12.965599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:12.965599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:12.965599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:12.965599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:12.965599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:12.966501 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:36:12.966501 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:36:12.966501 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:36:12.966501 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:36:12.966501 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:36:12.966501 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:36:12.966501 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:36:12.966501 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:36:12.967504 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 472/947] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:36:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:36:12.972469 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25aacad-571b-40a5-ae59-6d0ab3e363de None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:12.994522 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:13.090094 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25aacad-571b-40a5-ae59-6d0ab3e363de None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:13.130331 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ccfe35-8696-4939-b766-dcdec233544c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:13.131106 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ccfe35-8696-4939-b766-dcdec233544c None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:13.131453 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ccfe35-8696-4939-b766-dcdec233544c None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:13.131789 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ccfe35-8696-4939-b766-dcdec233544c None admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:13.132557 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ccfe35-8696-4939-b766-dcdec233544c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:13.132928 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ccfe35-8696-4939-b766-dcdec233544c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:13.134460 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ccfe35-8696-4939-b766-dcdec233544c None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:13.149354 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 476/948] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 8 13:36:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:13.156925 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bca1d3-8e5b-4ef8-afcf-3e59ceb078c4 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:13.170013 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:13.315604 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bca1d3-8e5b-4ef8-afcf-3e59ceb078c4 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:13.382715 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55caf31-7ced-4a9a-a787-535923476499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:13.383727 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55caf31-7ced-4a9a-a787-535923476499 None admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:13.384255 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55caf31-7ced-4a9a-a787-535923476499 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:13.384717 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55caf31-7ced-4a9a-a787-535923476499 None admin] PATH_INFO: `/v3/projects/88de9f1470c6415b97866ad5a3256ef2/users/6d2dd101d1a14e5ab95f272ab1bbeb94/roles/2cc89a32b68046feacb991d263b7cb75` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:13.388898 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55caf31-7ced-4a9a-a787-535923476499 None admin] RBAC: Authorizing `identity:create_grant(project_id=88de9f1470c6415b97866ad5a3256ef2, user_id=6d2dd101d1a14e5ab95f272ab1bbeb94, role_id=2cc89a32b68046feacb991d263b7cb75)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:13.391840 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55caf31-7ced-4a9a-a787-535923476499 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:13.419498 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 473/949] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Sep 8 13:36:13 2022] PUT /identity/v3/projects/88de9f1470c6415b97866ad5a3256ef2/users/6d2dd101d1a14e5ab95f272ab1bbeb94/roles/2cc89a32b68046feacb991d263b7cb75 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:36:13.543924 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4fdd6-15f9-41dc-8096-7e02f28a046d None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:13.544902 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4fdd6-15f9-41dc-8096-7e02f28a046d None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:13.545321 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4fdd6-15f9-41dc-8096-7e02f28a046d None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:13.547776 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 477/950] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:36:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:36:13.556470 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a5b18-77f2-4c3e-8e6f-38c532a4d34d None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:13.557065 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a5b18-77f2-4c3e-8e6f-38c532a4d34d None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:13.557682 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a5b18-77f2-4c3e-8e6f-38c532a4d34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:13.591401 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-ae0a5b18-77f2-4c3e-8e6f-38c532a4d34d None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:36:13.594485 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-ae0a5b18-77f2-4c3e-8e6f-38c532a4d34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:36:13.700696 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:13.715740 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 474/951] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:36:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:36:13.992440 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4fdd6-15f9-41dc-8096-7e02f28a046d None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:14.094800 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:14.156814 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a4fdd6-15f9-41dc-8096-7e02f28a046d None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:14.218931 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db1532d-1c39-4a90-9d27-1a79b2aa34a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:14.219986 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1532d-1c39-4a90-9d27-1a79b2aa34a9 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:14.220445 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1532d-1c39-4a90-9d27-1a79b2aa34a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:14.220921 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1532d-1c39-4a90-9d27-1a79b2aa34a9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:14.222045 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db1532d-1c39-4a90-9d27-1a79b2aa34a9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:14.226290 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db1532d-1c39-4a90-9d27-1a79b2aa34a9 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:14.246839 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-3db1532d-1c39-4a90-9d27-1a79b2aa34a9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 13:36:14.246839 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:14.246839 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:36:14.246839 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:36:14.246839 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:36:14.246839 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:36:14.246839 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:36:14.246839 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:36:14.246839 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 13:36:14.246839 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:14.246839 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:36:14.246839 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:14.246839 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:14.246839 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:14.246839 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:14.246839 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:14.246839 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:14.248726 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:14.248726 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:14.248726 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:14.248726 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:14.248726 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:14.248726 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:14.248726 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:36:14.248726 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:36:14.248726 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:36:14.248726 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:36:14.248726 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:14.248726 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:14.248726 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:14.248726 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:14.248726 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:14.248726 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:14.252574 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:14.252574 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:14.252574 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:14.252574 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:14.252574 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:14.252574 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:14.252574 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:14.252574 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:14.252574 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:14.252574 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:14.252574 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:36:14.252574 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:36:14.252574 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 13:36:14.252574 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:14.252574 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 478/952] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:36:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:36:14.268534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a5b18-77f2-4c3e-8e6f-38c532a4d34d None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:14.300329 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff9f5b-8277-4cec-bbd4-daa073fa5cad None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:14.301061 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff9f5b-8277-4cec-bbd4-daa073fa5cad None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:14.302893 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff9f5b-8277-4cec-bbd4-daa073fa5cad None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:14.305644 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 479/953] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:36:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:36:14.315548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf5ae3-7881-40a7-ab32-8ee8cc2ad277 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:14.316028 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf5ae3-7881-40a7-ab32-8ee8cc2ad277 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:14.317175 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf5ae3-7881-40a7-ab32-8ee8cc2ad277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:14.351407 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-ceaf5ae3-7881-40a7-ab32-8ee8cc2ad277 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:36:14.353978 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-ceaf5ae3-7881-40a7-ab32-8ee8cc2ad277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:36:14.474504 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a5b18-77f2-4c3e-8e6f-38c532a4d34d None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:14.505621 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 480/954] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:36:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:36:14.540763 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02876812-912e-4193-97ab-1a741a1cdb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:14.541878 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02876812-912e-4193-97ab-1a741a1cdb2f None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:14.542361 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02876812-912e-4193-97ab-1a741a1cdb2f None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:14.542845 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02876812-912e-4193-97ab-1a741a1cdb2f None admin] PATH_INFO: `/v3/services` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:14.544048 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02876812-912e-4193-97ab-1a741a1cdb2f None admin] RBAC: Adding query filter params (name=compute) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:14.544579 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02876812-912e-4193-97ab-1a741a1cdb2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:14.547479 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02876812-912e-4193-97ab-1a741a1cdb2f None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:14.559067 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 475/955] 10.222.0.69 () {56 vars in 1112 bytes} [Thu Sep 8 13:36:14 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:14.566869 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf5ae3-7881-40a7-ab32-8ee8cc2ad277 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:14.660797 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:14.707830 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf5ae3-7881-40a7-ab32-8ee8cc2ad277 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:14.751135 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ed256-7b7f-4cc6-9e62-7c35488bf832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:14.751756 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ed256-7b7f-4cc6-9e62-7c35488bf832 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:14.752032 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ed256-7b7f-4cc6-9e62-7c35488bf832 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:14.752301 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ed256-7b7f-4cc6-9e62-7c35488bf832 None admin] PATH_INFO: `/v3/services` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:14.752935 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ed256-7b7f-4cc6-9e62-7c35488bf832 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:14.753237 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ed256-7b7f-4cc6-9e62-7c35488bf832 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:14.755243 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ed256-7b7f-4cc6-9e62-7c35488bf832 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:14.760943 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 481/956] 10.222.0.69 () {56 vars in 1112 bytes} [Thu Sep 8 13:36:14 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:14.825719 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02876812-912e-4193-97ab-1a741a1cdb2f None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:14.905286 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:14.967670 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02876812-912e-4193-97ab-1a741a1cdb2f None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:15.024625 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60174c81-4d80-4ee3-998b-0eb6903c6188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:15.025324 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60174c81-4d80-4ee3-998b-0eb6903c6188 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:15.025648 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60174c81-4d80-4ee3-998b-0eb6903c6188 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:15.025946 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60174c81-4d80-4ee3-998b-0eb6903c6188 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:15.026682 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60174c81-4d80-4ee3-998b-0eb6903c6188 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:15.028304 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60174c81-4d80-4ee3-998b-0eb6903c6188 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:15.039872 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-60174c81-4d80-4ee3-998b-0eb6903c6188 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 13:36:15.039872 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:15.039872 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:36:15.039872 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:36:15.039872 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:36:15.039872 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:36:15.039872 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:36:15.039872 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:36:15.039872 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 13:36:15.039872 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:36:15.039872 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:36:15.039872 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:36:15.039872 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:15.039872 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:15.039872 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:15.039872 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:15.039872 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:15.040951 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:15.040951 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:15.040951 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:15.040951 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:15.040951 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:15.040951 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:15.040951 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:36:15.040951 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:36:15.040951 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:36:15.040951 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:36:15.040951 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:15.040951 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:15.040951 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:15.040951 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:15.040951 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:15.040951 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:15.042845 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:15.042845 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:15.042845 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:15.042845 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:15.042845 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:15.042845 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:15.042845 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:15.042845 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:15.042845 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:15.042845 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:15.042845 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:36:15.042845 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:36:15.042845 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 13:36:15.042845 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:36:15.042845 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 476/957] 10.222.0.69 () {56 vars in 1126 bytes} [Thu Sep 8 13:36:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:36:15.051719 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ed256-7b7f-4cc6-9e62-7c35488bf832 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:15.230430 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ed256-7b7f-4cc6-9e62-7c35488bf832 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:15.276830 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:15.283997 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9463602a-894f-4a2a-95bf-a0cd9282fb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:15.284835 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463602a-894f-4a2a-95bf-a0cd9282fb91 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:15.285872 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463602a-894f-4a2a-95bf-a0cd9282fb91 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:15.286293 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463602a-894f-4a2a-95bf-a0cd9282fb91 None admin] PATH_INFO: `/v3/services` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:15.287096 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9463602a-894f-4a2a-95bf-a0cd9282fb91 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:15.287547 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9463602a-894f-4a2a-95bf-a0cd9282fb91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:15.289071 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9463602a-894f-4a2a-95bf-a0cd9282fb91 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:15.294936 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 482/958] 10.222.0.69 () {56 vars in 1122 bytes} [Thu Sep 8 13:36:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:15.304619 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60174c81-4d80-4ee3-998b-0eb6903c6188 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:15.486772 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60174c81-4d80-4ee3-998b-0eb6903c6188 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:15.505909 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f75b5-000e-4e69-98c4-1d48b77ebdb0 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:15.506831 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f75b5-000e-4e69-98c4-1d48b77ebdb0 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:15.507448 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f75b5-000e-4e69-98c4-1d48b77ebdb0 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:15.516550 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 483/959] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:36:15 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:36:15.519303 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50454dc7-4b1e-464c-803a-f8f3d4551ba5 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:15.520175 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50454dc7-4b1e-464c-803a-f8f3d4551ba5 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:15.520899 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50454dc7-4b1e-464c-803a-f8f3d4551ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:15.529971 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:15.548773 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09902cd4-0393-4ee6-aa8f-fb4d5638887c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:15.549724 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09902cd4-0393-4ee6-aa8f-fb4d5638887c None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:15.550253 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09902cd4-0393-4ee6-aa8f-fb4d5638887c None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:15.551248 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09902cd4-0393-4ee6-aa8f-fb4d5638887c None admin] PATH_INFO: `/v3/services` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:15.552316 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09902cd4-0393-4ee6-aa8f-fb4d5638887c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:15.552833 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09902cd4-0393-4ee6-aa8f-fb4d5638887c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:15.553744 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-50454dc7-4b1e-464c-803a-f8f3d4551ba5 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:36:15.555299 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09902cd4-0393-4ee6-aa8f-fb4d5638887c None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:15.556155 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-50454dc7-4b1e-464c-803a-f8f3d4551ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:36:15.564804 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 477/960] 10.222.0.69 () {56 vars in 1122 bytes} [Thu Sep 8 13:36:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:15.577253 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09902cd4-0393-4ee6-aa8f-fb4d5638887c None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:15.670291 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 484/961] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:36:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:36:15.751831 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09902cd4-0393-4ee6-aa8f-fb4d5638887c None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:15.823331 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c254c4-c490-4a9a-8427-596818d19bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:15.824874 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c254c4-c490-4a9a-8427-596818d19bfc None admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:15.825663 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c254c4-c490-4a9a-8427-596818d19bfc None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:15.826413 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c254c4-c490-4a9a-8427-596818d19bfc None admin] PATH_INFO: `/v3/endpoints` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:15.827930 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c254c4-c490-4a9a-8427-596818d19bfc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:15.830677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c254c4-c490-4a9a-8427-596818d19bfc None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:15.869075 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 478/962] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:36:15 2022] POST /identity/v3/endpoints => generated 349 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:36:16.070300 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50454dc7-4b1e-464c-803a-f8f3d4551ba5 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:16.171208 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8737f97-8b72-45b0-ad94-325b9b287865 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:16.171471 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8737f97-8b72-45b0-ad94-325b9b287865 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:16.171787 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8737f97-8b72-45b0-ad94-325b9b287865 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:16.173295 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 479/963] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:36:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:36:16.179610 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0017414-31cc-4546-bcb2-2cdf8a814c5c None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:16.179840 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0017414-31cc-4546-bcb2-2cdf8a814c5c None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:16.180159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0017414-31cc-4546-bcb2-2cdf8a814c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:16.200788 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-e0017414-31cc-4546-bcb2-2cdf8a814c5c None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:36:16.202022 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-e0017414-31cc-4546-bcb2-2cdf8a814c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:36:16.262634 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:16.309900 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50454dc7-4b1e-464c-803a-f8f3d4551ba5 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:16.345417 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 480/964] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:36:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:36:16.357301 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:16.371271 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed17e7-68a0-4af8-b5ed-606c5db5a594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:16.371888 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed17e7-68a0-4af8-b5ed-606c5db5a594 None admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:16.372167 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed17e7-68a0-4af8-b5ed-606c5db5a594 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:16.372444 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed17e7-68a0-4af8-b5ed-606c5db5a594 None admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:16.373099 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed17e7-68a0-4af8-b5ed-606c5db5a594 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:16.374579 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed17e7-68a0-4af8-b5ed-606c5db5a594 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:16.377184 dv-cinder-856463-2-smb devstack@keystone.service[88207]: WARNING keystone.server.flask.common [None req-eeed17e7-68a0-4af8-b5ed-606c5db5a594 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 08 13:36:16.392626 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.sql.core [None req-eeed17e7-68a0-4af8-b5ed-606c5db5a594 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 08 13:36:16.392626 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 08 13:36:16.392626 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [parameters: {'user_id': '3765a125d13647d4b5103b721c2a90a5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 08 13:36:16.392626 dv-cinder-856463-2-smb devstack@keystone.service[88207]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88207) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 08 13:36:16.411548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-eeed17e7-68a0-4af8-b5ed-606c5db5a594 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 08 13:36:16.411548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:16.411548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 13:36:16.411548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 08 13:36:16.411548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 13:36:16.411548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 08 13:36:16.411548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 13:36:16.411548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application result = self._query(query) Sep 08 13:36:16.411548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 13:36:16.411548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application conn.query(q) Sep 08 13:36:16.411548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 13:36:16.411548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 13:36:16.411548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 13:36:16.411548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application result.read() Sep 08 13:36:16.411548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 13:36:16.412571 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 08 13:36:16.412571 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 13:36:16.412571 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 08 13:36:16.412571 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 13:36:16.412571 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 08 13:36:16.412571 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 13:36:16.412571 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 08 13:36:16.412571 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 08 13:36:16.412571 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:16.412571 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 08 13:36:16.412571 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:16.412571 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:16.412571 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 08 13:36:16.412571 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 08 13:36:16.412571 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 08 13:36:16.412571 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 08 13:36:16.412571 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 08 13:36:16.412571 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application next(self.gen) Sep 08 13:36:16.413813 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 08 13:36:16.413813 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application yield resource Sep 08 13:36:16.413813 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 08 13:36:16.413813 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application next(self.gen) Sep 08 13:36:16.413813 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 08 13:36:16.413813 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application self.session.rollback() Sep 08 13:36:16.413813 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 13:36:16.413813 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application self.force_reraise() Sep 08 13:36:16.413813 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 13:36:16.413813 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise self.value Sep 08 13:36:16.413813 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 08 13:36:16.413813 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 08 13:36:16.413813 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 08 13:36:16.413813 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application session.commit() Sep 08 13:36:16.413813 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 08 13:36:16.413813 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 08 13:36:16.413813 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 08 13:36:16.414736 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application self._prepare_impl() Sep 08 13:36:16.414736 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 08 13:36:16.414736 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application self.session.flush() Sep 08 13:36:16.414736 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 08 13:36:16.414736 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application self._flush(objects) Sep 08 13:36:16.414736 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 08 13:36:16.414736 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 08 13:36:16.414736 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 08 13:36:16.414736 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application compat.raise_( Sep 08 13:36:16.414736 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 13:36:16.414736 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception Sep 08 13:36:16.414736 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 08 13:36:16.414736 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application flush_context.execute() Sep 08 13:36:16.414736 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 08 13:36:16.414736 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rec.execute(self) Sep 08 13:36:16.414736 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 08 13:36:16.414736 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 08 13:36:16.415695 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 08 13:36:16.415695 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 08 13:36:16.415695 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 08 13:36:16.415695 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 08 13:36:16.415695 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 08 13:36:16.415695 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 08 13:36:16.415695 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 08 13:36:16.415695 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 08 13:36:16.415695 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 08 13:36:16.415695 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 08 13:36:16.415695 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 08 13:36:16.415695 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 08 13:36:16.415695 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 08 13:36:16.415695 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 08 13:36:16.415695 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 13:36:16.415695 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception Sep 08 13:36:16.416827 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 13:36:16.416827 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 08 13:36:16.416827 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 13:36:16.416827 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 08 13:36:16.416827 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 13:36:16.416827 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application result = self._query(query) Sep 08 13:36:16.416827 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 13:36:16.416827 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application conn.query(q) Sep 08 13:36:16.416827 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 13:36:16.416827 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 13:36:16.416827 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 13:36:16.416827 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application result.read() Sep 08 13:36:16.416827 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 13:36:16.416827 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 08 13:36:16.416827 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 13:36:16.416827 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 08 13:36:16.419079 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 13:36:16.419079 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 08 13:36:16.419079 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 13:36:16.419079 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 08 13:36:16.419079 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 08 13:36:16.419079 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 08 13:36:16.419079 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [parameters: {'user_id': '3765a125d13647d4b5103b721c2a90a5', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 08 13:36:16.419079 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 08 13:36:16.419079 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:16.419079 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:36:16.419079 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:16.419079 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:16.419079 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:16.419079 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:16.419079 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:16.421044 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:16.421044 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:16.421044 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:16.421044 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:16.421044 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:16.421044 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:16.421044 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:16.421044 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 08 13:36:16.421044 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 08 13:36:16.421044 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:16.421044 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:16.421044 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:36:16.421044 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:36:16.421044 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:36:16.421044 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:36:16.421044 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 08 13:36:16.421044 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 08 13:36:16.423346 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 08 13:36:16.423346 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 08 13:36:16.423346 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 08 13:36:16.423346 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 08 13:36:16.423346 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 08 13:36:16.423346 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:16.423346 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 485/965] 10.222.0.69 () {60 vars in 1131 bytes} [Thu Sep 8 13:36:16 2022] POST /identity/v3/users => generated 160 bytes in 344 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:36:16.431806 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0017414-31cc-4546-bcb2-2cdf8a814c5c None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:16.549678 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0017414-31cc-4546-bcb2-2cdf8a814c5c None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:16.590321 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ec145-23ec-493f-bd3d-31e6404d6585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:16.591415 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ec145-23ec-493f-bd3d-31e6404d6585 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:16.592032 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ec145-23ec-493f-bd3d-31e6404d6585 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:16.592531 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ec145-23ec-493f-bd3d-31e6404d6585 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:16.602614 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ec145-23ec-493f-bd3d-31e6404d6585 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:16.604492 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ec145-23ec-493f-bd3d-31e6404d6585 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:16.619803 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-c65ec145-23ec-493f-bd3d-31e6404d6585 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 08 13:36:16.619803 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:16.619803 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:16.619803 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:16.619803 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:16.619803 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:16.619803 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:16.619803 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:16.619803 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:16.619803 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:16.619803 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:16.619803 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:16.619803 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:36:16.619803 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:36:16.619803 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:36:16.619803 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:36:16.620946 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:16.620946 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:16.620946 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:36:16.620946 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:36:16.620946 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:36:16.620946 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:36:16.620946 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:16.620946 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:16.620946 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:16.620946 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:16.620946 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:16.620946 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:16.620946 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:16.620946 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:16.620946 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:16.620946 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:16.620946 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:16.620946 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:16.622009 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:16.622009 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:16.622009 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:36:16.622009 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:36:16.622009 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:36:16.622009 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:36:16.622009 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:36:16.622009 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:36:16.622009 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 08 13:36:16.622009 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:36:16.629584 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 481/966] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:36:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:36:16.631727 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed17e7-68a0-4af8-b5ed-606c5db5a594 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:16.665545 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ec145-23ec-493f-bd3d-31e6404d6585 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:16.710876 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:16.774833 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed17e7-68a0-4af8-b5ed-606c5db5a594 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:16.805190 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ec145-23ec-493f-bd3d-31e6404d6585 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:16.826423 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55b1d1-398b-4a77-ba7a-93b589279f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:16.827780 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55b1d1-398b-4a77-ba7a-93b589279f11 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:16.828228 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55b1d1-398b-4a77-ba7a-93b589279f11 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:16.828656 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55b1d1-398b-4a77-ba7a-93b589279f11 None admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:16.829560 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55b1d1-398b-4a77-ba7a-93b589279f11 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:16.830035 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55b1d1-398b-4a77-ba7a-93b589279f11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:16.832567 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55b1d1-398b-4a77-ba7a-93b589279f11 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:16.861812 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f0d0d-c098-4819-b41f-1ac56d1e072c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:16.865579 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f0d0d-c098-4819-b41f-1ac56d1e072c None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:16.866358 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f0d0d-c098-4819-b41f-1ac56d1e072c None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:16.867094 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f0d0d-c098-4819-b41f-1ac56d1e072c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:16.885407 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 486/967] 10.222.0.69 () {56 vars in 1101 bytes} [Thu Sep 8 13:36:16 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:16.894915 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01f0d0d-c098-4819-b41f-1ac56d1e072c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:36:16.900889 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-d01f0d0d-c098-4819-b41f-1ac56d1e072c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 13:36:16.900889 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:16.900889 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:16.900889 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:16.900889 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:16.900889 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:16.900889 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:16.900889 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:16.900889 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:16.900889 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:16.900889 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:16.900889 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:16.900889 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:36:16.900889 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:36:16.900889 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:36:16.900889 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:36:16.903545 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:36:16.903545 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:36:16.903545 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:36:16.903545 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:36:16.903545 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:16.903545 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:16.903545 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:16.903545 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:16.903545 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:16.903545 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:16.903545 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:16.903545 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:16.903545 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:16.903545 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:16.903545 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:16.903545 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:16.905266 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:16.905266 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:16.905266 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:16.905266 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:16.905266 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:36:16.905266 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:36:16.905266 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:36:16.905266 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:36:16.905266 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:36:16.905266 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:36:16.905266 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 13:36:16.905266 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:36:16.905266 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 482/968] 10.222.0.69 () {56 vars in 1120 bytes} [Thu Sep 8 13:36:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:36:16.919538 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55b1d1-398b-4a77-ba7a-93b589279f11 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:17.016105 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:17.147769 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55b1d1-398b-4a77-ba7a-93b589279f11 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:17.224556 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c0123-796a-4651-bc59-b3ee3117a28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:17.226125 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c0123-796a-4651-bc59-b3ee3117a28b None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:17.226883 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c0123-796a-4651-bc59-b3ee3117a28b None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:17.227647 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c0123-796a-4651-bc59-b3ee3117a28b None admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:17.229598 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c0123-796a-4651-bc59-b3ee3117a28b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:17.230448 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c0123-796a-4651-bc59-b3ee3117a28b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:17.233462 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c0123-796a-4651-bc59-b3ee3117a28b None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:17.256919 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 487/969] 10.222.0.69 () {56 vars in 1115 bytes} [Thu Sep 8 13:36:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:17.263136 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f0d0d-c098-4819-b41f-1ac56d1e072c None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:17.386581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:17.401318 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f0d0d-c098-4819-b41f-1ac56d1e072c None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:17.425138 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d92e84-991e-42c3-bb4d-0047ac2c07bb None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:17.425443 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d92e84-991e-42c3-bb4d-0047ac2c07bb None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:17.425797 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d92e84-991e-42c3-bb4d-0047ac2c07bb None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:17.427135 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 488/970] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:36:17.432661 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9367e0d-1ade-4d87-9d32-b9c6b228d752 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:17.432924 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9367e0d-1ade-4d87-9d32-b9c6b228d752 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:17.433205 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9367e0d-1ade-4d87-9d32-b9c6b228d752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:17.441019 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb3b16-387a-47d5-b44a-ca76c1a60b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:17.442467 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb3b16-387a-47d5-b44a-ca76c1a60b06 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:17.442745 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb3b16-387a-47d5-b44a-ca76c1a60b06 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:17.443202 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb3b16-387a-47d5-b44a-ca76c1a60b06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:17.456333 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb3b16-387a-47d5-b44a-ca76c1a60b06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:17.458635 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb3b16-387a-47d5-b44a-ca76c1a60b06 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:17.459019 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-f9367e0d-1ade-4d87-9d32-b9c6b228d752 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:36:17.460807 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-f9367e0d-1ade-4d87-9d32-b9c6b228d752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:36:17.475369 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-97eb3b16-387a-47d5-b44a-ca76c1a60b06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:36:17.475369 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:17.475369 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:17.475369 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:17.475369 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:17.475369 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:17.475369 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:17.475369 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:17.475369 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:17.475369 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:17.475369 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:17.475369 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:17.475369 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:36:17.475369 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:36:17.475369 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:36:17.475369 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:36:17.485107 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:17.485107 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:17.485107 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:17.485107 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:17.485107 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:17.485107 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:17.485107 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:17.485107 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:17.485107 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:17.485107 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:17.485107 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:17.485107 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:17.485107 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:17.485107 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:17.485107 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:17.485107 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:17.485107 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:36:17.487418 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:36:17.487418 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:36:17.487418 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:36:17.487418 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 483/971] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:36:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:36:17.491141 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb3b16-387a-47d5-b44a-ca76c1a60b06 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:17.554766 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 489/972] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:36:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:36:17.616589 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb3b16-387a-47d5-b44a-ca76c1a60b06 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:17.654910 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e423e75-9071-496a-af95-1c4ca56a9183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:17.655520 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e423e75-9071-496a-af95-1c4ca56a9183 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:17.655797 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e423e75-9071-496a-af95-1c4ca56a9183 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:17.656057 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e423e75-9071-496a-af95-1c4ca56a9183 None admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:17.656697 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e423e75-9071-496a-af95-1c4ca56a9183 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:17.656994 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e423e75-9071-496a-af95-1c4ca56a9183 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:17.658410 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e423e75-9071-496a-af95-1c4ca56a9183 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:17.672991 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 484/973] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:17.679098 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9367e0d-1ade-4d87-9d32-b9c6b228d752 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:17.719768 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:17.791694 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9367e0d-1ade-4d87-9d32-b9c6b228d752 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:17.828397 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf8f70-223b-4d52-aef6-b183a4d29ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:17.828939 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf8f70-223b-4d52-aef6-b183a4d29ead None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:17.829217 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf8f70-223b-4d52-aef6-b183a4d29ead None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:17.829520 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf8f70-223b-4d52-aef6-b183a4d29ead None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:17.833540 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e423e75-9071-496a-af95-1c4ca56a9183 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:17.836391 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:17.839325 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf8f70-223b-4d52-aef6-b183a4d29ead None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:17.840905 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf8f70-223b-4d52-aef6-b183a4d29ead None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:17.855445 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-0edf8f70-223b-4d52-aef6-b183a4d29ead None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 13:36:17.855445 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:17.855445 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:17.855445 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:17.855445 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:17.855445 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:17.855445 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:17.855445 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:17.855445 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:17.855445 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:17.855445 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:17.855445 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:17.855445 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:36:17.855445 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:36:17.855445 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:36:17.855445 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:36:17.856608 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:17.856608 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:17.856608 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:36:17.856608 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:36:17.856608 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:36:17.856608 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:36:17.856608 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:17.856608 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:17.856608 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:17.856608 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:17.856608 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:17.856608 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:17.856608 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:17.856608 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:17.856608 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:17.856608 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:17.856608 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:17.856608 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:17.857654 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:17.857654 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:17.857654 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:36:17.857654 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:36:17.857654 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:36:17.857654 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:36:17.857654 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:36:17.857654 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:36:17.857654 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 08 13:36:17.857654 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:17.857654 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 490/974] 10.222.0.69 () {56 vars in 1117 bytes} [Thu Sep 8 13:36:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:36:17.862873 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf8f70-223b-4d52-aef6-b183a4d29ead None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:17.961303 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e423e75-9071-496a-af95-1c4ca56a9183 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:17.986291 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:17.994722 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf8f70-223b-4d52-aef6-b183a4d29ead None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:18.005265 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5188e2-48d7-4b8f-85b7-1809e11a8522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:18.005916 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5188e2-48d7-4b8f-85b7-1809e11a8522 None admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:18.006192 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5188e2-48d7-4b8f-85b7-1809e11a8522 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:18.006462 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5188e2-48d7-4b8f-85b7-1809e11a8522 None admin] PATH_INFO: `/v3/services` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:18.007116 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5188e2-48d7-4b8f-85b7-1809e11a8522 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:18.008472 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5188e2-48d7-4b8f-85b7-1809e11a8522 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:18.024908 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 485/975] 10.222.0.69 () {60 vars in 1141 bytes} [Thu Sep 8 13:36:17 2022] POST /identity/v3/services => generated 242 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:36:18.049506 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d0f1a-8ddc-412f-b8ed-a93c77ec776d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:18.050134 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d0f1a-8ddc-412f-b8ed-a93c77ec776d None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:18.050414 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d0f1a-8ddc-412f-b8ed-a93c77ec776d None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:18.050715 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d0f1a-8ddc-412f-b8ed-a93c77ec776d None admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:18.051469 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1d0f1a-8ddc-412f-b8ed-a93c77ec776d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:18.051857 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1d0f1a-8ddc-412f-b8ed-a93c77ec776d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:18.053466 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1d0f1a-8ddc-412f-b8ed-a93c77ec776d None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:18.075387 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 491/976] 10.222.0.69 () {56 vars in 1149 bytes} [Thu Sep 8 13:36:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:18.081174 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5188e2-48d7-4b8f-85b7-1809e11a8522 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:18.152049 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:18.199447 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5188e2-48d7-4b8f-85b7-1809e11a8522 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:18.241661 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f4c77-6418-4314-a179-dd82eec1acf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:18.242289 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f4c77-6418-4314-a179-dd82eec1acf0 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:18.242620 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f4c77-6418-4314-a179-dd82eec1acf0 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:18.242891 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f4c77-6418-4314-a179-dd82eec1acf0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:18.324321 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f4c77-6418-4314-a179-dd82eec1acf0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:18.325801 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f4c77-6418-4314-a179-dd82eec1acf0 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:18.397694 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:18.443066 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 486/977] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:36:18 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 13:36:18.448833 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d0f1a-8ddc-412f-b8ed-a93c77ec776d None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:18.462647 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25beecf-2941-4dc1-ad96-9d59f64d5286 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:18.462960 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25beecf-2941-4dc1-ad96-9d59f64d5286 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:18.463212 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25beecf-2941-4dc1-ad96-9d59f64d5286 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:18.464750 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 487/978] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:36:18.470268 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3bd36-9393-4c38-ae91-dd1ec1dde7bf None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:18.470552 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3bd36-9393-4c38-ae91-dd1ec1dde7bf None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:18.470833 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3bd36-9393-4c38-ae91-dd1ec1dde7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:18.492761 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-48c3bd36-9393-4c38-ae91-dd1ec1dde7bf None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:36:18.493997 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-48c3bd36-9393-4c38-ae91-dd1ec1dde7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:36:18.574730 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d0f1a-8ddc-412f-b8ed-a93c77ec776d None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:18.577978 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 488/979] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:36:18 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:36:18.627225 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a722ec4-1d18-4091-bd27-cb2201aea8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:18.627859 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a722ec4-1d18-4091-bd27-cb2201aea8d4 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:18.628138 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a722ec4-1d18-4091-bd27-cb2201aea8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:18.628411 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a722ec4-1d18-4091-bd27-cb2201aea8d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:18.641074 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a722ec4-1d18-4091-bd27-cb2201aea8d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:18.642592 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a722ec4-1d18-4091-bd27-cb2201aea8d4 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:18.659192 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-7a722ec4-1d18-4091-bd27-cb2201aea8d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:36:18.659192 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:18.659192 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:18.659192 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:18.659192 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:18.659192 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:18.659192 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:18.659192 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:18.659192 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:18.659192 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:18.659192 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:18.659192 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:18.659192 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:36:18.659192 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:36:18.659192 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:36:18.659192 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:36:18.660209 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:18.660209 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:18.660209 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:18.660209 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:18.660209 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:18.660209 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:18.660209 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:18.660209 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:18.660209 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:18.660209 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:18.660209 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:18.660209 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:18.660209 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:18.660209 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:18.660209 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:18.660209 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:18.660209 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:36:18.661218 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:36:18.661218 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:36:18.661218 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:18.661218 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 492/980] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:36:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:36:18.665943 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3bd36-9393-4c38-ae91-dd1ec1dde7bf None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:18.784335 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:18.797916 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3bd36-9393-4c38-ae91-dd1ec1dde7bf None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:18.840993 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316572c-0258-42a0-8b70-547dcf41d8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:18.841637 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316572c-0258-42a0-8b70-547dcf41d8a1 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:18.841913 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316572c-0258-42a0-8b70-547dcf41d8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:18.842180 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316572c-0258-42a0-8b70-547dcf41d8a1 None admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:18.842832 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316572c-0258-42a0-8b70-547dcf41d8a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:18.843136 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316572c-0258-42a0-8b70-547dcf41d8a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:18.844576 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316572c-0258-42a0-8b70-547dcf41d8a1 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:18.846491 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a722ec4-1d18-4091-bd27-cb2201aea8d4 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:18.851283 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:18.859308 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 489/981] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:36:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:18.865639 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316572c-0258-42a0-8b70-547dcf41d8a1 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:18.977307 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a722ec4-1d18-4091-bd27-cb2201aea8d4 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:19.007056 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316572c-0258-42a0-8b70-547dcf41d8a1 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:19.021988 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e93378-0356-4c51-8cb5-7e5cf932b9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:19.022629 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e93378-0356-4c51-8cb5-7e5cf932b9df None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:19.022917 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e93378-0356-4c51-8cb5-7e5cf932b9df None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:19.023187 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e93378-0356-4c51-8cb5-7e5cf932b9df None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:19.023782 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e93378-0356-4c51-8cb5-7e5cf932b9df None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:19.025171 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e93378-0356-4c51-8cb5-7e5cf932b9df None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:19.034555 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-75e93378-0356-4c51-8cb5-7e5cf932b9df None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 13:36:19.034555 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:19.034555 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:36:19.034555 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:36:19.034555 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:36:19.034555 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:36:19.034555 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:36:19.034555 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:36:19.034555 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 13:36:19.034555 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:19.034555 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:36:19.034555 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:19.034555 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:19.034555 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:19.034555 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:19.034555 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:19.034555 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:19.036196 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:19.036196 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:19.036196 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:19.036196 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:19.036196 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:19.036196 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:19.036196 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:36:19.036196 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:36:19.036196 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:36:19.036196 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:36:19.036196 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:19.036196 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:19.036196 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:19.036196 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:19.036196 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:19.036196 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:19.038274 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:19.038274 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:19.038274 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:19.038274 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:19.038274 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:19.038274 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:19.038274 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:19.038274 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:19.038274 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:19.038274 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:19.038274 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:36:19.038274 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:36:19.038274 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 13:36:19.038274 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:19.038274 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 493/982] 10.222.0.69 () {56 vars in 1126 bytes} [Thu Sep 8 13:36:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:36:19.042988 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e93378-0356-4c51-8cb5-7e5cf932b9df None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:19.063123 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193cc16e-ffca-4d09-b1a7-6ab3dd82c5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:19.063762 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193cc16e-ffca-4d09-b1a7-6ab3dd82c5e9 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:19.064039 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193cc16e-ffca-4d09-b1a7-6ab3dd82c5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:19.064309 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193cc16e-ffca-4d09-b1a7-6ab3dd82c5e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:19.073471 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193cc16e-ffca-4d09-b1a7-6ab3dd82c5e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:19.075313 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193cc16e-ffca-4d09-b1a7-6ab3dd82c5e9 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:19.089702 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-193cc16e-ffca-4d09-b1a7-6ab3dd82c5e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:36:19.089702 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:19.089702 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:19.089702 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:19.089702 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:19.089702 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:19.089702 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:19.089702 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:19.089702 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:19.089702 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:19.089702 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:19.089702 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:19.089702 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:36:19.089702 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:36:19.089702 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:36:19.090783 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:36:19.090783 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:19.090783 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:19.090783 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:19.090783 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:19.090783 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:19.090783 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:19.090783 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:19.090783 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:19.090783 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:19.090783 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:19.090783 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:19.090783 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:19.090783 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:19.090783 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:19.090783 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:19.090783 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:19.091741 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:36:19.091741 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:36:19.091741 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:36:19.091741 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:36:19.091741 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:36:19.091741 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:36:19.091741 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:36:19.091741 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:36:19.091741 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 490/983] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:36:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:36:19.096496 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193cc16e-ffca-4d09-b1a7-6ab3dd82c5e9 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:19.116748 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:19.149067 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:19.194340 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e93378-0356-4c51-8cb5-7e5cf932b9df None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:19.232872 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193cc16e-ffca-4d09-b1a7-6ab3dd82c5e9 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:19.244370 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa73cf-c63b-412f-ab8e-836aecf663ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:19.244997 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa73cf-c63b-412f-ab8e-836aecf663ef None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:19.245273 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa73cf-c63b-412f-ab8e-836aecf663ef None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:19.245584 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa73cf-c63b-412f-ab8e-836aecf663ef None admin] PATH_INFO: `/v3/services` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:19.246235 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa73cf-c63b-412f-ab8e-836aecf663ef None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:19.246539 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa73cf-c63b-412f-ab8e-836aecf663ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:19.247959 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa73cf-c63b-412f-ab8e-836aecf663ef None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:19.261429 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 494/984] 10.222.0.69 () {56 vars in 1122 bytes} [Thu Sep 8 13:36:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:36:19.268262 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa73cf-c63b-412f-ab8e-836aecf663ef None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:19.298113 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca174ab7-ca05-48b8-a9a3-f18cb2ed6adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:19.299489 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca174ab7-ca05-48b8-a9a3-f18cb2ed6adb None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:19.299795 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca174ab7-ca05-48b8-a9a3-f18cb2ed6adb None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:19.300325 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca174ab7-ca05-48b8-a9a3-f18cb2ed6adb None admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:19.301651 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca174ab7-ca05-48b8-a9a3-f18cb2ed6adb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:19.302091 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca174ab7-ca05-48b8-a9a3-f18cb2ed6adb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:19.303672 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca174ab7-ca05-48b8-a9a3-f18cb2ed6adb None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:19.324896 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 491/985] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 8 13:36:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:36:19.327195 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca174ab7-ca05-48b8-a9a3-f18cb2ed6adb None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:19.396646 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa73cf-c63b-412f-ab8e-836aecf663ef None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:19.429605 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:19.440247 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:19.448670 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ade69-2337-4d8a-a4a9-3e6e2e045b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:19.449487 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ade69-2337-4d8a-a4a9-3e6e2e045b11 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:19.449776 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ade69-2337-4d8a-a4a9-3e6e2e045b11 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:19.450050 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ade69-2337-4d8a-a4a9-3e6e2e045b11 None admin] PATH_INFO: `/v3/services` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:19.450672 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170ade69-2337-4d8a-a4a9-3e6e2e045b11 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:19.450970 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170ade69-2337-4d8a-a4a9-3e6e2e045b11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:19.452359 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170ade69-2337-4d8a-a4a9-3e6e2e045b11 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:19.458233 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 495/986] 10.222.0.69 () {56 vars in 1122 bytes} [Thu Sep 8 13:36:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:36:19.464849 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ade69-2337-4d8a-a4a9-3e6e2e045b11 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:19.480624 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca174ab7-ca05-48b8-a9a3-f18cb2ed6adb None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:19.522956 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a39e1-c1d0-4b72-a2f4-7cfc6540acee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:19.523469 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a39e1-c1d0-4b72-a2f4-7cfc6540acee None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:19.523749 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a39e1-c1d0-4b72-a2f4-7cfc6540acee None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:19.524018 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a39e1-c1d0-4b72-a2f4-7cfc6540acee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:19.524750 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a39e1-c1d0-4b72-a2f4-7cfc6540acee None admin] RBAC: Adding query filter params (role.id=2cc89a32b68046feacb991d263b7cb75, scope.project.id=88de9f1470c6415b97866ad5a3256ef2, user.id=6d2dd101d1a14e5ab95f272ab1bbeb94) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:19.525064 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a39e1-c1d0-4b72-a2f4-7cfc6540acee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:19.529425 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a39e1-c1d0-4b72-a2f4-7cfc6540acee None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:19.532786 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 492/987] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 8 13:36:19 2022] GET /identity/v3/role_assignments?user.id=6d2dd101d1a14e5ab95f272ab1bbeb94&scope.project.id=88de9f1470c6415b97866ad5a3256ef2&role.id=2cc89a32b68046feacb991d263b7cb75 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:19.612234 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ade69-2337-4d8a-a4a9-3e6e2e045b11 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:19.654219 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9306397-d0d7-413c-88f7-a5e8a53e6e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:19.654916 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9306397-d0d7-413c-88f7-a5e8a53e6e63 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:19.655201 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9306397-d0d7-413c-88f7-a5e8a53e6e63 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:19.655472 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9306397-d0d7-413c-88f7-a5e8a53e6e63 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:19.656199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9306397-d0d7-413c-88f7-a5e8a53e6e63 None admin] RBAC: Adding query filter params (interface=admin, service_id=65e3f7e7483a4f88914cf98de921f2e3, region_id=RegionOne) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:19.656513 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9306397-d0d7-413c-88f7-a5e8a53e6e63 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:19.657956 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9306397-d0d7-413c-88f7-a5e8a53e6e63 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:19.669295 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 496/988] 10.222.0.69 () {56 vars in 1249 bytes} [Thu Sep 8 13:36:19 2022] GET /identity/v3/endpoints?service_id=65e3f7e7483a4f88914cf98de921f2e3&interface=admin®ion_id=RegionOne => generated 193 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:36:19.670997 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a39e1-c1d0-4b72-a2f4-7cfc6540acee None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:19.791799 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a39e1-c1d0-4b72-a2f4-7cfc6540acee None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:19.830220 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d303df7-7f11-46a9-a71e-26a80b74f4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:19.831168 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d303df7-7f11-46a9-a71e-26a80b74f4b4 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:19.831630 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d303df7-7f11-46a9-a71e-26a80b74f4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:19.832128 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d303df7-7f11-46a9-a71e-26a80b74f4b4 None admin] PATH_INFO: `/v3/services` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:19.832843 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d303df7-7f11-46a9-a71e-26a80b74f4b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:19.834251 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d303df7-7f11-46a9-a71e-26a80b74f4b4 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:19.836355 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:19.842402 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 493/989] 10.222.0.69 () {56 vars in 1087 bytes} [Thu Sep 8 13:36:19 2022] GET /identity/v3/services => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:36:20.416873 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13223ed-50df-45cd-91f7-72790e5538a8 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:20.417683 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13223ed-50df-45cd-91f7-72790e5538a8 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:20.417683 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13223ed-50df-45cd-91f7-72790e5538a8 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:20.418974 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 497/990] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:36:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:36:20.424758 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435dd30f-8b3e-41a2-beda-f945c0562892 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:20.425038 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435dd30f-8b3e-41a2-beda-f945c0562892 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:20.425308 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435dd30f-8b3e-41a2-beda-f945c0562892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:20.447055 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-435dd30f-8b3e-41a2-beda-f945c0562892 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:36:20.448257 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-435dd30f-8b3e-41a2-beda-f945c0562892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:36:20.530763 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 494/991] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:36:20 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:36:20.808493 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13223ed-50df-45cd-91f7-72790e5538a8 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:20.889788 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:20.966662 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13223ed-50df-45cd-91f7-72790e5538a8 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:21.025921 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7b38d-3c63-4ad9-b9cf-5fba7ad93208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:21.026942 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7b38d-3c63-4ad9-b9cf-5fba7ad93208 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:21.027438 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7b38d-3c63-4ad9-b9cf-5fba7ad93208 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:21.027965 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7b38d-3c63-4ad9-b9cf-5fba7ad93208 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:21.028857 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7b38d-3c63-4ad9-b9cf-5fba7ad93208 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:21.031362 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7b38d-3c63-4ad9-b9cf-5fba7ad93208 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:21.049531 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-77f7b38d-3c63-4ad9-b9cf-5fba7ad93208 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 13:36:21.049531 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:21.049531 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:36:21.049531 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:36:21.049531 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:36:21.049531 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:36:21.049531 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:36:21.049531 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:36:21.049531 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 13:36:21.049531 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:21.049531 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:36:21.049531 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:21.049531 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:21.049531 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:21.049531 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:21.049531 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:21.049531 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:21.051617 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:21.051617 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:21.051617 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:21.051617 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:21.051617 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:21.051617 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:21.051617 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:36:21.051617 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:36:21.051617 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:36:21.051617 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:36:21.051617 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:21.051617 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:21.051617 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:21.051617 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:21.051617 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:21.051617 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:21.052473 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:21.052473 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:21.052473 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:21.052473 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:21.052473 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:21.052473 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:21.052473 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:21.052473 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:21.052473 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:21.052473 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:21.052473 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:36:21.052473 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:36:21.052473 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 13:36:21.052473 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:21.054081 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 498/992] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:36:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:36:21.061337 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435dd30f-8b3e-41a2-beda-f945c0562892 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:21.209407 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435dd30f-8b3e-41a2-beda-f945c0562892 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:21.249844 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:21.262867 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8962f-3345-402a-89f2-b499c096ed6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:21.263886 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8962f-3345-402a-89f2-b499c096ed6f None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:21.264356 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8962f-3345-402a-89f2-b499c096ed6f None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:21.264817 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8962f-3345-402a-89f2-b499c096ed6f None admin] PATH_INFO: `/v3/services` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:21.265966 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8962f-3345-402a-89f2-b499c096ed6f None admin] RBAC: Adding query filter params (name=compute) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:21.266484 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8962f-3345-402a-89f2-b499c096ed6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:21.268954 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8962f-3345-402a-89f2-b499c096ed6f None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:21.278794 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 495/993] 10.222.0.69 () {56 vars in 1112 bytes} [Thu Sep 8 13:36:21 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:21.284507 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7b38d-3c63-4ad9-b9cf-5fba7ad93208 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:21.406510 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7b38d-3c63-4ad9-b9cf-5fba7ad93208 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:21.432669 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:21.448555 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f8fc5-cbb0-4d61-bf1f-323bb468543d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:21.449168 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f8fc5-cbb0-4d61-bf1f-323bb468543d None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:21.449470 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f8fc5-cbb0-4d61-bf1f-323bb468543d None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:21.449738 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f8fc5-cbb0-4d61-bf1f-323bb468543d None admin] PATH_INFO: `/v3/services` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:21.450436 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39f8fc5-cbb0-4d61-bf1f-323bb468543d None admin] RBAC: Adding query filter params (type=compute) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:21.450732 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39f8fc5-cbb0-4d61-bf1f-323bb468543d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:21.452135 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39f8fc5-cbb0-4d61-bf1f-323bb468543d None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:21.463202 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 499/994] 10.222.0.69 () {56 vars in 1112 bytes} [Thu Sep 8 13:36:21 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:21.465074 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8962f-3345-402a-89f2-b499c096ed6f None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:21.586570 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8962f-3345-402a-89f2-b499c096ed6f None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:21.633798 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f10bae-e06c-4b45-97c9-9bc57172b3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:21.634420 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f10bae-e06c-4b45-97c9-9bc57172b3a4 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:21.634700 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f10bae-e06c-4b45-97c9-9bc57172b3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:21.634976 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f10bae-e06c-4b45-97c9-9bc57172b3a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:21.635684 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f10bae-e06c-4b45-97c9-9bc57172b3a4 None admin] RBAC: Adding query filter params (interface=public, service_id=04c33792f3424c11bc2ea25f63f6f885, region_id=RegionOne) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:21.635998 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f10bae-e06c-4b45-97c9-9bc57172b3a4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:21.637381 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f10bae-e06c-4b45-97c9-9bc57172b3a4 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:21.643242 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 496/995] 10.222.0.69 () {56 vars in 1251 bytes} [Thu Sep 8 13:36:21 2022] GET /identity/v3/endpoints?service_id=04c33792f3424c11bc2ea25f63f6f885&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:21.649186 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f8fc5-cbb0-4d61-bf1f-323bb468543d None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:21.778671 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f8fc5-cbb0-4d61-bf1f-323bb468543d None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:21.823196 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1692a6f-8d0d-4187-9502-464cfd731764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:21.823811 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1692a6f-8d0d-4187-9502-464cfd731764 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:21.824088 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1692a6f-8d0d-4187-9502-464cfd731764 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:21.824360 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1692a6f-8d0d-4187-9502-464cfd731764 None admin] PATH_INFO: `/v3/services` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:21.824974 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1692a6f-8d0d-4187-9502-464cfd731764 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:21.826696 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1692a6f-8d0d-4187-9502-464cfd731764 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:21.834497 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 500/996] 10.222.0.69 () {56 vars in 1087 bytes} [Thu Sep 8 13:36:21 2022] GET /identity/v3/services => generated 1727 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:36:21.908214 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815ed47-bd1f-4567-92e2-f91c1f0913c3 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:21.908532 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815ed47-bd1f-4567-92e2-f91c1f0913c3 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:21.908769 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815ed47-bd1f-4567-92e2-f91c1f0913c3 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:21.910725 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 497/997] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:36:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:36:21.916914 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bd20c-7a18-410b-b963-c818ca220a68 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:21.916914 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bd20c-7a18-410b-b963-c818ca220a68 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:21.917208 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346bd20c-7a18-410b-b963-c818ca220a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:21.937286 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-346bd20c-7a18-410b-b963-c818ca220a68 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:36:21.938515 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-346bd20c-7a18-410b-b963-c818ca220a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:36:21.998679 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:22.029802 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 501/998] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:36:21 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:36:22.302699 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b815ed47-bd1f-4567-92e2-f91c1f0913c3 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:22.321440 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e78ced-ae9e-40fc-890a-dc2e42a01650 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:22.321758 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e78ced-ae9e-40fc-890a-dc2e42a01650 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:22.321989 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e78ced-ae9e-40fc-890a-dc2e42a01650 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:22.323728 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 502/999] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:36:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:36:22.329244 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39d9a0-f941-45de-8ca9-35eedbd3c9df None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:22.329568 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39d9a0-f941-45de-8ca9-35eedbd3c9df None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:22.329844 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e39d9a0-f941-45de-8ca9-35eedbd3c9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:22.350671 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-4e39d9a0-f941-45de-8ca9-35eedbd3c9df None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:36:22.351888 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-4e39d9a0-f941-45de-8ca9-35eedbd3c9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:36:22.401752 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:22.439705 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 503/1000] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:36:22 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:36:22.474856 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b815ed47-bd1f-4567-92e2-f91c1f0913c3 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:22.540396 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e75a98-dc33-40f0-8c64-3c185fae6517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:22.541478 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e75a98-dc33-40f0-8c64-3c185fae6517 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:22.541961 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e75a98-dc33-40f0-8c64-3c185fae6517 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:22.542432 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e75a98-dc33-40f0-8c64-3c185fae6517 None admin] PATH_INFO: `/v3/services/image` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:22.543467 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e75a98-dc33-40f0-8c64-3c185fae6517 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:22.546038 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e75a98-dc33-40f0-8c64-3c185fae6517 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:22.561833 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-07e75a98-dc33-40f0-8c64-3c185fae6517 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 13:36:22.561833 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:22.561833 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:36:22.561833 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:36:22.561833 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:36:22.561833 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:36:22.561833 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:36:22.561833 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:36:22.561833 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 13:36:22.561833 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:36:22.561833 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:36:22.561833 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:36:22.561833 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:22.561833 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:22.561833 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:22.561833 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:22.561833 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:22.562921 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:22.562921 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:22.562921 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:22.562921 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:22.562921 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:22.562921 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:22.562921 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:36:22.562921 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:36:22.562921 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:36:22.562921 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:36:22.562921 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:22.562921 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:22.562921 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:22.562921 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:22.562921 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:22.562921 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:22.563840 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:22.563840 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:22.563840 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:22.563840 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:22.563840 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:22.563840 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:22.563840 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:22.563840 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:22.563840 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:22.563840 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:22.563840 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:36:22.563840 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:36:22.563840 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 13:36:22.563840 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:36:22.569567 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 498/1001] 10.222.0.69 () {56 vars in 1105 bytes} [Thu Sep 8 13:36:22 2022] GET /identity/v3/services/image => generated 86 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:36:22.572132 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39d9a0-f941-45de-8ca9-35eedbd3c9df None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:22.735954 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e75a98-dc33-40f0-8c64-3c185fae6517 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:22.747400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e39d9a0-f941-45de-8ca9-35eedbd3c9df None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:22.760406 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:22.790320 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8e49f-a286-49a3-86b4-98ece5415f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:22.791244 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8e49f-a286-49a3-86b4-98ece5415f68 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:22.791783 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8e49f-a286-49a3-86b4-98ece5415f68 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:22.792264 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8e49f-a286-49a3-86b4-98ece5415f68 None admin] PATH_INFO: `/v3/services` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:22.793100 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c8e49f-a286-49a3-86b4-98ece5415f68 None admin] RBAC: Adding query filter params (name=image) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:22.793428 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c8e49f-a286-49a3-86b4-98ece5415f68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:22.795338 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c8e49f-a286-49a3-86b4-98ece5415f68 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:22.805480 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 504/1002] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:36:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:22.807801 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8e49f-a286-49a3-86b4-98ece5415f68 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:22.917772 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e75a98-dc33-40f0-8c64-3c185fae6517 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:22.957848 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:22.958479 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8e49f-a286-49a3-86b4-98ece5415f68 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:22.974364 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7202712-6c97-4a69-b264-839b956ad015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:22.975476 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7202712-6c97-4a69-b264-839b956ad015 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:22.975762 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7202712-6c97-4a69-b264-839b956ad015 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:22.976055 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7202712-6c97-4a69-b264-839b956ad015 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:22.976622 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7202712-6c97-4a69-b264-839b956ad015 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:22.978545 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7202712-6c97-4a69-b264-839b956ad015 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:22.990263 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-e7202712-6c97-4a69-b264-839b956ad015 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 13:36:22.990263 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:22.990263 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:36:22.990263 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:36:22.990263 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:36:22.990263 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:36:22.990263 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:36:22.990263 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:36:22.990263 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 13:36:22.990263 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:36:22.990263 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:36:22.990263 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:36:22.990263 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:22.990263 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:22.990263 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:22.990263 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:22.990263 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:22.992079 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:22.992079 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:22.992079 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:22.992079 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:22.992079 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:22.992079 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:22.992079 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:36:22.992079 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:36:22.992079 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:36:22.992079 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:36:22.992079 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:22.992079 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:22.992079 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:22.992079 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:22.992079 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:22.992079 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:22.994046 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:22.994046 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:22.994046 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:22.994046 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:22.994046 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:22.994046 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:22.994046 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:22.994046 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:22.994046 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:22.994046 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:22.994046 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:36:22.994046 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:36:22.994046 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 08 13:36:22.994046 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:36:22.994046 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 499/1003] 10.222.0.69 () {56 vars in 1126 bytes} [Thu Sep 8 13:36:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:36:22.999155 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7202712-6c97-4a69-b264-839b956ad015 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:23.022856 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8544e0-42c1-4eda-bc77-1b260e7b0e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:23.023475 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8544e0-42c1-4eda-bc77-1b260e7b0e99 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:23.023876 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8544e0-42c1-4eda-bc77-1b260e7b0e99 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:23.024135 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8544e0-42c1-4eda-bc77-1b260e7b0e99 None admin] PATH_INFO: `/v3/services` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:23.024728 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8544e0-42c1-4eda-bc77-1b260e7b0e99 None admin] RBAC: Adding query filter params (type=image) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:23.025031 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8544e0-42c1-4eda-bc77-1b260e7b0e99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:23.026797 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8544e0-42c1-4eda-bc77-1b260e7b0e99 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:23.032347 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 505/1004] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:36:22 2022] GET /identity/v3/services?type=image => generated 122 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:36:23.187542 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7202712-6c97-4a69-b264-839b956ad015 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:23.230858 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a24891-9768-4f8c-a437-4b25fb452dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:23.231532 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a24891-9768-4f8c-a437-4b25fb452dc8 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:23.231815 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a24891-9768-4f8c-a437-4b25fb452dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:23.232087 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a24891-9768-4f8c-a437-4b25fb452dc8 None admin] PATH_INFO: `/v3/services` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:23.232729 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a24891-9768-4f8c-a437-4b25fb452dc8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:23.233030 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a24891-9768-4f8c-a437-4b25fb452dc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:23.234435 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a24891-9768-4f8c-a437-4b25fb452dc8 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:23.241457 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 500/1005] 10.222.0.69 () {56 vars in 1122 bytes} [Thu Sep 8 13:36:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:36:23.247981 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8544e0-42c1-4eda-bc77-1b260e7b0e99 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:23.303918 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:23.377144 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8544e0-42c1-4eda-bc77-1b260e7b0e99 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:23.415650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31a829-503a-4f41-abdf-37161cd5fc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:23.416262 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31a829-503a-4f41-abdf-37161cd5fc82 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:23.416638 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31a829-503a-4f41-abdf-37161cd5fc82 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:23.416812 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31a829-503a-4f41-abdf-37161cd5fc82 None admin] PATH_INFO: `/v3/services` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:23.417466 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f31a829-503a-4f41-abdf-37161cd5fc82 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:23.417770 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f31a829-503a-4f41-abdf-37161cd5fc82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:23.419151 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f31a829-503a-4f41-abdf-37161cd5fc82 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:23.425348 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 506/1006] 10.222.0.69 () {56 vars in 1122 bytes} [Thu Sep 8 13:36:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:23.432382 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a24891-9768-4f8c-a437-4b25fb452dc8 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:23.494753 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:23.553809 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a24891-9768-4f8c-a437-4b25fb452dc8 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:23.604161 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d7d69-1088-4b4d-8749-a92b1056b0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:23.604769 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d7d69-1088-4b4d-8749-a92b1056b0d0 None admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:23.606491 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d7d69-1088-4b4d-8749-a92b1056b0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:23.606491 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d7d69-1088-4b4d-8749-a92b1056b0d0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:23.606491 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d7d69-1088-4b4d-8749-a92b1056b0d0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:23.607789 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d7d69-1088-4b4d-8749-a92b1056b0d0 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:23.629302 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 501/1007] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:36:23 2022] POST /identity/v3/endpoints => generated 325 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:36:24.368488 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb57575-802a-4223-9428-c2b5bc66ebb5 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:24.369069 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb57575-802a-4223-9428-c2b5bc66ebb5 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:24.369069 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb57575-802a-4223-9428-c2b5bc66ebb5 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:24.370622 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 507/1008] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:36:24.376341 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0e609-a17b-49b9-892a-433ba1b5f0ba None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:24.376637 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0e609-a17b-49b9-892a-433ba1b5f0ba None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:24.376901 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0e609-a17b-49b9-892a-433ba1b5f0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:24.397100 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-76e0e609-a17b-49b9-892a-433ba1b5f0ba None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:36:24.398337 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-76e0e609-a17b-49b9-892a-433ba1b5f0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:36:24.477428 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 502/1009] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:36:24 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:36:24.747006 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb57575-802a-4223-9428-c2b5bc66ebb5 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:24.852828 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb57575-802a-4223-9428-c2b5bc66ebb5 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:24.854432 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:24.891781 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dca4293-2be6-4046-8bec-73452ee1c9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:24.892407 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca4293-2be6-4046-8bec-73452ee1c9e7 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:24.892680 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca4293-2be6-4046-8bec-73452ee1c9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:24.892944 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca4293-2be6-4046-8bec-73452ee1c9e7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:24.893549 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dca4293-2be6-4046-8bec-73452ee1c9e7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:24.895772 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dca4293-2be6-4046-8bec-73452ee1c9e7 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:24.904642 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-6dca4293-2be6-4046-8bec-73452ee1c9e7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 13:36:24.904642 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:24.904642 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:36:24.904642 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:36:24.904642 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:36:24.904642 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:36:24.904642 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:36:24.904642 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:36:24.904642 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 13:36:24.904642 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:24.904642 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:36:24.904642 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:24.904642 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:24.904642 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:24.904642 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:24.904642 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:24.904642 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:24.905943 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:24.905943 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:24.905943 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:24.905943 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:24.905943 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:24.905943 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:24.905943 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:36:24.905943 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:36:24.905943 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:36:24.905943 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:36:24.905943 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:24.905943 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:24.905943 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:24.905943 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:24.905943 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:24.905943 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:24.906791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:24.906791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:24.906791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:24.906791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:24.906791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:24.906791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:24.906791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:24.906791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:24.906791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:24.906791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:24.906791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:36:24.906791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:36:24.906791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 08 13:36:24.906791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:24.909453 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 508/1010] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:36:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:36:24.912652 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0e609-a17b-49b9-892a-433ba1b5f0ba None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:24.953472 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:25.029185 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0e609-a17b-49b9-892a-433ba1b5f0ba None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:25.065307 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb04b14-0b45-4bf1-bd84-79ce6f1e3e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:25.065939 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb04b14-0b45-4bf1-bd84-79ce6f1e3e19 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:25.066763 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb04b14-0b45-4bf1-bd84-79ce6f1e3e19 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:25.067034 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb04b14-0b45-4bf1-bd84-79ce6f1e3e19 None admin] PATH_INFO: `/v3/services` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:25.067665 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb04b14-0b45-4bf1-bd84-79ce6f1e3e19 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:25.067966 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb04b14-0b45-4bf1-bd84-79ce6f1e3e19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:25.069326 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb04b14-0b45-4bf1-bd84-79ce6f1e3e19 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:25.078691 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 503/1011] 10.222.0.69 () {56 vars in 1112 bytes} [Thu Sep 8 13:36:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:36:25.079864 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dca4293-2be6-4046-8bec-73452ee1c9e7 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:25.186703 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dca4293-2be6-4046-8bec-73452ee1c9e7 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:25.225995 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d3a4b-d87d-45ee-90bd-a07cc27116af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:25.226618 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d3a4b-d87d-45ee-90bd-a07cc27116af None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:25.226896 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d3a4b-d87d-45ee-90bd-a07cc27116af None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:25.227166 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d3a4b-d87d-45ee-90bd-a07cc27116af None admin] PATH_INFO: `/v3/services` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:25.227815 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307d3a4b-d87d-45ee-90bd-a07cc27116af None admin] RBAC: Adding query filter params (type=compute) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:25.228119 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307d3a4b-d87d-45ee-90bd-a07cc27116af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:25.229571 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307d3a4b-d87d-45ee-90bd-a07cc27116af None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:25.241122 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 509/1012] 10.222.0.69 () {56 vars in 1112 bytes} [Thu Sep 8 13:36:25 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:36:25.242575 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb04b14-0b45-4bf1-bd84-79ce6f1e3e19 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:25.346576 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c449e14-4dc0-4f1b-959f-f1c9e03a5112 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:25.346576 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c449e14-4dc0-4f1b-959f-f1c9e03a5112 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:25.346871 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c449e14-4dc0-4f1b-959f-f1c9e03a5112 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:25.349897 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 510/1013] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:36:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:36:25.355542 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89afee5-e0af-4428-a0e8-dd06d5507945 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:25.355827 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89afee5-e0af-4428-a0e8-dd06d5507945 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:25.356127 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89afee5-e0af-4428-a0e8-dd06d5507945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:25.372852 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:25.376087 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb04b14-0b45-4bf1-bd84-79ce6f1e3e19 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:25.379945 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-c89afee5-e0af-4428-a0e8-dd06d5507945 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:36:25.380912 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-c89afee5-e0af-4428-a0e8-dd06d5507945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:36:25.408786 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:25.421158 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76c0a7-a14e-4353-8b69-1e3b41b4948d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:25.422038 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76c0a7-a14e-4353-8b69-1e3b41b4948d None admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:25.422497 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76c0a7-a14e-4353-8b69-1e3b41b4948d None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:25.422774 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76c0a7-a14e-4353-8b69-1e3b41b4948d None admin] PATH_INFO: `/v3/endpoints` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:25.423463 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac76c0a7-a14e-4353-8b69-1e3b41b4948d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:25.426251 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac76c0a7-a14e-4353-8b69-1e3b41b4948d None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:25.454971 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 504/1014] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:36:25 2022] POST /identity/v3/endpoints => generated 334 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:36:25.481432 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 511/1015] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:36:25 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:36:25.956278 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a67cc0-460a-42e1-b8fc-cf12068dffd5 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:25.956849 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a67cc0-460a-42e1-b8fc-cf12068dffd5 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:25.956849 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a67cc0-460a-42e1-b8fc-cf12068dffd5 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:25.958424 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 505/1016] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:36:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:36:25.963611 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf2497-c01c-47d0-90f2-c17bc80316b6 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:25.963896 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf2497-c01c-47d0-90f2-c17bc80316b6 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:25.964166 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf2497-c01c-47d0-90f2-c17bc80316b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:25.983024 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-8dcf2497-c01c-47d0-90f2-c17bc80316b6 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:36:25.984202 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-8dcf2497-c01c-47d0-90f2-c17bc80316b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:36:26.030889 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a67cc0-460a-42e1-b8fc-cf12068dffd5 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:26.070029 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 512/1017] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:36:25 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:36:26.216534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a67cc0-460a-42e1-b8fc-cf12068dffd5 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:26.268653 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a524159-365e-486b-92f0-cb8d1fa12456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:26.269846 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a524159-365e-486b-92f0-cb8d1fa12456 None admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:26.270331 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a524159-365e-486b-92f0-cb8d1fa12456 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:26.270807 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a524159-365e-486b-92f0-cb8d1fa12456 None admin] PATH_INFO: `/v3/services` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:26.271655 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a524159-365e-486b-92f0-cb8d1fa12456 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:26.273218 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a524159-365e-486b-92f0-cb8d1fa12456 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:26.293447 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 506/1018] 10.222.0.69 () {60 vars in 1141 bytes} [Thu Sep 8 13:36:26 2022] POST /identity/v3/services => generated 242 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:36:26.340206 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf2497-c01c-47d0-90f2-c17bc80316b6 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:26.450379 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:26.474780 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf2497-c01c-47d0-90f2-c17bc80316b6 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:26.539721 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa8c71-72c2-469e-b608-a1338bfa9479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:26.540352 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa8c71-72c2-469e-b608-a1338bfa9479 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:26.540722 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa8c71-72c2-469e-b608-a1338bfa9479 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:26.540893 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa8c71-72c2-469e-b608-a1338bfa9479 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:26.542018 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa8c71-72c2-469e-b608-a1338bfa9479 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:26.543453 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa8c71-72c2-469e-b608-a1338bfa9479 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:26.545356 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 513/1019] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:36:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:26.551118 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a524159-365e-486b-92f0-cb8d1fa12456 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:26.572000 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:26.664059 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a524159-365e-486b-92f0-cb8d1fa12456 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:26.701289 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c0999c-31b6-4de9-b7f0-c90a5c98656e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:26.701931 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0999c-31b6-4de9-b7f0-c90a5c98656e None admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:26.702210 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0999c-31b6-4de9-b7f0-c90a5c98656e None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:26.702481 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c0999c-31b6-4de9-b7f0-c90a5c98656e None admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:26.703154 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c0999c-31b6-4de9-b7f0-c90a5c98656e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:26.704594 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c0999c-31b6-4de9-b7f0-c90a5c98656e None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:26.745484 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 507/1020] 10.222.0.69 () {60 vars in 1141 bytes} [Thu Sep 8 13:36:26 2022] POST /identity/v3/projects => generated 311 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:36:27.826030 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6a68f-1d49-46e5-bb04-cd25c0725e34 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:27.826557 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6a68f-1d49-46e5-bb04-cd25c0725e34 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:27.826557 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6a68f-1d49-46e5-bb04-cd25c0725e34 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:27.828188 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 514/1021] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:36:27.833453 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c490e-9031-4198-8e79-6eefbd64fcfa None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:27.833873 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c490e-9031-4198-8e79-6eefbd64fcfa None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:27.834070 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c490e-9031-4198-8e79-6eefbd64fcfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:27.852789 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-3f1c490e-9031-4198-8e79-6eefbd64fcfa None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:36:27.853999 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-3f1c490e-9031-4198-8e79-6eefbd64fcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:36:27.919754 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:27.933456 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 508/1022] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:36:27 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:36:28.196228 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d6a68f-1d49-46e5-bb04-cd25c0725e34 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:28.318656 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d6a68f-1d49-46e5-bb04-cd25c0725e34 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:28.358610 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b3598d-128e-407e-9403-a85db88eace9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:28.359245 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3598d-128e-407e-9403-a85db88eace9 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:28.359529 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3598d-128e-407e-9403-a85db88eace9 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:28.359802 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3598d-128e-407e-9403-a85db88eace9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:28.371149 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b3598d-128e-407e-9403-a85db88eace9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:36:28.375950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-27b3598d-128e-407e-9403-a85db88eace9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 13:36:28.375950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:28.375950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:28.375950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:28.375950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:28.375950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:28.375950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:28.375950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:28.375950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:28.375950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:28.375950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:28.375950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:28.375950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:36:28.375950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:36:28.375950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:36:28.375950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:36:28.376995 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:36:28.376995 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:36:28.376995 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:36:28.376995 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:36:28.376995 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:28.376995 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:28.376995 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:28.376995 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:28.376995 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:28.376995 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:28.376995 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:28.376995 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:28.376995 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:28.376995 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:28.376995 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:28.376995 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:28.377955 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:28.377955 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:28.377955 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:28.377955 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:28.377955 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:36:28.377955 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:36:28.377955 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:36:28.377955 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:36:28.377955 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:36:28.377955 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:36:28.377955 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 13:36:28.377955 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:28.379471 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 515/1023] 10.222.0.69 () {56 vars in 1120 bytes} [Thu Sep 8 13:36:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:36:28.383536 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c490e-9031-4198-8e79-6eefbd64fcfa None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:28.508327 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c490e-9031-4198-8e79-6eefbd64fcfa None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:28.546663 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25dc9b7-8be2-49ee-ada4-64aad400d6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:28.547852 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25dc9b7-8be2-49ee-ada4-64aad400d6eb None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:28.547969 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25dc9b7-8be2-49ee-ada4-64aad400d6eb None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:28.548219 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25dc9b7-8be2-49ee-ada4-64aad400d6eb None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:28.549037 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25dc9b7-8be2-49ee-ada4-64aad400d6eb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:28.549408 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25dc9b7-8be2-49ee-ada4-64aad400d6eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:28.551873 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25dc9b7-8be2-49ee-ada4-64aad400d6eb None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:28.561404 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 509/1024] 10.222.0.69 () {56 vars in 1115 bytes} [Thu Sep 8 13:36:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:36:28.567644 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b3598d-128e-407e-9403-a85db88eace9 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:28.568712 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ba1d4-932a-425a-aa3e-65698bad648a None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:28.569004 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ba1d4-932a-425a-aa3e-65698bad648a None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:28.569280 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ba1d4-932a-425a-aa3e-65698bad648a None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:28.570909 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 510/1025] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:36:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:36:28.576090 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f493b-d3db-46fe-8c10-c6a9b0c2bd85 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:28.576371 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f493b-d3db-46fe-8c10-c6a9b0c2bd85 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:28.576648 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f493b-d3db-46fe-8c10-c6a9b0c2bd85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:28.582484 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:28.596437 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-670f493b-d3db-46fe-8c10-c6a9b0c2bd85 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:36:28.598197 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-670f493b-d3db-46fe-8c10-c6a9b0c2bd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:36:28.667356 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:28.685576 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 511/1026] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:36:28 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:36:28.690383 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b3598d-128e-407e-9403-a85db88eace9 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:28.728706 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c90ea-3982-4dc4-80dd-210730b3d0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:28.729327 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c90ea-3982-4dc4-80dd-210730b3d0fc None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:28.729632 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c90ea-3982-4dc4-80dd-210730b3d0fc None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:28.729917 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c90ea-3982-4dc4-80dd-210730b3d0fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:28.741485 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26c90ea-3982-4dc4-80dd-210730b3d0fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:28.742944 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26c90ea-3982-4dc4-80dd-210730b3d0fc None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:28.759007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-d26c90ea-3982-4dc4-80dd-210730b3d0fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:36:28.759007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:28.759007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:28.759007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:28.759007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:28.759007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:28.759007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:28.759007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:28.759007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:28.759007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:28.759007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:28.759007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:28.759007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:36:28.759007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:36:28.759007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:36:28.759007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:36:28.760015 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:28.760015 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:28.760015 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:28.760015 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:28.760015 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:28.760015 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:28.760015 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:28.760015 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:28.760015 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:28.760015 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:28.760015 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:28.760015 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:28.760015 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:28.760015 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:28.760015 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:28.760015 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:28.760015 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:36:28.761484 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:36:28.761484 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:36:28.761484 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:28.761484 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 516/1027] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:36:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:36:28.765803 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f493b-d3db-46fe-8c10-c6a9b0c2bd85 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:28.872823 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f493b-d3db-46fe-8c10-c6a9b0c2bd85 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:28.911231 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfece42-20aa-47c8-bc3a-cc08a7365cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:28.911837 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfece42-20aa-47c8-bc3a-cc08a7365cd7 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:28.912109 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfece42-20aa-47c8-bc3a-cc08a7365cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:28.912376 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfece42-20aa-47c8-bc3a-cc08a7365cd7 None admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:28.913013 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfece42-20aa-47c8-bc3a-cc08a7365cd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:28.913309 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfece42-20aa-47c8-bc3a-cc08a7365cd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:28.914682 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfece42-20aa-47c8-bc3a-cc08a7365cd7 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:28.927709 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 512/1028] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:36:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:28.934169 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c90ea-3982-4dc4-80dd-210730b3d0fc None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:28.959828 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfece42-20aa-47c8-bc3a-cc08a7365cd7 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:29.015345 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:29.036324 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:29.072128 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfece42-20aa-47c8-bc3a-cc08a7365cd7 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:29.076617 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c90ea-3982-4dc4-80dd-210730b3d0fc None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:29.108209 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f2a83-c126-4643-9880-99ee8615a60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:29.108867 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f2a83-c126-4643-9880-99ee8615a60d None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:29.109141 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f2a83-c126-4643-9880-99ee8615a60d None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:29.109549 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f2a83-c126-4643-9880-99ee8615a60d None admin] PATH_INFO: `/v3/services/image` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:29.110045 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10f2a83-c126-4643-9880-99ee8615a60d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:29.110757 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e4d23f-59c7-496e-a589-4c43ea97f1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:29.111396 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10f2a83-c126-4643-9880-99ee8615a60d None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:29.111501 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4d23f-59c7-496e-a589-4c43ea97f1b1 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:29.111677 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4d23f-59c7-496e-a589-4c43ea97f1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:29.111948 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e4d23f-59c7-496e-a589-4c43ea97f1b1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:29.120230 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e4d23f-59c7-496e-a589-4c43ea97f1b1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:29.121079 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-c10f2a83-c126-4643-9880-99ee8615a60d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 13:36:29.121079 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:29.121079 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:36:29.121079 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:36:29.121079 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:36:29.121079 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:36:29.121079 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:36:29.121079 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:36:29.121079 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 13:36:29.121079 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:36:29.121079 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:36:29.121079 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:36:29.121079 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:29.121079 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:29.121079 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:29.121079 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:29.121079 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:29.122351 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:29.122351 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:29.122351 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:29.122351 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:29.122351 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:29.122351 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:29.122351 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:36:29.122351 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:36:29.122351 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:36:29.122351 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:36:29.122351 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:29.122351 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:29.122351 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:29.122351 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:29.122351 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:29.122351 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:29.123287 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:29.123287 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:29.123287 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:29.123287 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:29.123287 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:29.123287 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:29.123287 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:29.123287 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:29.123287 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:29.123287 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:29.123287 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:36:29.123287 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:36:29.123287 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 13:36:29.123287 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:36:29.124045 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e4d23f-59c7-496e-a589-4c43ea97f1b1 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:29.124515 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 513/1029] 10.222.0.69 () {56 vars in 1105 bytes} [Thu Sep 8 13:36:28 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:36:29.125888 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9156c8-f17b-4202-9828-9808d0c0f582 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:29.126168 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9156c8-f17b-4202-9828-9808d0c0f582 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:29.126452 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9156c8-f17b-4202-9828-9808d0c0f582 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:29.129597 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 514/1030] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:36:29.129597 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9156c8-f17b-4202-9828-9808d0c0f582 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:29.136481 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-37e4d23f-59c7-496e-a589-4c43ea97f1b1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:36:29.136481 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:29.136481 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:29.136481 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:29.136481 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:29.136481 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:29.136481 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:29.136481 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:29.136481 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:29.136481 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:29.136481 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:29.136481 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:29.136481 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:36:29.136481 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:36:29.136481 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:36:29.136481 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:36:29.137679 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:29.137679 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:29.137679 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:36:29.137679 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:36:29.137679 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:36:29.137679 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:36:29.137679 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:29.137679 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:29.137679 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:29.137679 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:29.137679 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:29.137679 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:29.137679 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:29.137679 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:29.137679 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:29.137679 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:29.137679 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:29.137679 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:29.138664 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:29.138664 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:29.138664 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:36:29.138664 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:36:29.138664 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:36:29.138664 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:36:29.138664 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:36:29.138664 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:36:29.138664 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:36:29.138664 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:29.138664 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 517/1031] 10.222.0.69 () {56 vars in 1093 bytes} [Thu Sep 8 13:36:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:36:29.139288 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d7a2e-9f0b-4d96-bf7e-8877085eb47c None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:29.139288 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d7a2e-9f0b-4d96-bf7e-8877085eb47c None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:29.139511 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d7a2e-9f0b-4d96-bf7e-8877085eb47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:29.158792 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-119d7a2e-9f0b-4d96-bf7e-8877085eb47c None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:36:29.160059 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-119d7a2e-9f0b-4d96-bf7e-8877085eb47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:36:29.231406 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 518/1032] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:36:29 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:36:29.232072 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d7a2e-9f0b-4d96-bf7e-8877085eb47c None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:29.273454 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9156c8-f17b-4202-9828-9808d0c0f582 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:29.289941 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:29.299184 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:29.316801 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111998f-9472-498b-ae22-061832f94178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:29.317540 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111998f-9472-498b-ae22-061832f94178 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:29.317887 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111998f-9472-498b-ae22-061832f94178 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:29.318230 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111998f-9472-498b-ae22-061832f94178 None admin] PATH_INFO: `/v3/services` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:29.318941 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111998f-9472-498b-ae22-061832f94178 None admin] RBAC: Adding query filter params (name=image) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:29.319313 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111998f-9472-498b-ae22-061832f94178 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:29.320761 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111998f-9472-498b-ae22-061832f94178 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:29.333226 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 515/1033] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:36:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:29.340378 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111998f-9472-498b-ae22-061832f94178 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:29.360436 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d7a2e-9f0b-4d96-bf7e-8877085eb47c None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:29.399545 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305367a-7da0-4a31-89c8-5002919ef661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:29.400155 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305367a-7da0-4a31-89c8-5002919ef661 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:29.400434 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305367a-7da0-4a31-89c8-5002919ef661 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:29.400702 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305367a-7da0-4a31-89c8-5002919ef661 None admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:29.401467 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e305367a-7da0-4a31-89c8-5002919ef661 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:29.401774 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e305367a-7da0-4a31-89c8-5002919ef661 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:29.403199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e305367a-7da0-4a31-89c8-5002919ef661 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:29.421517 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 519/1034] 10.222.0.69 () {56 vars in 1133 bytes} [Thu Sep 8 13:36:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:29.427397 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305367a-7da0-4a31-89c8-5002919ef661 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:29.488605 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111998f-9472-498b-ae22-061832f94178 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:29.535762 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305367a-7da0-4a31-89c8-5002919ef661 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:29.542910 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b456dd16-2615-4c68-aba1-e4876996bce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:29.543949 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456dd16-2615-4c68-aba1-e4876996bce6 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:29.544224 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456dd16-2615-4c68-aba1-e4876996bce6 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:29.544493 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456dd16-2615-4c68-aba1-e4876996bce6 None admin] PATH_INFO: `/v3/services` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:29.545492 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b456dd16-2615-4c68-aba1-e4876996bce6 None admin] RBAC: Adding query filter params (type=image) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:29.545809 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b456dd16-2615-4c68-aba1-e4876996bce6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:29.546727 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:29.547600 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b456dd16-2615-4c68-aba1-e4876996bce6 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:29.554052 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 516/1035] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:36:29 2022] GET /identity/v3/services?type=image => generated 350 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:29.554872 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b456dd16-2615-4c68-aba1-e4876996bce6 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:29.574974 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee9c27-60fe-47d6-ad50-65db13d2ae6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:29.575585 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee9c27-60fe-47d6-ad50-65db13d2ae6d None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:29.575872 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee9c27-60fe-47d6-ad50-65db13d2ae6d None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:29.576145 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee9c27-60fe-47d6-ad50-65db13d2ae6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:29.601499 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:29.648573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adee9c27-60fe-47d6-ad50-65db13d2ae6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:29.650074 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adee9c27-60fe-47d6-ad50-65db13d2ae6d None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:29.663712 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b456dd16-2615-4c68-aba1-e4876996bce6 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:29.699973 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2ca9b-e6d2-4d1a-8d84-6f63ba1683e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:29.700605 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2ca9b-e6d2-4d1a-8d84-6f63ba1683e1 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:29.700890 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2ca9b-e6d2-4d1a-8d84-6f63ba1683e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:29.701139 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d2ca9b-e6d2-4d1a-8d84-6f63ba1683e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:29.702294 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2ca9b-e6d2-4d1a-8d84-6f63ba1683e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:29.703725 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d2ca9b-e6d2-4d1a-8d84-6f63ba1683e1 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:29.705303 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 517/1036] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:36:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:29.706092 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2ca9b-e6d2-4d1a-8d84-6f63ba1683e1 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:29.754553 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 520/1037] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:36:29 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 08 13:36:29.755379 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee9c27-60fe-47d6-ad50-65db13d2ae6d None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:29.767084 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:29.813456 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d2ca9b-e6d2-4d1a-8d84-6f63ba1683e1 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:29.824437 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:29.852279 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20f426-2ac7-4641-8e16-5fa5f548eaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:29.853023 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20f426-2ac7-4641-8e16-5fa5f548eaac None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:29.853294 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20f426-2ac7-4641-8e16-5fa5f548eaac None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:29.853696 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20f426-2ac7-4641-8e16-5fa5f548eaac None admin] PATH_INFO: `/v3/endpoints` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:29.854397 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20f426-2ac7-4641-8e16-5fa5f548eaac None admin] RBAC: Adding query filter params (interface=public, service_id=59e4ebd396d24a8cab4eb50bcd68fa5e, region_id=RegionOne) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:29.854704 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20f426-2ac7-4641-8e16-5fa5f548eaac None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:29.856056 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20f426-2ac7-4641-8e16-5fa5f548eaac None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:29.860000 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee9c27-60fe-47d6-ad50-65db13d2ae6d None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:29.861267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 518/1038] 10.222.0.69 () {56 vars in 1251 bytes} [Thu Sep 8 13:36:29 2022] GET /identity/v3/endpoints?service_id=59e4ebd396d24a8cab4eb50bcd68fa5e&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:29.862093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20f426-2ac7-4641-8e16-5fa5f548eaac None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:29.895983 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fae6e3-a89f-48dd-b6b0-0dbdb10b5058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:29.896588 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fae6e3-a89f-48dd-b6b0-0dbdb10b5058 None admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:29.896869 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fae6e3-a89f-48dd-b6b0-0dbdb10b5058 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:29.897143 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fae6e3-a89f-48dd-b6b0-0dbdb10b5058 None admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:29.897830 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fae6e3-a89f-48dd-b6b0-0dbdb10b5058 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:29.899251 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fae6e3-a89f-48dd-b6b0-0dbdb10b5058 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:29.922038 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 521/1039] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Sep 8 13:36:29 2022] POST /identity/v3/users => generated 285 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:36:29.922810 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fae6e3-a89f-48dd-b6b0-0dbdb10b5058 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:29.992649 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20f426-2ac7-4641-8e16-5fa5f548eaac None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:30.000327 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:30.046527 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9470dc4-446e-4ced-9ff2-df0d7487fd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:30.047172 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9470dc4-446e-4ced-9ff2-df0d7487fd0b None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:30.047280 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fae6e3-a89f-48dd-b6b0-0dbdb10b5058 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:30.047444 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9470dc4-446e-4ced-9ff2-df0d7487fd0b None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:30.047714 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9470dc4-446e-4ced-9ff2-df0d7487fd0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:30.064157 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9470dc4-446e-4ced-9ff2-df0d7487fd0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:30.065589 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9470dc4-446e-4ced-9ff2-df0d7487fd0b None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:30.082865 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-f9470dc4-446e-4ced-9ff2-df0d7487fd0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:36:30.082865 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:30.082865 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:30.082865 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:30.082865 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:30.082865 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:30.082865 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:30.082865 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:30.082865 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:30.082865 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:30.082865 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:30.082865 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:30.082865 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:36:30.082865 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:36:30.082865 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:36:30.082865 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:36:30.084099 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:30.084099 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:30.084099 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:30.084099 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:30.084099 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:30.084099 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:30.084099 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:30.084099 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:30.084099 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:30.084099 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:30.084099 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:30.084099 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:30.084099 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:30.084099 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:30.084099 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:30.084099 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:30.084099 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:36:30.085206 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:36:30.085206 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:36:30.085206 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:36:30.089239 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 519/1040] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:36:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:36:30.090396 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9470dc4-446e-4ced-9ff2-df0d7487fd0b None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:30.097581 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fabff8-a4b3-4145-a221-9e7aaea0f400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:30.098441 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fabff8-a4b3-4145-a221-9e7aaea0f400 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:30.099143 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fabff8-a4b3-4145-a221-9e7aaea0f400 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:30.099553 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fabff8-a4b3-4145-a221-9e7aaea0f400 None admin] PATH_INFO: `/v3/services` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:30.100928 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fabff8-a4b3-4145-a221-9e7aaea0f400 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:30.102729 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fabff8-a4b3-4145-a221-9e7aaea0f400 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:30.111437 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 522/1041] 10.222.0.69 () {56 vars in 1087 bytes} [Thu Sep 8 13:36:29 2022] GET /identity/v3/services => generated 1957 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:36:30.130702 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:30.228055 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9470dc4-446e-4ced-9ff2-df0d7487fd0b None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:30.276834 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58282e1a-da41-40b0-bd0e-685dedb73443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:30.277500 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58282e1a-da41-40b0-bd0e-685dedb73443 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:30.277780 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58282e1a-da41-40b0-bd0e-685dedb73443 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:30.278118 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58282e1a-da41-40b0-bd0e-685dedb73443 None admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:30.279064 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58282e1a-da41-40b0-bd0e-685dedb73443 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:30.279370 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58282e1a-da41-40b0-bd0e-685dedb73443 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:30.281244 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58282e1a-da41-40b0-bd0e-685dedb73443 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:30.301414 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 520/1042] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:30.303787 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fabff8-a4b3-4145-a221-9e7aaea0f400 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:30.435805 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fabff8-a4b3-4145-a221-9e7aaea0f400 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:30.474996 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:30.485856 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0d2cf-33ef-48d9-97ca-269467c5db5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:30.486914 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0d2cf-33ef-48d9-97ca-269467c5db5d None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:30.487406 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0d2cf-33ef-48d9-97ca-269467c5db5d None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:30.488570 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0d2cf-33ef-48d9-97ca-269467c5db5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:30.500886 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c0d2cf-33ef-48d9-97ca-269467c5db5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:30.504138 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c0d2cf-33ef-48d9-97ca-269467c5db5d None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:30.527007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-90c0d2cf-33ef-48d9-97ca-269467c5db5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:36:30.527007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:30.527007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:30.527007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:30.527007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:30.527007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:30.527007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:30.527007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:30.527007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:30.527007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:30.527007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:30.527007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:30.527007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:36:30.527007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:36:30.527007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:36:30.527995 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:36:30.527995 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:30.527995 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:30.527995 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:30.527995 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:30.527995 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:30.527995 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:30.527995 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:30.527995 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:30.527995 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:30.527995 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:30.527995 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:30.527995 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:30.527995 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:30.527995 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:30.527995 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:30.527995 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:30.528971 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:36:30.528971 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:36:30.528971 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:36:30.528971 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:36:30.528971 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:36:30.528971 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:36:30.528971 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:36:30.528971 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:30.529434 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 523/1043] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:36:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:36:30.535889 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58282e1a-da41-40b0-bd0e-685dedb73443 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:30.628817 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:30.648578 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58282e1a-da41-40b0-bd0e-685dedb73443 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:30.684383 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c00257-2b36-4ea7-abf3-c81f9cae6a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:30.684988 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c00257-2b36-4ea7-abf3-c81f9cae6a2d None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:30.685263 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c00257-2b36-4ea7-abf3-c81f9cae6a2d None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:30.685565 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c00257-2b36-4ea7-abf3-c81f9cae6a2d None admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:30.686310 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c00257-2b36-4ea7-abf3-c81f9cae6a2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:30.686615 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c00257-2b36-4ea7-abf3-c81f9cae6a2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:30.688032 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c00257-2b36-4ea7-abf3-c81f9cae6a2d None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:30.705411 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 521/1044] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 8 13:36:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:30.708171 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0d2cf-33ef-48d9-97ca-269467c5db5d None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:30.812339 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0d2cf-33ef-48d9-97ca-269467c5db5d None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:30.849248 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf31ca4-3156-4568-98eb-e1087deb2dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:30.849888 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf31ca4-3156-4568-98eb-e1087deb2dc6 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:30.850167 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf31ca4-3156-4568-98eb-e1087deb2dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:30.850433 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf31ca4-3156-4568-98eb-e1087deb2dc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:30.851156 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf31ca4-3156-4568-98eb-e1087deb2dc6 None admin] RBAC: Adding query filter params (role.id=2cc89a32b68046feacb991d263b7cb75, scope.project.id=88de9f1470c6415b97866ad5a3256ef2, user.id=c95448c1b8b1466cae37fda5c713d53f) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:30.851459 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf31ca4-3156-4568-98eb-e1087deb2dc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:30.852880 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf31ca4-3156-4568-98eb-e1087deb2dc6 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:30.865694 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 524/1045] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 8 13:36:30 2022] GET /identity/v3/role_assignments?user.id=c95448c1b8b1466cae37fda5c713d53f&scope.project.id=88de9f1470c6415b97866ad5a3256ef2&role.id=2cc89a32b68046feacb991d263b7cb75 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:36:32.353813 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915eda5-5e22-4398-bc06-7ab87bddc4b8 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:32.354334 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915eda5-5e22-4398-bc06-7ab87bddc4b8 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:32.354424 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915eda5-5e22-4398-bc06-7ab87bddc4b8 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:32.356007 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 522/1046] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:36:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:36:32.361547 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ff498-3f66-4df9-aa66-2723ba6a3be5 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:32.361956 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ff498-3f66-4df9-aa66-2723ba6a3be5 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:32.362094 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ff498-3f66-4df9-aa66-2723ba6a3be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:32.381873 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-d81ff498-3f66-4df9-aa66-2723ba6a3be5 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:36:32.383157 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-d81ff498-3f66-4df9-aa66-2723ba6a3be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:36:32.445113 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:32.466719 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 525/1047] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:36:32 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:36:32.540893 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb607153-8753-4d81-9087-4333b769443c None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:32.541560 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb607153-8753-4d81-9087-4333b769443c None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:32.542049 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb607153-8753-4d81-9087-4333b769443c None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:32.543899 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 523/1048] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:36:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:36:32.549179 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55e2b3-22a2-4a59-9322-e31d85297769 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:32.549488 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55e2b3-22a2-4a59-9322-e31d85297769 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:32.549761 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55e2b3-22a2-4a59-9322-e31d85297769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:32.574869 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-4e55e2b3-22a2-4a59-9322-e31d85297769 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:36:32.576084 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-4e55e2b3-22a2-4a59-9322-e31d85297769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:36:32.652573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 526/1049] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:36:32 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:36:32.734047 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb607153-8753-4d81-9087-4333b769443c None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:32.841437 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb607153-8753-4d81-9087-4333b769443c None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:32.884006 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542b103-2ef4-43f2-99a0-3d8d3d5da9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:32.884632 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542b103-2ef4-43f2-99a0-3d8d3d5da9df None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:32.884905 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542b103-2ef4-43f2-99a0-3d8d3d5da9df None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:32.885173 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542b103-2ef4-43f2-99a0-3d8d3d5da9df None admin] PATH_INFO: `/v3/services/image` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:32.886014 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2542b103-2ef4-43f2-99a0-3d8d3d5da9df None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:32.887132 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2542b103-2ef4-43f2-99a0-3d8d3d5da9df None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:32.896785 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-2542b103-2ef4-43f2-99a0-3d8d3d5da9df None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 13:36:32.896785 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:32.896785 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:36:32.896785 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:36:32.896785 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:36:32.896785 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:36:32.896785 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:36:32.896785 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:36:32.896785 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 13:36:32.896785 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:36:32.896785 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:36:32.896785 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:36:32.896785 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:32.896785 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:32.896785 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:32.896785 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:32.896785 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:32.897908 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:32.897908 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:32.897908 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:32.897908 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:32.897908 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:32.897908 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:32.897908 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:36:32.897908 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:36:32.897908 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:36:32.897908 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:36:32.897908 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:32.897908 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:32.897908 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:32.897908 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:32.897908 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:32.897908 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:32.898806 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:32.898806 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:32.898806 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:32.898806 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:32.898806 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:32.898806 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:32.898806 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:32.898806 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:32.898806 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:32.898806 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:32.898806 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:36:32.898806 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:36:32.898806 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 08 13:36:32.898806 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:36:32.901714 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 524/1050] 10.222.0.69 () {56 vars in 1105 bytes} [Thu Sep 8 13:36:32 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:36:32.903851 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55e2b3-22a2-4a59-9322-e31d85297769 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:32.929703 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542b103-2ef4-43f2-99a0-3d8d3d5da9df None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:32.943575 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:33.019727 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55e2b3-22a2-4a59-9322-e31d85297769 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:33.035867 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:33.047189 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542b103-2ef4-43f2-99a0-3d8d3d5da9df None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:33.059262 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b33ee-6d70-4de9-ba62-609e225f90f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:33.059873 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b33ee-6d70-4de9-ba62-609e225f90f7 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:33.060155 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b33ee-6d70-4de9-ba62-609e225f90f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:33.060407 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b33ee-6d70-4de9-ba62-609e225f90f7 None admin] PATH_INFO: `/v3/services` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:33.061051 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9b33ee-6d70-4de9-ba62-609e225f90f7 None admin] RBAC: Adding query filter params (name=image) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:33.061352 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9b33ee-6d70-4de9-ba62-609e225f90f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:33.062985 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9b33ee-6d70-4de9-ba62-609e225f90f7 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:33.069418 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 527/1051] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:36:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:33.077050 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18032e08-71d6-4d0c-870a-cbc9ae468f85 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:33.077320 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18032e08-71d6-4d0c-870a-cbc9ae468f85 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:33.077635 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18032e08-71d6-4d0c-870a-cbc9ae468f85 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:33.079050 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 528/1052] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:36:33 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:36:33.079815 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18032e08-71d6-4d0c-870a-cbc9ae468f85 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:33.100785 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213b463-0ba7-4c7a-88bc-63969c5d078e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:33.101461 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213b463-0ba7-4c7a-88bc-63969c5d078e None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:33.101739 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213b463-0ba7-4c7a-88bc-63969c5d078e None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:33.102016 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213b463-0ba7-4c7a-88bc-63969c5d078e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:33.113014 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7213b463-0ba7-4c7a-88bc-63969c5d078e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:36:33.117878 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-7213b463-0ba7-4c7a-88bc-63969c5d078e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:36:33.117878 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:33.117878 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:33.117878 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:33.117878 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:33.117878 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:33.117878 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:33.117878 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:33.117878 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:33.117878 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:33.117878 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:33.117878 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:33.117878 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:36:33.117878 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:36:33.117878 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:36:33.117878 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:36:33.121994 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:36:33.121994 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:36:33.121994 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:36:33.121994 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:36:33.121994 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:33.121994 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:33.121994 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:33.121994 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:33.121994 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:33.121994 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:33.121994 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:33.121994 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:33.121994 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:33.121994 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:33.121994 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:33.121994 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:33.123771 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:33.123771 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:33.123771 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:33.123771 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:33.123771 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:36:33.123771 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:36:33.123771 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:36:33.123771 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:36:33.123771 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:36:33.123771 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:36:33.123771 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:36:33.123771 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:36:33.123771 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 525/1053] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 8 13:36:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:36:33.123771 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202af84f-5f3a-42a1-8719-cd663c004654 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:33.124956 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202af84f-5f3a-42a1-8719-cd663c004654 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:33.124956 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202af84f-5f3a-42a1-8719-cd663c004654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:33.143154 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-202af84f-5f3a-42a1-8719-cd663c004654 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:36:33.145143 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-202af84f-5f3a-42a1-8719-cd663c004654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:36:33.207247 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18032e08-71d6-4d0c-870a-cbc9ae468f85 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:33.212272 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:33.218755 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 526/1054] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:36:33 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:36:33.219598 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202af84f-5f3a-42a1-8719-cd663c004654 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:33.247194 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f1590-a389-421d-9893-9fab3d40186e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:33.247800 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f1590-a389-421d-9893-9fab3d40186e None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:33.248077 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f1590-a389-421d-9893-9fab3d40186e None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:33.248348 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82f1590-a389-421d-9893-9fab3d40186e None admin] PATH_INFO: `/v3/services` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:33.248981 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82f1590-a389-421d-9893-9fab3d40186e None admin] RBAC: Adding query filter params (type=image) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:33.249283 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82f1590-a389-421d-9893-9fab3d40186e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:33.250685 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82f1590-a389-421d-9893-9fab3d40186e None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:33.260087 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 529/1055] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:36:33 2022] GET /identity/v3/services?type=image => generated 350 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:33.265262 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f1590-a389-421d-9893-9fab3d40186e None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:33.317156 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:33.358280 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202af84f-5f3a-42a1-8719-cd663c004654 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:33.388142 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82f1590-a389-421d-9893-9fab3d40186e None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:33.403545 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876605ae-c15e-4338-83fc-9a9ad77c4449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:33.404297 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876605ae-c15e-4338-83fc-9a9ad77c4449 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:33.404687 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876605ae-c15e-4338-83fc-9a9ad77c4449 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:33.405074 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876605ae-c15e-4338-83fc-9a9ad77c4449 None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:33.406211 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876605ae-c15e-4338-83fc-9a9ad77c4449 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:33.406707 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876605ae-c15e-4338-83fc-9a9ad77c4449 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:33.409204 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876605ae-c15e-4338-83fc-9a9ad77c4449 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:33.429913 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 527/1056] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:36:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:33.431226 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876605ae-c15e-4338-83fc-9a9ad77c4449 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:33.441991 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa3882-db81-475d-9610-e901616d2e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:33.442595 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa3882-db81-475d-9610-e901616d2e07 None admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:33.442869 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa3882-db81-475d-9610-e901616d2e07 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:33.443138 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa3882-db81-475d-9610-e901616d2e07 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:33.443798 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fa3882-db81-475d-9610-e901616d2e07 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:33.445147 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fa3882-db81-475d-9610-e901616d2e07 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:33.479504 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 530/1057] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:36:33 2022] POST /identity/v3/endpoints => generated 327 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:36:33.518941 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:33.520312 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa3882-db81-475d-9610-e901616d2e07 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:33.580681 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876605ae-c15e-4338-83fc-9a9ad77c4449 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:33.632665 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2c5aa-b058-4fa7-b81a-306f3c82ef32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:33.633237 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2c5aa-b058-4fa7-b81a-306f3c82ef32 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:33.633563 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2c5aa-b058-4fa7-b81a-306f3c82ef32 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:33.633830 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2c5aa-b058-4fa7-b81a-306f3c82ef32 None admin] PATH_INFO: `/v3/users/205e91b62d0d48289b5dd3b58f9654a8` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:33.639967 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:33.648324 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa3882-db81-475d-9610-e901616d2e07 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:33.652070 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2c5aa-b058-4fa7-b81a-306f3c82ef32 None admin] RBAC: Authorizing `identity:get_user(user_id=205e91b62d0d48289b5dd3b58f9654a8)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:33.653618 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2c5aa-b058-4fa7-b81a-306f3c82ef32 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:33.655502 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 528/1058] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:36:33 2022] GET /identity/v3/users/205e91b62d0d48289b5dd3b58f9654a8 => generated 285 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:33.662031 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2c5aa-b058-4fa7-b81a-306f3c82ef32 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:33.692659 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be2d70-81a3-4199-ae59-46f7e0df9862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:33.693764 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be2d70-81a3-4199-ae59-46f7e0df9862 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:33.694265 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be2d70-81a3-4199-ae59-46f7e0df9862 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:33.694741 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be2d70-81a3-4199-ae59-46f7e0df9862 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:33.708832 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be2d70-81a3-4199-ae59-46f7e0df9862 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:36:33.713865 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-a8be2d70-81a3-4199-ae59-46f7e0df9862 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 13:36:33.713865 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:33.713865 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:33.713865 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:33.713865 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:33.713865 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:33.713865 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:33.713865 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:33.713865 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:33.713865 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:33.713865 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:33.713865 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:33.713865 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:36:33.713865 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:36:33.713865 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:36:33.713865 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:36:33.714899 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:36:33.714899 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:36:33.714899 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:36:33.714899 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:36:33.714899 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:33.714899 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:33.714899 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:33.714899 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:33.714899 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:33.714899 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:33.714899 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:33.714899 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:33.714899 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:33.714899 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:33.714899 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:33.714899 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:33.716326 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:33.716326 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:33.716326 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:33.716326 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:33.716326 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:36:33.716326 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:36:33.716326 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:36:33.716326 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:36:33.716326 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:36:33.716326 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:36:33.716326 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 13:36:33.716326 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:33.716326 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 531/1059] 10.222.0.69 () {56 vars in 1120 bytes} [Thu Sep 8 13:36:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:36:33.722038 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be2d70-81a3-4199-ae59-46f7e0df9862 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:33.782562 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2c5aa-b058-4fa7-b81a-306f3c82ef32 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:33.801876 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:33.821687 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fa74f-c9a5-48f4-931a-bdaca7e42c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:33.822683 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fa74f-c9a5-48f4-931a-bdaca7e42c6d None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:33.822826 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fa74f-c9a5-48f4-931a-bdaca7e42c6d None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:33.823128 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fa74f-c9a5-48f4-931a-bdaca7e42c6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:33.833633 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be2d70-81a3-4199-ae59-46f7e0df9862 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:33.872445 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e94f5c5-a869-4246-9458-24d4eeed4459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:33.873232 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94f5c5-a869-4246-9458-24d4eeed4459 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:33.873545 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94f5c5-a869-4246-9458-24d4eeed4459 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:33.873842 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94f5c5-a869-4246-9458-24d4eeed4459 None admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:33.874478 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e94f5c5-a869-4246-9458-24d4eeed4459 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:33.874787 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e94f5c5-a869-4246-9458-24d4eeed4459 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:33.876157 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e94f5c5-a869-4246-9458-24d4eeed4459 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:33.885912 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 532/1060] 10.222.0.69 () {56 vars in 1115 bytes} [Thu Sep 8 13:36:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:36:33.891429 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e94f5c5-a869-4246-9458-24d4eeed4459 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:33.903925 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7fa74f-c9a5-48f4-931a-bdaca7e42c6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:33.905455 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7fa74f-c9a5-48f4-931a-bdaca7e42c6d None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:33.915689 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:34.001727 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e94f5c5-a869-4246-9458-24d4eeed4459 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:34.032324 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 529/1061] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:36:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 08 13:36:34.038191 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fa74f-c9a5-48f4-931a-bdaca7e42c6d None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:34.047676 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ce3b2-7bee-44f9-af70-aa0afc4fe39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:34.048298 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ce3b2-7bee-44f9-af70-aa0afc4fe39b None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:34.048771 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ce3b2-7bee-44f9-af70-aa0afc4fe39b None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:34.048882 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ce3b2-7bee-44f9-af70-aa0afc4fe39b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:34.058340 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:34.061275 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ce3b2-7bee-44f9-af70-aa0afc4fe39b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:34.063021 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ce3b2-7bee-44f9-af70-aa0afc4fe39b None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:34.078494 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-8b8ce3b2-7bee-44f9-af70-aa0afc4fe39b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:36:34.078494 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:34.078494 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:34.078494 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:34.078494 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:34.078494 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:34.078494 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:34.078494 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:34.078494 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:34.078494 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:34.078494 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:34.078494 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:34.078494 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:36:34.078494 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:36:34.078494 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:36:34.078494 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:36:34.079491 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:34.079491 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:34.079491 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:34.079491 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:34.079491 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:34.079491 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:34.079491 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:34.079491 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:34.079491 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:34.079491 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:34.079491 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:34.079491 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:34.079491 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:34.079491 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:34.079491 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:34.079491 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:34.079491 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:36:34.080415 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:36:34.080415 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:36:34.080415 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:34.080415 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 533/1062] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:36:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:36:34.086617 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ce3b2-7bee-44f9-af70-aa0afc4fe39b None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:34.167646 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:34.167832 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fa74f-c9a5-48f4-931a-bdaca7e42c6d None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:34.208156 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ce3b2-7bee-44f9-af70-aa0afc4fe39b None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:34.210138 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8775bbde-d608-4550-a8e4-84a0692dffa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:34.210777 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775bbde-d608-4550-a8e4-84a0692dffa1 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:34.211048 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775bbde-d608-4550-a8e4-84a0692dffa1 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:34.211317 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775bbde-d608-4550-a8e4-84a0692dffa1 None admin] PATH_INFO: `/v3/projects/1d01eba2858a45ee99de1c1518ed753a` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:34.212444 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8775bbde-d608-4550-a8e4-84a0692dffa1 None admin] RBAC: Authorizing `identity:get_project(project_id=1d01eba2858a45ee99de1c1518ed753a)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:34.213909 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8775bbde-d608-4550-a8e4-84a0692dffa1 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:34.215567 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 530/1063] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:36:34 2022] GET /identity/v3/projects/1d01eba2858a45ee99de1c1518ed753a => generated 311 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:34.221570 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8775bbde-d608-4550-a8e4-84a0692dffa1 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:34.250047 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dac331-a4b7-4394-917a-db9f4a6fe1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:34.250811 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dac331-a4b7-4394-917a-db9f4a6fe1c7 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:34.251091 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dac331-a4b7-4394-917a-db9f4a6fe1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:34.251364 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dac331-a4b7-4394-917a-db9f4a6fe1c7 None admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:34.252018 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dac331-a4b7-4394-917a-db9f4a6fe1c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:34.252325 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dac331-a4b7-4394-917a-db9f4a6fe1c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:34.254535 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dac331-a4b7-4394-917a-db9f4a6fe1c7 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:34.268391 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 534/1064] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:36:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:36:34.274390 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dac331-a4b7-4394-917a-db9f4a6fe1c7 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:34.330535 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:34.351188 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8775bbde-d608-4550-a8e4-84a0692dffa1 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:34.384085 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dac331-a4b7-4394-917a-db9f4a6fe1c7 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:34.390868 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654f7ee-3612-42a8-b4ed-4902d0f3eb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:34.391486 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654f7ee-3612-42a8-b4ed-4902d0f3eb50 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:34.391746 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654f7ee-3612-42a8-b4ed-4902d0f3eb50 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:34.392022 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654f7ee-3612-42a8-b4ed-4902d0f3eb50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:34.393172 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654f7ee-3612-42a8-b4ed-4902d0f3eb50 None admin] RBAC: Adding query filter params (role.id=9c76f398c9e04caeab83842e70eb824b, scope.project.id=1d01eba2858a45ee99de1c1518ed753a, user.id=205e91b62d0d48289b5dd3b58f9654a8) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:34.393519 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654f7ee-3612-42a8-b4ed-4902d0f3eb50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:34.395979 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654f7ee-3612-42a8-b4ed-4902d0f3eb50 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:34.413394 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 531/1065] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 8 13:36:34 2022] GET /identity/v3/role_assignments?user.id=205e91b62d0d48289b5dd3b58f9654a8&scope.project.id=1d01eba2858a45ee99de1c1518ed753a&role.id=9c76f398c9e04caeab83842e70eb824b => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:36:34.432619 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:34.439663 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919293c-47b3-42a7-b573-9f5e85f456b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:34.440605 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919293c-47b3-42a7-b573-9f5e85f456b7 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:34.441717 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919293c-47b3-42a7-b573-9f5e85f456b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:34.442156 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f919293c-47b3-42a7-b573-9f5e85f456b7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:34.452022 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f919293c-47b3-42a7-b573-9f5e85f456b7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:34.453765 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f919293c-47b3-42a7-b573-9f5e85f456b7 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:34.470224 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-f919293c-47b3-42a7-b573-9f5e85f456b7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:36:34.470224 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:34.470224 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:34.470224 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:34.470224 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:34.470224 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:34.470224 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:34.470224 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:34.470224 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:34.470224 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:34.470224 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:34.470224 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:34.470224 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:36:34.470224 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:36:34.470224 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:36:34.470224 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:36:34.471572 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:34.471572 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:34.471572 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:36:34.471572 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:36:34.471572 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:36:34.471572 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:36:34.471572 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:34.471572 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:34.471572 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:34.471572 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:34.471572 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:34.471572 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:34.471572 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:34.471572 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:34.471572 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:34.471572 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:34.471572 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:34.471572 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:34.472791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:34.472791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:34.472791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:36:34.472791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:36:34.472791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:36:34.472791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:36:34.472791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:36:34.472791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:36:34.472791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:36:34.472791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:34.479671 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 535/1066] 10.222.0.69 () {56 vars in 1093 bytes} [Thu Sep 8 13:36:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:36:34.482002 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654f7ee-3612-42a8-b4ed-4902d0f3eb50 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:34.613971 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654f7ee-3612-42a8-b4ed-4902d0f3eb50 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:34.649441 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a137da-3448-4e7f-ac92-e39c5d5ae1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:34.650085 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a137da-3448-4e7f-ac92-e39c5d5ae1e6 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:34.650363 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a137da-3448-4e7f-ac92-e39c5d5ae1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:34.650708 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a137da-3448-4e7f-ac92-e39c5d5ae1e6 None admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:34.651354 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a137da-3448-4e7f-ac92-e39c5d5ae1e6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:34.651652 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a137da-3448-4e7f-ac92-e39c5d5ae1e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:34.653052 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a137da-3448-4e7f-ac92-e39c5d5ae1e6 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:34.677887 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 532/1067] 10.222.0.69 () {56 vars in 1133 bytes} [Thu Sep 8 13:36:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:34.679429 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919293c-47b3-42a7-b573-9f5e85f456b7 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:34.787354 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f919293c-47b3-42a7-b573-9f5e85f456b7 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:34.824008 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a21f3b-07f7-4c9a-816d-45f47cd35cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:34.824630 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a21f3b-07f7-4c9a-816d-45f47cd35cfc None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:34.824894 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a21f3b-07f7-4c9a-816d-45f47cd35cfc None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:34.825164 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a21f3b-07f7-4c9a-816d-45f47cd35cfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:34.836911 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a21f3b-07f7-4c9a-816d-45f47cd35cfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:34.838825 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a21f3b-07f7-4c9a-816d-45f47cd35cfc None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:34.853897 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-57a21f3b-07f7-4c9a-816d-45f47cd35cfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:36:34.853897 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:34.853897 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:34.853897 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:34.853897 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:34.853897 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:34.853897 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:34.853897 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:34.853897 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:34.853897 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:34.853897 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:34.853897 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:34.853897 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:36:34.853897 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:36:34.853897 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:36:34.853897 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:36:34.854904 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:34.854904 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:34.854904 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:34.854904 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:34.854904 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:34.854904 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:34.854904 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:34.854904 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:34.854904 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:34.854904 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:34.854904 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:34.854904 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:34.854904 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:34.854904 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:34.854904 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:34.854904 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:34.854904 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:36:34.855824 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:36:34.855824 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:36:34.855824 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:34.855824 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 536/1068] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:36:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:36:34.861485 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a137da-3448-4e7f-ac92-e39c5d5ae1e6 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:34.871659 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:34.969303 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a137da-3448-4e7f-ac92-e39c5d5ae1e6 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:35.004677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e392b3f-17f5-4544-9194-5732eff26102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:35.005272 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e392b3f-17f5-4544-9194-5732eff26102 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:35.005570 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e392b3f-17f5-4544-9194-5732eff26102 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:35.005845 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e392b3f-17f5-4544-9194-5732eff26102 None admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:35.006482 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e392b3f-17f5-4544-9194-5732eff26102 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:35.006776 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e392b3f-17f5-4544-9194-5732eff26102 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:35.008113 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e392b3f-17f5-4544-9194-5732eff26102 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:35.024871 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 533/1069] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:36:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:35.027312 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a21f3b-07f7-4c9a-816d-45f47cd35cfc None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:35.074024 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:35.135485 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a21f3b-07f7-4c9a-816d-45f47cd35cfc None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:35.172930 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a4aaca-3c03-420e-9c02-f09290f090cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:35.173586 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4aaca-3c03-420e-9c02-f09290f090cb None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:35.173866 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4aaca-3c03-420e-9c02-f09290f090cb None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:35.174150 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a4aaca-3c03-420e-9c02-f09290f090cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:35.181833 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a4aaca-3c03-420e-9c02-f09290f090cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:35.183276 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a4aaca-3c03-420e-9c02-f09290f090cb None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:35.195830 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-a7a4aaca-3c03-420e-9c02-f09290f090cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:36:35.195830 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:35.195830 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:35.195830 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:35.195830 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:35.195830 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:35.195830 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:35.195830 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:35.195830 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:35.195830 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:35.195830 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:35.195830 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:35.195830 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:36:35.195830 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:36:35.195830 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:36:35.196782 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:36:35.196782 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:35.196782 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:35.196782 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:35.196782 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:35.196782 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:35.196782 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:35.196782 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:35.196782 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:35.196782 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:35.196782 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:35.196782 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:35.196782 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:35.196782 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:35.196782 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:35.196782 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:35.196782 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:35.198083 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:36:35.198083 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:36:35.198083 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:36:35.198083 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:36:35.198083 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:36:35.198083 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:36:35.198083 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:36:35.198083 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:35.201452 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 537/1070] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:36:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:36:35.203101 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e392b3f-17f5-4544-9194-5732eff26102 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:35.282105 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:35.327238 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e392b3f-17f5-4544-9194-5732eff26102 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:35.369725 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d69fdfb-56cf-4655-bb34-4447bebe8fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:35.370710 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69fdfb-56cf-4655-bb34-4447bebe8fd1 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:35.371216 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69fdfb-56cf-4655-bb34-4447bebe8fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:35.371827 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d69fdfb-56cf-4655-bb34-4447bebe8fd1 None admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:35.372748 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d69fdfb-56cf-4655-bb34-4447bebe8fd1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:35.373252 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d69fdfb-56cf-4655-bb34-4447bebe8fd1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:35.374937 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d69fdfb-56cf-4655-bb34-4447bebe8fd1 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:35.392898 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 534/1071] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 8 13:36:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:35.399775 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a4aaca-3c03-420e-9c02-f09290f090cb None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:35.513452 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a4aaca-3c03-420e-9c02-f09290f090cb None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:35.516745 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:35.554095 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9fee5-2014-40a2-8b61-acc0c0a9ad75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:35.554761 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9fee5-2014-40a2-8b61-acc0c0a9ad75 None admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:35.555040 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9fee5-2014-40a2-8b61-acc0c0a9ad75 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:35.555314 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9fee5-2014-40a2-8b61-acc0c0a9ad75 None admin] PATH_INFO: `/v3/projects/88de9f1470c6415b97866ad5a3256ef2/users/c95448c1b8b1466cae37fda5c713d53f/roles/2cc89a32b68046feacb991d263b7cb75` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:35.557570 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad9fee5-2014-40a2-8b61-acc0c0a9ad75 None admin] RBAC: Authorizing `identity:create_grant(project_id=88de9f1470c6415b97866ad5a3256ef2, user_id=c95448c1b8b1466cae37fda5c713d53f, role_id=2cc89a32b68046feacb991d263b7cb75)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:35.558997 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad9fee5-2014-40a2-8b61-acc0c0a9ad75 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:35.573988 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 538/1072] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Sep 8 13:36:35 2022] PUT /identity/v3/projects/88de9f1470c6415b97866ad5a3256ef2/users/c95448c1b8b1466cae37fda5c713d53f/roles/2cc89a32b68046feacb991d263b7cb75 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:36:35.794175 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281261f-14c2-4490-bb82-0035e2e372d6 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:35.794520 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281261f-14c2-4490-bb82-0035e2e372d6 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:35.794716 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281261f-14c2-4490-bb82-0035e2e372d6 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:35.796218 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 535/1073] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:36:35.802015 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f685c72-7829-44c8-ad52-5ef72a344c97 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:35.802304 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f685c72-7829-44c8-ad52-5ef72a344c97 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:35.802578 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f685c72-7829-44c8-ad52-5ef72a344c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:35.821718 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-2f685c72-7829-44c8-ad52-5ef72a344c97 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:36:35.822929 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-2f685c72-7829-44c8-ad52-5ef72a344c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:36:35.895055 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 539/1074] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:36:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:36:36.166033 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281261f-14c2-4490-bb82-0035e2e372d6 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:36.282033 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281261f-14c2-4490-bb82-0035e2e372d6 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:36.319377 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:36.330505 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15467c7-6b0b-402b-9fb1-54ff8cfdfc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:36.331119 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15467c7-6b0b-402b-9fb1-54ff8cfdfc7e None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:36.331538 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15467c7-6b0b-402b-9fb1-54ff8cfdfc7e None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:36.331821 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15467c7-6b0b-402b-9fb1-54ff8cfdfc7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:36.408450 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15467c7-6b0b-402b-9fb1-54ff8cfdfc7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:36.410157 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15467c7-6b0b-402b-9fb1-54ff8cfdfc7e None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:36.521401 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 536/1075] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:36:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 08 13:36:36.527428 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f685c72-7829-44c8-ad52-5ef72a344c97 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:36.634213 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:36.642869 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f685c72-7829-44c8-ad52-5ef72a344c97 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:36.680544 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f6dda6-440c-409b-99bb-8d2a595f2131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:36.681176 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6dda6-440c-409b-99bb-8d2a595f2131 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:36.681482 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6dda6-440c-409b-99bb-8d2a595f2131 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:36.681765 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6dda6-440c-409b-99bb-8d2a595f2131 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:36.693752 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f6dda6-440c-409b-99bb-8d2a595f2131 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:36.695423 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f6dda6-440c-409b-99bb-8d2a595f2131 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:36.712987 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-07f6dda6-440c-409b-99bb-8d2a595f2131 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:36:36.712987 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:36.712987 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:36.712987 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:36.712987 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:36.712987 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:36.712987 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:36.712987 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:36.712987 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:36.712987 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:36.712987 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:36.712987 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:36.712987 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:36:36.712987 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:36:36.712987 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:36:36.712987 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:36:36.719466 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:36.719466 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:36.719466 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:36.719466 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:36.719466 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:36.719466 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:36.719466 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:36.719466 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:36.719466 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:36.719466 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:36.719466 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:36.719466 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:36.719466 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:36.719466 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:36.719466 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:36.719466 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:36.719466 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:36:36.720720 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:36:36.720720 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:36:36.720720 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:36.720720 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 540/1076] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:36:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:36:36.722448 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f6dda6-440c-409b-99bb-8d2a595f2131 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:36.723081 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7d0a1-e9ab-41c7-8ad7-00438ac46e1b None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:36.723210 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7d0a1-e9ab-41c7-8ad7-00438ac46e1b None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:36.723515 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7d0a1-e9ab-41c7-8ad7-00438ac46e1b None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:36.725160 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 537/1077] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:36:36.730593 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e59eb-7176-4cab-ac87-5cfdcc4dbd5f None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:36.731030 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e59eb-7176-4cab-ac87-5cfdcc4dbd5f None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:36.731307 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e59eb-7176-4cab-ac87-5cfdcc4dbd5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:36.750929 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-5a0e59eb-7176-4cab-ac87-5cfdcc4dbd5f None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:36:36.752119 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-5a0e59eb-7176-4cab-ac87-5cfdcc4dbd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:36:36.775225 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:36.829045 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 538/1078] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:36:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:36:36.844735 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f6dda6-440c-409b-99bb-8d2a595f2131 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:36.885607 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d5051a-c145-4a7e-a717-68a590dc3571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:36.886636 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5051a-c145-4a7e-a717-68a590dc3571 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:36.887114 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5051a-c145-4a7e-a717-68a590dc3571 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:36.887581 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5051a-c145-4a7e-a717-68a590dc3571 None admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:36.888525 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d5051a-c145-4a7e-a717-68a590dc3571 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:36.889029 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d5051a-c145-4a7e-a717-68a590dc3571 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:36.890628 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d5051a-c145-4a7e-a717-68a590dc3571 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:36.904315 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 541/1079] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:36:37.105887 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e59eb-7176-4cab-ac87-5cfdcc4dbd5f None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:37.224551 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e59eb-7176-4cab-ac87-5cfdcc4dbd5f None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:37.262472 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9211cc9-8e4f-456a-b4e9-dd8611413972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:37.263110 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9211cc9-8e4f-456a-b4e9-dd8611413972 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:37.263392 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9211cc9-8e4f-456a-b4e9-dd8611413972 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:37.263667 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9211cc9-8e4f-456a-b4e9-dd8611413972 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:37.277979 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9211cc9-8e4f-456a-b4e9-dd8611413972 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:36:37.282597 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-f9211cc9-8e4f-456a-b4e9-dd8611413972 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:36:37.282597 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:37.282597 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:37.282597 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:37.282597 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:37.282597 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:37.282597 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:37.282597 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:37.282597 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:37.282597 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:37.282597 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:37.282597 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:37.282597 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:36:37.282597 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:36:37.282597 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:36:37.282597 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:36:37.284415 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:36:37.284415 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:36:37.284415 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:36:37.284415 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:36:37.284415 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:37.284415 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:37.284415 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:37.284415 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:37.284415 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:37.284415 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:37.284415 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:37.284415 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:37.284415 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:37.284415 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:37.284415 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:37.284415 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:37.286347 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:37.286347 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:37.286347 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:37.286347 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:37.286347 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:36:37.286347 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:36:37.286347 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:36:37.286347 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:36:37.286347 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:36:37.286347 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:36:37.286347 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:36:37.286347 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:36:37.289162 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 539/1080] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 8 13:36:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:36:37.290276 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d5051a-c145-4a7e-a717-68a590dc3571 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:37.299782 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:37.404197 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d5051a-c145-4a7e-a717-68a590dc3571 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:37.452016 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415e0b2-e758-4262-907c-c037a697de5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:37.452616 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415e0b2-e758-4262-907c-c037a697de5d None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:37.452894 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415e0b2-e758-4262-907c-c037a697de5d None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:37.453164 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415e0b2-e758-4262-907c-c037a697de5d None admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:37.453942 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1415e0b2-e758-4262-907c-c037a697de5d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:37.454167 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1415e0b2-e758-4262-907c-c037a697de5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:37.455527 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1415e0b2-e758-4262-907c-c037a697de5d None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:37.465200 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 542/1081] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:36:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:37.471109 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9211cc9-8e4f-456a-b4e9-dd8611413972 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:37.491417 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:37.575428 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9211cc9-8e4f-456a-b4e9-dd8611413972 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:37.610593 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29aa26-e184-49cf-a95f-c3efa2027e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:37.611211 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29aa26-e184-49cf-a95f-c3efa2027e97 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:37.611489 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29aa26-e184-49cf-a95f-c3efa2027e97 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:37.611762 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29aa26-e184-49cf-a95f-c3efa2027e97 None admin] PATH_INFO: `/v3/users/205e91b62d0d48289b5dd3b58f9654a8` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:37.613870 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec29aa26-e184-49cf-a95f-c3efa2027e97 None admin] RBAC: Authorizing `identity:get_user(user_id=205e91b62d0d48289b5dd3b58f9654a8)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:37.615149 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec29aa26-e184-49cf-a95f-c3efa2027e97 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:37.616775 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 540/1082] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:36:37 2022] GET /identity/v3/users/205e91b62d0d48289b5dd3b58f9654a8 => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:36:37.622652 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415e0b2-e758-4262-907c-c037a697de5d None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:37.699514 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:37.735773 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415e0b2-e758-4262-907c-c037a697de5d None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:37.770082 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718f751-d042-493f-bbf8-74b6a904230b None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:37.770551 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718f751-d042-493f-bbf8-74b6a904230b None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:37.770678 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718f751-d042-493f-bbf8-74b6a904230b None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:37.771963 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 541/1083] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:36:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:36:37.775926 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c5410-3387-4102-af08-10bb83815a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:37.776563 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c5410-3387-4102-af08-10bb83815a7e None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:37.776844 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c5410-3387-4102-af08-10bb83815a7e None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:37.777118 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c5410-3387-4102-af08-10bb83815a7e None admin] PATH_INFO: `/v3/projects/1d01eba2858a45ee99de1c1518ed753a` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:37.777231 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88069a6-8ccb-44b4-8f26-0bbe4fc2281f None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:37.777535 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88069a6-8ccb-44b4-8f26-0bbe4fc2281f None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:37.777816 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88069a6-8ccb-44b4-8f26-0bbe4fc2281f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:37.778342 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175c5410-3387-4102-af08-10bb83815a7e None admin] RBAC: Authorizing `identity:get_project(project_id=1d01eba2858a45ee99de1c1518ed753a)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:37.779769 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175c5410-3387-4102-af08-10bb83815a7e None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:37.781536 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 543/1084] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:36:37 2022] GET /identity/v3/projects/1d01eba2858a45ee99de1c1518ed753a => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:36:37.787223 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c5410-3387-4102-af08-10bb83815a7e None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:37.798196 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-f88069a6-8ccb-44b4-8f26-0bbe4fc2281f None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:36:37.799400 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-f88069a6-8ccb-44b4-8f26-0bbe4fc2281f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:36:37.870193 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 542/1085] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:36:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:36:37.892295 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c5410-3387-4102-af08-10bb83815a7e None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:37.927648 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823b27e-fb36-4eab-9cb1-06e396f1abcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:37.928304 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823b27e-fb36-4eab-9cb1-06e396f1abcc None admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:37.928582 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823b27e-fb36-4eab-9cb1-06e396f1abcc None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:37.928858 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823b27e-fb36-4eab-9cb1-06e396f1abcc None admin] PATH_INFO: `/v3/projects/1d01eba2858a45ee99de1c1518ed753a/users/205e91b62d0d48289b5dd3b58f9654a8/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:37.930775 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3823b27e-fb36-4eab-9cb1-06e396f1abcc None admin] RBAC: Authorizing `identity:create_grant(project_id=1d01eba2858a45ee99de1c1518ed753a, user_id=205e91b62d0d48289b5dd3b58f9654a8, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:37.932196 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3823b27e-fb36-4eab-9cb1-06e396f1abcc None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:37.935982 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:37.948398 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 544/1086] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Sep 8 13:36:37 2022] PUT /identity/v3/projects/1d01eba2858a45ee99de1c1518ed753a/users/205e91b62d0d48289b5dd3b58f9654a8/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:36:38.153777 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88069a6-8ccb-44b4-8f26-0bbe4fc2281f None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:38.170454 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:38.260051 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88069a6-8ccb-44b4-8f26-0bbe4fc2281f None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:38.301732 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819dd8e-76bf-4493-8c40-27d49ed93753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:38.302366 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819dd8e-76bf-4493-8c40-27d49ed93753 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:38.302644 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819dd8e-76bf-4493-8c40-27d49ed93753 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:38.302915 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819dd8e-76bf-4493-8c40-27d49ed93753 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:38.314103 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819dd8e-76bf-4493-8c40-27d49ed93753 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:36:38.320199 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-a819dd8e-76bf-4493-8c40-27d49ed93753 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 13:36:38.320199 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:38.320199 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:38.320199 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:38.320199 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:38.320199 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:38.320199 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:38.320199 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:38.320199 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:38.320199 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:38.320199 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:38.320199 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:38.320199 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:36:38.320199 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:36:38.320199 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:36:38.320199 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:36:38.321200 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:36:38.321200 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:36:38.321200 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:36:38.321200 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:36:38.321200 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:38.321200 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:38.321200 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:38.321200 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:38.321200 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:38.321200 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:38.321200 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:38.321200 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:38.321200 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:38.321200 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:38.321200 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:38.321200 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:38.322485 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:38.322485 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:38.322485 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:38.322485 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:38.322485 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:36:38.322485 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:36:38.322485 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:36:38.322485 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:36:38.322485 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:36:38.322485 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:36:38.322485 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 08 13:36:38.322485 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:36:38.322485 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 543/1087] 10.222.0.69 () {56 vars in 1120 bytes} [Thu Sep 8 13:36:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:36:38.327449 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823b27e-fb36-4eab-9cb1-06e396f1abcc None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:38.437553 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823b27e-fb36-4eab-9cb1-06e396f1abcc None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:38.474936 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a07560-b65a-4586-865b-a0f78eb2d18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:38.475544 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a07560-b65a-4586-865b-a0f78eb2d18c None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:38.475824 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a07560-b65a-4586-865b-a0f78eb2d18c None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:38.476095 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a07560-b65a-4586-865b-a0f78eb2d18c None admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:38.476759 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a07560-b65a-4586-865b-a0f78eb2d18c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:38.477062 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a07560-b65a-4586-865b-a0f78eb2d18c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:38.478477 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a07560-b65a-4586-865b-a0f78eb2d18c None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:38.487099 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 545/1088] 10.222.0.69 () {56 vars in 1115 bytes} [Thu Sep 8 13:36:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:38.493098 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819dd8e-76bf-4493-8c40-27d49ed93753 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:38.574029 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:38.601628 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819dd8e-76bf-4493-8c40-27d49ed93753 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:38.637557 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627c6c9-8f60-4aaf-a552-d8f3d04329e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:38.638196 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627c6c9-8f60-4aaf-a552-d8f3d04329e9 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:38.638476 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627c6c9-8f60-4aaf-a552-d8f3d04329e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:38.638746 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627c6c9-8f60-4aaf-a552-d8f3d04329e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:38.650724 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627c6c9-8f60-4aaf-a552-d8f3d04329e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:38.652171 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627c6c9-8f60-4aaf-a552-d8f3d04329e9 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:38.668169 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-4627c6c9-8f60-4aaf-a552-d8f3d04329e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:36:38.668169 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:38.668169 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:38.668169 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:38.668169 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:38.668169 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:38.668169 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:38.668169 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:38.668169 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:38.668169 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:38.668169 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:38.668169 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:38.668169 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:36:38.668169 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:36:38.668169 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:36:38.668169 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:36:38.674558 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:38.674558 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:38.674558 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:38.674558 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:38.674558 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:38.674558 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:38.674558 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:38.674558 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:38.674558 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:38.674558 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:38.674558 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:38.674558 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:38.674558 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:38.674558 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:38.674558 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:38.674558 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:38.674558 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:36:38.675732 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:36:38.675732 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:36:38.675732 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:36:38.675732 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 544/1089] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:36:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:36:38.676017 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a07560-b65a-4586-865b-a0f78eb2d18c None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:38.737883 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:38.781891 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a07560-b65a-4586-865b-a0f78eb2d18c None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:38.817896 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d0e971-391a-4d89-9241-4ccc4267c047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:38.818512 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0e971-391a-4d89-9241-4ccc4267c047 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:38.818794 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0e971-391a-4d89-9241-4ccc4267c047 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:38.819069 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d0e971-391a-4d89-9241-4ccc4267c047 None admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:38.819720 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d0e971-391a-4d89-9241-4ccc4267c047 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:38.820024 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d0e971-391a-4d89-9241-4ccc4267c047 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:38.821459 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d0e971-391a-4d89-9241-4ccc4267c047 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:38.835969 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 546/1090] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:38.842067 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627c6c9-8f60-4aaf-a552-d8f3d04329e9 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:38.943471 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627c6c9-8f60-4aaf-a552-d8f3d04329e9 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:38.969260 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:38.979275 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cab6a3-3a72-4ea2-8fcc-b3c9d382c239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:38.980000 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cab6a3-3a72-4ea2-8fcc-b3c9d382c239 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:38.980336 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cab6a3-3a72-4ea2-8fcc-b3c9d382c239 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:38.980662 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cab6a3-3a72-4ea2-8fcc-b3c9d382c239 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:38.988304 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cab6a3-3a72-4ea2-8fcc-b3c9d382c239 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:38.989703 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cab6a3-3a72-4ea2-8fcc-b3c9d382c239 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:39.000691 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-61cab6a3-3a72-4ea2-8fcc-b3c9d382c239 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:36:39.000691 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:39.000691 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:39.000691 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:39.000691 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:39.000691 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:39.000691 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:39.000691 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:39.000691 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:39.000691 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:39.000691 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:39.000691 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:39.000691 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:36:39.000691 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:36:39.000691 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:36:39.000691 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:36:39.001722 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:39.001722 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:39.001722 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:36:39.001722 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:36:39.001722 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:36:39.001722 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:36:39.001722 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:39.001722 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:39.001722 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:39.001722 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:39.001722 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:39.001722 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:39.001722 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:39.001722 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:39.001722 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:39.001722 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:39.001722 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:39.001722 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:39.002668 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:39.002668 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:39.002668 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:36:39.002668 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:36:39.002668 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:36:39.002668 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:36:39.002668 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:36:39.002668 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:36:39.002668 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 08 13:36:39.002668 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:36:39.005526 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 545/1091] 10.222.0.69 () {56 vars in 1093 bytes} [Thu Sep 8 13:36:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:36:39.007627 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d0e971-391a-4d89-9241-4ccc4267c047 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:39.143612 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d0e971-391a-4d89-9241-4ccc4267c047 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:39.165007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:39.183723 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff31bfc8-f8a0-49ac-a897-d74ec87d9168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:39.184332 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31bfc8-f8a0-49ac-a897-d74ec87d9168 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:39.184611 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31bfc8-f8a0-49ac-a897-d74ec87d9168 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:39.184883 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31bfc8-f8a0-49ac-a897-d74ec87d9168 None admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:39.185651 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff31bfc8-f8a0-49ac-a897-d74ec87d9168 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:39.185969 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff31bfc8-f8a0-49ac-a897-d74ec87d9168 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:39.187399 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff31bfc8-f8a0-49ac-a897-d74ec87d9168 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:39.205773 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 547/1092] 10.222.0.69 () {56 vars in 1133 bytes} [Thu Sep 8 13:36:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:39.212213 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cab6a3-3a72-4ea2-8fcc-b3c9d382c239 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:39.320063 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cab6a3-3a72-4ea2-8fcc-b3c9d382c239 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:39.354764 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c383f-4ae0-47fb-967d-b84fb0688504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:39.355359 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c383f-4ae0-47fb-967d-b84fb0688504 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:39.355632 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c383f-4ae0-47fb-967d-b84fb0688504 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:39.355902 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c383f-4ae0-47fb-967d-b84fb0688504 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:39.413797 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:39.429831 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c383f-4ae0-47fb-967d-b84fb0688504 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:39.431547 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c383f-4ae0-47fb-967d-b84fb0688504 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:39.547730 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 546/1093] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:36:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 13:36:39.554298 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff31bfc8-f8a0-49ac-a897-d74ec87d9168 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:39.667522 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff31bfc8-f8a0-49ac-a897-d74ec87d9168 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:39.703199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c1b6cf-4d1a-403d-9543-a87658439c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:39.703843 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1b6cf-4d1a-403d-9543-a87658439c34 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:39.704079 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1b6cf-4d1a-403d-9543-a87658439c34 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:39.704343 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c1b6cf-4d1a-403d-9543-a87658439c34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:39.714895 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c1b6cf-4d1a-403d-9543-a87658439c34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:39.716326 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c1b6cf-4d1a-403d-9543-a87658439c34 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:39.731145 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-28c1b6cf-4d1a-403d-9543-a87658439c34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:36:39.731145 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:39.731145 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:39.731145 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:39.731145 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:39.731145 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:39.731145 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:39.731145 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:39.731145 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:39.731145 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:39.731145 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:39.731145 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:39.731145 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:36:39.731145 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:36:39.731145 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:36:39.731145 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:36:39.732340 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:39.732340 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:39.732340 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:39.732340 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:39.732340 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:39.732340 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:39.732340 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:39.732340 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:39.732340 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:39.732340 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:39.732340 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:39.732340 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:39.732340 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:39.732340 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:39.732340 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:39.732340 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:39.732340 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:36:39.733666 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:36:39.733666 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:36:39.733666 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:39.733666 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 548/1094] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:36:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:36:39.738463 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c383f-4ae0-47fb-967d-b84fb0688504 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:39.834050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:39.851053 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c383f-4ae0-47fb-967d-b84fb0688504 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:39.887883 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d2336-9915-486b-a27a-8bfe248abd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:39.888486 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d2336-9915-486b-a27a-8bfe248abd2e None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:39.888756 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d2336-9915-486b-a27a-8bfe248abd2e None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:39.889022 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d2336-9915-486b-a27a-8bfe248abd2e None admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:39.889687 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d2336-9915-486b-a27a-8bfe248abd2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:39.889993 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d2336-9915-486b-a27a-8bfe248abd2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:39.891339 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d2336-9915-486b-a27a-8bfe248abd2e None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:39.904092 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 547/1095] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:39.909917 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c1b6cf-4d1a-403d-9543-a87658439c34 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:39.938255 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:40.013248 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c1b6cf-4d1a-403d-9543-a87658439c34 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:40.051345 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e954b5dd-3983-4886-9e77-073ba610b522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:40.051999 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954b5dd-3983-4886-9e77-073ba610b522 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:40.052277 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954b5dd-3983-4886-9e77-073ba610b522 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:40.052552 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954b5dd-3983-4886-9e77-073ba610b522 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:40.060354 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e954b5dd-3983-4886-9e77-073ba610b522 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:40.061882 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e954b5dd-3983-4886-9e77-073ba610b522 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:40.074306 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-e954b5dd-3983-4886-9e77-073ba610b522 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:36:40.074306 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:40.074306 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:40.074306 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:40.074306 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:40.074306 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:40.074306 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:40.074306 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:40.074306 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:40.074306 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:40.074306 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:40.074306 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:40.074306 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:36:40.074306 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:36:40.074306 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:36:40.075292 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:36:40.075292 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:40.075292 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:40.075292 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:40.075292 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:40.075292 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:40.075292 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:40.075292 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:40.075292 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:40.075292 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:40.075292 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:40.075292 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:40.075292 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:40.075292 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:40.075292 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:40.075292 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:40.075292 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:40.076192 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:36:40.076192 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:36:40.076192 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:36:40.076192 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:36:40.076192 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:36:40.076192 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:36:40.076192 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:36:40.076192 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:40.076192 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 549/1096] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:36:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:36:40.081391 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d2336-9915-486b-a27a-8bfe248abd2e None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:40.160302 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8b5dd-81f9-4d83-bfc5-5a935b3cb53c None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:40.160592 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8b5dd-81f9-4d83-bfc5-5a935b3cb53c None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:40.160757 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8b5dd-81f9-4d83-bfc5-5a935b3cb53c None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:40.162785 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 550/1097] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:36:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:36:40.167893 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4024fea6-be1e-4b54-acda-1a43e8025b36 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:40.168173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4024fea6-be1e-4b54-acda-1a43e8025b36 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:40.168449 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4024fea6-be1e-4b54-acda-1a43e8025b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:40.187206 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-4024fea6-be1e-4b54-acda-1a43e8025b36 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:36:40.188126 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d2336-9915-486b-a27a-8bfe248abd2e None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:40.188415 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-4024fea6-be1e-4b54-acda-1a43e8025b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:36:40.228172 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f4089-7161-41d2-8769-ad9bac6dd469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:40.228829 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f4089-7161-41d2-8769-ad9bac6dd469 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:40.229056 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f4089-7161-41d2-8769-ad9bac6dd469 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:40.229328 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f4089-7161-41d2-8769-ad9bac6dd469 None admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:40.230054 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f4089-7161-41d2-8769-ad9bac6dd469 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:40.230361 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f4089-7161-41d2-8769-ad9bac6dd469 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:40.231790 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f4089-7161-41d2-8769-ad9bac6dd469 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:40.249400 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 548/1098] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 8 13:36:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:40.250520 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f4089-7161-41d2-8769-ad9bac6dd469 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:40.259790 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:40.269606 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 551/1099] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:36:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:36:40.356257 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f4089-7161-41d2-8769-ad9bac6dd469 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:40.390121 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f808e7e-a858-471d-be19-e8dcb0695984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:40.390716 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f808e7e-a858-471d-be19-e8dcb0695984 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:40.390990 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f808e7e-a858-471d-be19-e8dcb0695984 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:40.391253 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f808e7e-a858-471d-be19-e8dcb0695984 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:40.391964 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f808e7e-a858-471d-be19-e8dcb0695984 None admin] RBAC: Adding query filter params (role.id=2cc89a32b68046feacb991d263b7cb75, scope.project.id=88de9f1470c6415b97866ad5a3256ef2, user.id=c95448c1b8b1466cae37fda5c713d53f) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:40.392266 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f808e7e-a858-471d-be19-e8dcb0695984 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:40.393700 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f808e7e-a858-471d-be19-e8dcb0695984 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:40.399990 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 549/1100] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 8 13:36:40 2022] GET /identity/v3/role_assignments?user.id=c95448c1b8b1466cae37fda5c713d53f&scope.project.id=88de9f1470c6415b97866ad5a3256ef2&role.id=2cc89a32b68046feacb991d263b7cb75 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:36:40.557937 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4024fea6-be1e-4b54-acda-1a43e8025b36 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:40.577267 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:40.677137 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4024fea6-be1e-4b54-acda-1a43e8025b36 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:40.714201 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ecca1a-00bd-4ee4-ad49-2b78a481cda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:40.714821 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ecca1a-00bd-4ee4-ad49-2b78a481cda3 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:40.715099 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ecca1a-00bd-4ee4-ad49-2b78a481cda3 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:40.715370 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ecca1a-00bd-4ee4-ad49-2b78a481cda3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:40.730899 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ecca1a-00bd-4ee4-ad49-2b78a481cda3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:36:40.735799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-52ecca1a-00bd-4ee4-ad49-2b78a481cda3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:36:40.735799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:36:40.735799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:36:40.735799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:36:40.735799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:36:40.735799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:36:40.735799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:36:40.735799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:36:40.735799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:36:40.735799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:36:40.735799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:36:40.735799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:36:40.735799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:36:40.735799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:36:40.735799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:36:40.735799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:36:40.736802 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:36:40.736802 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:36:40.736802 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:36:40.736802 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:36:40.736802 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:36:40.736802 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:36:40.736802 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:36:40.736802 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:36:40.736802 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:36:40.736802 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:36:40.736802 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:36:40.736802 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:36:40.736802 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:36:40.736802 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:36:40.736802 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:36:40.736802 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:36:40.738542 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:36:40.738542 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:36:40.738542 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:36:40.738542 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:36:40.738542 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:36:40.738542 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:36:40.738542 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:36:40.738542 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:36:40.738542 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:36:40.738542 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:36:40.738542 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:36:40.738542 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:36:40.739369 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 552/1101] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 8 13:36:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:36:40.743960 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f808e7e-a858-471d-be19-e8dcb0695984 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:40.819708 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:40.853591 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f808e7e-a858-471d-be19-e8dcb0695984 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:40.896643 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8eba72-ef73-4dd0-99bc-4d354f40e3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:40.897257 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8eba72-ef73-4dd0-99bc-4d354f40e3ac None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:40.897563 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8eba72-ef73-4dd0-99bc-4d354f40e3ac None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:40.897871 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8eba72-ef73-4dd0-99bc-4d354f40e3ac None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:40.898528 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8eba72-ef73-4dd0-99bc-4d354f40e3ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:40.898831 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8eba72-ef73-4dd0-99bc-4d354f40e3ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:40.900193 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8eba72-ef73-4dd0-99bc-4d354f40e3ac None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:40.910548 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 550/1102] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:36:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:40.916750 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ecca1a-00bd-4ee4-ad49-2b78a481cda3 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:40.999754 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:41.023133 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ecca1a-00bd-4ee4-ad49-2b78a481cda3 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:41.060199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef8311-fb15-493b-92cb-2a658b144259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:41.060828 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef8311-fb15-493b-92cb-2a658b144259 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:41.061102 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef8311-fb15-493b-92cb-2a658b144259 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:41.061385 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef8311-fb15-493b-92cb-2a658b144259 None admin] PATH_INFO: `/v3/users/205e91b62d0d48289b5dd3b58f9654a8` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:41.062533 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef8311-fb15-493b-92cb-2a658b144259 None admin] RBAC: Authorizing `identity:get_user(user_id=205e91b62d0d48289b5dd3b58f9654a8)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:41.064018 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef8311-fb15-493b-92cb-2a658b144259 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:41.065641 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 553/1103] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:36:40 2022] GET /identity/v3/users/205e91b62d0d48289b5dd3b58f9654a8 => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:41.071886 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8eba72-ef73-4dd0-99bc-4d354f40e3ac None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:41.187767 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8eba72-ef73-4dd0-99bc-4d354f40e3ac None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:41.218975 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:41.225248 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683ccf2-47ad-4a71-b798-ba59a7965fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:41.226216 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683ccf2-47ad-4a71-b798-ba59a7965fc2 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:41.226757 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683ccf2-47ad-4a71-b798-ba59a7965fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:41.227266 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683ccf2-47ad-4a71-b798-ba59a7965fc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:41.307184 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683ccf2-47ad-4a71-b798-ba59a7965fc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:41.308636 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683ccf2-47ad-4a71-b798-ba59a7965fc2 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:41.411718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 551/1104] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:36:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 13:36:41.417697 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef8311-fb15-493b-92cb-2a658b144259 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:41.526498 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef8311-fb15-493b-92cb-2a658b144259 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:41.562082 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702edcb-7b3e-4ef4-a6c3-742a2c96adc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:41.562713 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702edcb-7b3e-4ef4-a6c3-742a2c96adc2 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:41.562994 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702edcb-7b3e-4ef4-a6c3-742a2c96adc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:41.563268 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702edcb-7b3e-4ef4-a6c3-742a2c96adc2 None admin] PATH_INFO: `/v3/projects/1d01eba2858a45ee99de1c1518ed753a` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:41.564375 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702edcb-7b3e-4ef4-a6c3-742a2c96adc2 None admin] RBAC: Authorizing `identity:get_project(project_id=1d01eba2858a45ee99de1c1518ed753a)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:41.565875 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702edcb-7b3e-4ef4-a6c3-742a2c96adc2 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:41.567520 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 554/1105] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:36:41 2022] GET /identity/v3/projects/1d01eba2858a45ee99de1c1518ed753a => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:41.573766 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683ccf2-47ad-4a71-b798-ba59a7965fc2 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:41.605002 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:41.678472 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683ccf2-47ad-4a71-b798-ba59a7965fc2 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:41.712988 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4fb0fd-356b-40ec-8cd1-bbf677ea7bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:41.713613 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fb0fd-356b-40ec-8cd1-bbf677ea7bdb None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:41.713894 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fb0fd-356b-40ec-8cd1-bbf677ea7bdb None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:41.714169 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fb0fd-356b-40ec-8cd1-bbf677ea7bdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:41.714892 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4fb0fd-356b-40ec-8cd1-bbf677ea7bdb None admin] RBAC: Adding query filter params (role.id=9c76f398c9e04caeab83842e70eb824b, scope.project.id=1d01eba2858a45ee99de1c1518ed753a, user.id=205e91b62d0d48289b5dd3b58f9654a8) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:41.715201 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4fb0fd-356b-40ec-8cd1-bbf677ea7bdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:41.716619 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4fb0fd-356b-40ec-8cd1-bbf677ea7bdb None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:41.723285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 552/1106] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 8 13:36:41 2022] GET /identity/v3/role_assignments?user.id=205e91b62d0d48289b5dd3b58f9654a8&scope.project.id=1d01eba2858a45ee99de1c1518ed753a&role.id=9c76f398c9e04caeab83842e70eb824b => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:43.987061 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3870db-0d18-410a-92f7-2d97886377cd None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:43.988107 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3870db-0d18-410a-92f7-2d97886377cd None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:43.988107 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3870db-0d18-410a-92f7-2d97886377cd None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:43.989569 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 555/1107] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:36:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:36:43.995378 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56fbb0-de0b-437e-a87e-3ca78db6b046 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:43.995848 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56fbb0-de0b-437e-a87e-3ca78db6b046 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:43.995968 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56fbb0-de0b-437e-a87e-3ca78db6b046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:44.015065 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-2e56fbb0-de0b-437e-a87e-3ca78db6b046 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:36:44.016270 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-2e56fbb0-de0b-437e-a87e-3ca78db6b046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:36:44.087790 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 553/1108] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:36:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:36:44.356344 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3870db-0d18-410a-92f7-2d97886377cd None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:44.373707 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:44.460753 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3870db-0d18-410a-92f7-2d97886377cd None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:44.496191 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999c318-6fe9-4e6e-80de-f24e7ddcad30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:44.496809 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999c318-6fe9-4e6e-80de-f24e7ddcad30 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:44.497083 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999c318-6fe9-4e6e-80de-f24e7ddcad30 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:44.497351 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999c318-6fe9-4e6e-80de-f24e7ddcad30 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:44.498479 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999c318-6fe9-4e6e-80de-f24e7ddcad30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:44.499895 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7999c318-6fe9-4e6e-80de-f24e7ddcad30 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:44.501470 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 556/1109] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:36:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:44.507662 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56fbb0-de0b-437e-a87e-3ca78db6b046 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:44.534765 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:44.609333 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56fbb0-de0b-437e-a87e-3ca78db6b046 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:44.643242 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4774de-c152-4a24-8c3c-b93adb69d969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:44.644523 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4774de-c152-4a24-8c3c-b93adb69d969 None admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:44.644808 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4774de-c152-4a24-8c3c-b93adb69d969 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:44.645075 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4774de-c152-4a24-8c3c-b93adb69d969 None admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:44.645856 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4774de-c152-4a24-8c3c-b93adb69d969 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:44.647291 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4774de-c152-4a24-8c3c-b93adb69d969 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:44.668916 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 554/1110] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Sep 8 13:36:44 2022] POST /identity/v3/users => generated 286 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:36:46.974213 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d320b1-f12b-45cd-984d-22f3a5554d8f None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:46.974800 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d320b1-f12b-45cd-984d-22f3a5554d8f None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:46.974800 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d320b1-f12b-45cd-984d-22f3a5554d8f None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:46.976086 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 557/1111] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:36:46.981632 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64eb50-8b97-49bb-b687-207709901366 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:46.982067 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64eb50-8b97-49bb-b687-207709901366 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:46.982159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64eb50-8b97-49bb-b687-207709901366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:47.002588 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-cc64eb50-8b97-49bb-b687-207709901366 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:36:47.003839 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-cc64eb50-8b97-49bb-b687-207709901366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:36:47.073377 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 555/1112] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:36:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:36:47.343605 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d320b1-f12b-45cd-984d-22f3a5554d8f None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:47.427678 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:47.448602 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d320b1-f12b-45cd-984d-22f3a5554d8f None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:47.485722 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9466f-f2b8-4340-8ce7-621a3621d223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:47.486350 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9466f-f2b8-4340-8ce7-621a3621d223 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:47.486630 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9466f-f2b8-4340-8ce7-621a3621d223 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:47.486899 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d9466f-f2b8-4340-8ce7-621a3621d223 None admin] PATH_INFO: `/v3/roles/a0b9865e737f48f2975da1bb8cb386b7` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:47.488960 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d9466f-f2b8-4340-8ce7-621a3621d223 None admin] RBAC: Authorizing `identity:get_role(role_id=a0b9865e737f48f2975da1bb8cb386b7)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:47.490353 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d9466f-f2b8-4340-8ce7-621a3621d223 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:47.491688 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 558/1113] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:36:47 2022] GET /identity/v3/roles/a0b9865e737f48f2975da1bb8cb386b7 => generated 223 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:47.497815 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64eb50-8b97-49bb-b687-207709901366 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:47.513058 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:47.607971 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64eb50-8b97-49bb-b687-207709901366 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:47.642088 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a697c8-f0b6-4390-9081-83235aa76340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:47.642711 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a697c8-f0b6-4390-9081-83235aa76340 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:47.642984 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a697c8-f0b6-4390-9081-83235aa76340 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:47.643249 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a697c8-f0b6-4390-9081-83235aa76340 None admin] PATH_INFO: `/v3/users/63db1cc2f6b54474a4b57428a839a39b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:47.656933 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a697c8-f0b6-4390-9081-83235aa76340 None admin] RBAC: Authorizing `identity:get_user(user_id=63db1cc2f6b54474a4b57428a839a39b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:47.658386 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a697c8-f0b6-4390-9081-83235aa76340 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:47.660711 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 556/1114] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:36:47 2022] GET /identity/v3/users/63db1cc2f6b54474a4b57428a839a39b => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:47.666601 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9466f-f2b8-4340-8ce7-621a3621d223 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:47.768433 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d9466f-f2b8-4340-8ce7-621a3621d223 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:47.803593 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37deae-5ae7-4022-a940-3f2473192cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:47.804188 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37deae-5ae7-4022-a940-3f2473192cb5 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:47.804468 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37deae-5ae7-4022-a940-3f2473192cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:47.804739 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37deae-5ae7-4022-a940-3f2473192cb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:47.824125 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:47.874520 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37deae-5ae7-4022-a940-3f2473192cb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:47.875885 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37deae-5ae7-4022-a940-3f2473192cb5 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:47.975400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 559/1115] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:36:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 13:36:47.981401 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a697c8-f0b6-4390-9081-83235aa76340 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:48.051200 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:48.083243 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a697c8-f0b6-4390-9081-83235aa76340 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:48.119213 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a4931-8bda-48ef-ad67-76424ec8f452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:48.119827 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a4931-8bda-48ef-ad67-76424ec8f452 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:48.120106 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a4931-8bda-48ef-ad67-76424ec8f452 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:48.120374 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a4931-8bda-48ef-ad67-76424ec8f452 None admin] PATH_INFO: `/v3/projects/1d01eba2858a45ee99de1c1518ed753a` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:48.121512 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a4931-8bda-48ef-ad67-76424ec8f452 None admin] RBAC: Authorizing `identity:get_project(project_id=1d01eba2858a45ee99de1c1518ed753a)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:48.122952 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a4931-8bda-48ef-ad67-76424ec8f452 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:48.124647 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 557/1116] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:36:47 2022] GET /identity/v3/projects/1d01eba2858a45ee99de1c1518ed753a => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:48.131419 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37deae-5ae7-4022-a940-3f2473192cb5 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:48.183271 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:48.234521 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37deae-5ae7-4022-a940-3f2473192cb5 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:48.270326 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0bd7e-f5f0-475d-998f-28c2e9c29283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:48.270926 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0bd7e-f5f0-475d-998f-28c2e9c29283 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:48.271203 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0bd7e-f5f0-475d-998f-28c2e9c29283 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:48.271470 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0bd7e-f5f0-475d-998f-28c2e9c29283 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:48.272188 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a0bd7e-f5f0-475d-998f-28c2e9c29283 None admin] RBAC: Adding query filter params (role.id=a0b9865e737f48f2975da1bb8cb386b7, scope.project.id=1d01eba2858a45ee99de1c1518ed753a, user.id=63db1cc2f6b54474a4b57428a839a39b) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:48.272486 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a0bd7e-f5f0-475d-998f-28c2e9c29283 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:48.273945 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a0bd7e-f5f0-475d-998f-28c2e9c29283 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:48.279782 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 560/1117] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 8 13:36:48 2022] GET /identity/v3/role_assignments?user.id=63db1cc2f6b54474a4b57428a839a39b&scope.project.id=1d01eba2858a45ee99de1c1518ed753a&role.id=a0b9865e737f48f2975da1bb8cb386b7 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:50.458190 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4561f4c8-419f-4594-84f9-f17b7df335e3 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:50.458751 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4561f4c8-419f-4594-84f9-f17b7df335e3 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:50.458751 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4561f4c8-419f-4594-84f9-f17b7df335e3 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:50.460067 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 558/1118] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:36:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:36:50.465635 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b0272-bb35-4d45-b303-69ff214c7238 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:50.466133 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b0272-bb35-4d45-b303-69ff214c7238 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:50.466233 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b0272-bb35-4d45-b303-69ff214c7238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:50.485053 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-ea6b0272-bb35-4d45-b303-69ff214c7238 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:36:50.486286 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-ea6b0272-bb35-4d45-b303-69ff214c7238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:36:50.556149 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 561/1119] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:36:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:36:50.825278 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4561f4c8-419f-4594-84f9-f17b7df335e3 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:50.928515 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4561f4c8-419f-4594-84f9-f17b7df335e3 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:50.967023 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50067e0-a677-4a42-966a-23417e69cb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:50.967651 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50067e0-a677-4a42-966a-23417e69cb97 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:50.967925 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50067e0-a677-4a42-966a-23417e69cb97 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:50.968190 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50067e0-a677-4a42-966a-23417e69cb97 None admin] PATH_INFO: `/v3/roles/a0b9865e737f48f2975da1bb8cb386b7` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:50.969602 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50067e0-a677-4a42-966a-23417e69cb97 None admin] RBAC: Authorizing `identity:get_role(role_id=a0b9865e737f48f2975da1bb8cb386b7)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:50.970961 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50067e0-a677-4a42-966a-23417e69cb97 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:50.973445 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 559/1120] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:36:50 2022] GET /identity/v3/roles/a0b9865e737f48f2975da1bb8cb386b7 => generated 223 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:50.979735 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b0272-bb35-4d45-b303-69ff214c7238 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:51.025325 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:51.079593 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b0272-bb35-4d45-b303-69ff214c7238 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:51.113892 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b91de-48c9-4673-a819-629dc7549624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:51.114516 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b91de-48c9-4673-a819-629dc7549624 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:51.114794 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b91de-48c9-4673-a819-629dc7549624 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:51.115066 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b91de-48c9-4673-a819-629dc7549624 None admin] PATH_INFO: `/v3/users/63db1cc2f6b54474a4b57428a839a39b` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:51.116178 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4b91de-48c9-4673-a819-629dc7549624 None admin] RBAC: Authorizing `identity:get_user(user_id=63db1cc2f6b54474a4b57428a839a39b)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:51.117628 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4b91de-48c9-4673-a819-629dc7549624 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:51.119211 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 562/1121] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:36:50 2022] GET /identity/v3/users/63db1cc2f6b54474a4b57428a839a39b => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:51.125724 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50067e0-a677-4a42-966a-23417e69cb97 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:51.137355 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:51.238134 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50067e0-a677-4a42-966a-23417e69cb97 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:51.277546 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0845891c-3d5c-4e09-8406-f04db1f157c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:51.278392 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845891c-3d5c-4e09-8406-f04db1f157c4 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:51.278541 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845891c-3d5c-4e09-8406-f04db1f157c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:51.278737 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0845891c-3d5c-4e09-8406-f04db1f157c4 None admin] PATH_INFO: `/v3/projects/1d01eba2858a45ee99de1c1518ed753a` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:51.280005 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0845891c-3d5c-4e09-8406-f04db1f157c4 None admin] RBAC: Authorizing `identity:get_project(project_id=1d01eba2858a45ee99de1c1518ed753a)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:51.281503 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0845891c-3d5c-4e09-8406-f04db1f157c4 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:51.283241 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 560/1122] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:36:51 2022] GET /identity/v3/projects/1d01eba2858a45ee99de1c1518ed753a => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:51.290427 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b91de-48c9-4673-a819-629dc7549624 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:51.395319 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b91de-48c9-4673-a819-629dc7549624 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:51.407899 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:51.429923 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ecdb0-cbe9-4da4-8cd1-0b089cf456cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:51.430826 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ecdb0-cbe9-4da4-8cd1-0b089cf456cd None admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:51.430826 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ecdb0-cbe9-4da4-8cd1-0b089cf456cd None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:51.431094 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ecdb0-cbe9-4da4-8cd1-0b089cf456cd None admin] PATH_INFO: `/v3/projects/1d01eba2858a45ee99de1c1518ed753a/users/63db1cc2f6b54474a4b57428a839a39b/roles/a0b9865e737f48f2975da1bb8cb386b7` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:51.433170 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ecdb0-cbe9-4da4-8cd1-0b089cf456cd None admin] RBAC: Authorizing `identity:create_grant(project_id=1d01eba2858a45ee99de1c1518ed753a, user_id=63db1cc2f6b54474a4b57428a839a39b, role_id=a0b9865e737f48f2975da1bb8cb386b7)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:51.434633 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ecdb0-cbe9-4da4-8cd1-0b089cf456cd None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:51.447964 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 563/1123] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Sep 8 13:36:51 2022] PUT /identity/v3/projects/1d01eba2858a45ee99de1c1518ed753a/users/63db1cc2f6b54474a4b57428a839a39b/roles/a0b9865e737f48f2975da1bb8cb386b7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:36:53.779846 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2d8a1-6842-48d8-8327-fec2ecbea522 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:53.780442 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2d8a1-6842-48d8-8327-fec2ecbea522 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:53.780442 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2d8a1-6842-48d8-8327-fec2ecbea522 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:53.781902 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 561/1124] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:36:53.789155 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d2d8a-2a3d-46ed-8126-d417b4766a64 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:53.789774 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d2d8a-2a3d-46ed-8126-d417b4766a64 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:53.789774 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d2d8a-2a3d-46ed-8126-d417b4766a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:53.809989 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-317d2d8a-2a3d-46ed-8126-d417b4766a64 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:36:53.811210 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-317d2d8a-2a3d-46ed-8126-d417b4766a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:36:53.889532 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 564/1125] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:36:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:36:54.172660 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2d8a1-6842-48d8-8327-fec2ecbea522 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:54.261575 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:54.291617 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea2d8a1-6842-48d8-8327-fec2ecbea522 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:54.328373 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df12c7-91a1-449e-b9a2-4c41d3adb075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:54.329036 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df12c7-91a1-449e-b9a2-4c41d3adb075 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:54.329320 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df12c7-91a1-449e-b9a2-4c41d3adb075 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:54.329632 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df12c7-91a1-449e-b9a2-4c41d3adb075 None admin] PATH_INFO: `/v3/roles/a0b9865e737f48f2975da1bb8cb386b7` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:54.331078 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df12c7-91a1-449e-b9a2-4c41d3adb075 None admin] RBAC: Authorizing `identity:get_role(role_id=a0b9865e737f48f2975da1bb8cb386b7)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:54.332452 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df12c7-91a1-449e-b9a2-4c41d3adb075 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:54.339508 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 562/1126] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:36:54 2022] GET /identity/v3/roles/a0b9865e737f48f2975da1bb8cb386b7 => generated 223 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:36:54.340266 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d2d8a-2a3d-46ed-8126-d417b4766a64 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:54.454437 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d2d8a-2a3d-46ed-8126-d417b4766a64 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:54.456055 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:54.497751 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b730a75c-010a-4d16-a239-ea34508e20e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:54.498390 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730a75c-010a-4d16-a239-ea34508e20e1 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:54.498671 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730a75c-010a-4d16-a239-ea34508e20e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:54.498947 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730a75c-010a-4d16-a239-ea34508e20e1 None admin] PATH_INFO: `/v3/users/63db1cc2f6b54474a4b57428a839a39b` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:54.500116 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b730a75c-010a-4d16-a239-ea34508e20e1 None admin] RBAC: Authorizing `identity:get_user(user_id=63db1cc2f6b54474a4b57428a839a39b)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:54.501593 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b730a75c-010a-4d16-a239-ea34508e20e1 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:54.503856 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 565/1127] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:36:54 2022] GET /identity/v3/users/63db1cc2f6b54474a4b57428a839a39b => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:54.510183 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df12c7-91a1-449e-b9a2-4c41d3adb075 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:54.626862 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df12c7-91a1-449e-b9a2-4c41d3adb075 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:54.664412 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813db32-d931-4688-8664-4b0360952e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:54.665271 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813db32-d931-4688-8664-4b0360952e34 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:54.665651 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813db32-d931-4688-8664-4b0360952e34 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:54.665993 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813db32-d931-4688-8664-4b0360952e34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:54.682285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:54.760552 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2813db32-d931-4688-8664-4b0360952e34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:54.763131 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2813db32-d931-4688-8664-4b0360952e34 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:54.935720 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 563/1128] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:36:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 08 13:36:54.942693 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b730a75c-010a-4d16-a239-ea34508e20e1 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:55.057088 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b730a75c-010a-4d16-a239-ea34508e20e1 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:55.095752 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1755315-ed6b-46b8-8b00-bc719ca36ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:55.096384 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1755315-ed6b-46b8-8b00-bc719ca36ff6 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:55.096824 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1755315-ed6b-46b8-8b00-bc719ca36ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:55.097097 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1755315-ed6b-46b8-8b00-bc719ca36ff6 None admin] PATH_INFO: `/v3/projects/1d01eba2858a45ee99de1c1518ed753a` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:55.098323 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1755315-ed6b-46b8-8b00-bc719ca36ff6 None admin] RBAC: Authorizing `identity:get_project(project_id=1d01eba2858a45ee99de1c1518ed753a)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:55.100050 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1755315-ed6b-46b8-8b00-bc719ca36ff6 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:55.101784 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 566/1129] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:36:54 2022] GET /identity/v3/projects/1d01eba2858a45ee99de1c1518ed753a => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:36:55.109187 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813db32-d931-4688-8664-4b0360952e34 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:55.187187 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:55.250993 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813db32-d931-4688-8664-4b0360952e34 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:55.294079 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feef049-bf7a-4ea4-ac2d-1df317a15c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:55.295077 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feef049-bf7a-4ea4-ac2d-1df317a15c43 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:55.295551 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feef049-bf7a-4ea4-ac2d-1df317a15c43 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:55.296026 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feef049-bf7a-4ea4-ac2d-1df317a15c43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:55.297348 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feef049-bf7a-4ea4-ac2d-1df317a15c43 None admin] RBAC: Adding query filter params (role.id=a0b9865e737f48f2975da1bb8cb386b7, scope.project.id=1d01eba2858a45ee99de1c1518ed753a, user.id=63db1cc2f6b54474a4b57428a839a39b) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:36:55.297931 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feef049-bf7a-4ea4-ac2d-1df317a15c43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:55.301175 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feef049-bf7a-4ea4-ac2d-1df317a15c43 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:55.312790 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 564/1130] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 8 13:36:55 2022] GET /identity/v3/role_assignments?user.id=63db1cc2f6b54474a4b57428a839a39b&scope.project.id=1d01eba2858a45ee99de1c1518ed753a&role.id=a0b9865e737f48f2975da1bb8cb386b7 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:57.622627 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2af26-7218-4aae-b515-d66fc6a97f47 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:57.623158 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2af26-7218-4aae-b515-d66fc6a97f47 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:57.623158 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2af26-7218-4aae-b515-d66fc6a97f47 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:57.624527 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 567/1131] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:36:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:36:57.630350 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789c646-5a3f-4ac1-8c71-7457b59e8ca1 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:57.630922 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789c646-5a3f-4ac1-8c71-7457b59e8ca1 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:57.630922 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789c646-5a3f-4ac1-8c71-7457b59e8ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:57.650146 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-b789c646-5a3f-4ac1-8c71-7457b59e8ca1 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:36:57.651355 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-b789c646-5a3f-4ac1-8c71-7457b59e8ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:36:57.736061 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 565/1132] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:36:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:36:58.012939 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb2af26-7218-4aae-b515-d66fc6a97f47 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:58.062095 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:58.129708 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb2af26-7218-4aae-b515-d66fc6a97f47 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:58.169055 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c5d1c-e7c3-4e5f-8f29-32ec6210f3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:58.169711 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c5d1c-e7c3-4e5f-8f29-32ec6210f3f1 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:58.170023 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c5d1c-e7c3-4e5f-8f29-32ec6210f3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:58.170306 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c5d1c-e7c3-4e5f-8f29-32ec6210f3f1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:58.171489 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c5d1c-e7c3-4e5f-8f29-32ec6210f3f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:58.172983 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c5d1c-e7c3-4e5f-8f29-32ec6210f3f1 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:58.174641 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 568/1133] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:36:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:36:58.183165 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789c646-5a3f-4ac1-8c71-7457b59e8ca1 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:36:58.223247 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:58.295542 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789c646-5a3f-4ac1-8c71-7457b59e8ca1 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:36:58.334814 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dbc7cd-b88e-45d6-a284-eb78773af2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:36:58.335458 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dbc7cd-b88e-45d6-a284-eb78773af2bc None admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:36:58.335757 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dbc7cd-b88e-45d6-a284-eb78773af2bc None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:36:58.336031 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dbc7cd-b88e-45d6-a284-eb78773af2bc None admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:36:58.336732 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dbc7cd-b88e-45d6-a284-eb78773af2bc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:36:58.338266 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dbc7cd-b88e-45d6-a284-eb78773af2bc None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:36:58.369011 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 566/1134] 10.222.0.69 () {60 vars in 1141 bytes} [Thu Sep 8 13:36:58 2022] POST /identity/v3/projects => generated 311 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:37:00.741526 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fd3d6-aa3c-43af-837e-3978e5a455d6 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:00.742074 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fd3d6-aa3c-43af-837e-3978e5a455d6 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:00.742074 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fd3d6-aa3c-43af-837e-3978e5a455d6 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:00.743403 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 569/1135] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:37:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:37:00.749433 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de613ba-8e65-419b-b47b-bdf1252f5f53 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:00.750024 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de613ba-8e65-419b-b47b-bdf1252f5f53 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:00.750024 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de613ba-8e65-419b-b47b-bdf1252f5f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:00.769633 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-7de613ba-8e65-419b-b47b-bdf1252f5f53 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:37:00.770846 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-7de613ba-8e65-419b-b47b-bdf1252f5f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:37:00.852263 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 567/1136] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:37:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:37:01.122954 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67fd3d6-aa3c-43af-837e-3978e5a455d6 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:37:01.238905 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67fd3d6-aa3c-43af-837e-3978e5a455d6 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:37:01.249302 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:01.277943 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a0be0-8495-4ca8-9c06-3335b5f6e587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:37:01.278604 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a0be0-8495-4ca8-9c06-3335b5f6e587 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:01.278849 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a0be0-8495-4ca8-9c06-3335b5f6e587 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:01.279118 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a0be0-8495-4ca8-9c06-3335b5f6e587 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:01.280777 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a0be0-8495-4ca8-9c06-3335b5f6e587 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:37:01.290546 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a0be0-8495-4ca8-9c06-3335b5f6e587 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:37:01.292282 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 570/1137] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:37:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:37:01.298449 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de613ba-8e65-419b-b47b-bdf1252f5f53 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:37:01.320945 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:01.409571 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de613ba-8e65-419b-b47b-bdf1252f5f53 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:37:01.453955 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdbf519-14a5-4e1f-afb5-7cc475f5ff37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:37:01.454554 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdbf519-14a5-4e1f-afb5-7cc475f5ff37 None admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:01.454832 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdbf519-14a5-4e1f-afb5-7cc475f5ff37 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:01.455099 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdbf519-14a5-4e1f-afb5-7cc475f5ff37 None admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:01.456299 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdbf519-14a5-4e1f-afb5-7cc475f5ff37 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:37:01.457745 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdbf519-14a5-4e1f-afb5-7cc475f5ff37 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:37:01.481801 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 568/1138] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Sep 8 13:37:01 2022] POST /identity/v3/users => generated 286 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:37:03.878845 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c83cc-9730-48d4-b8c6-16cfee625a98 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:03.879425 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c83cc-9730-48d4-b8c6-16cfee625a98 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:03.879742 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c83cc-9730-48d4-b8c6-16cfee625a98 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:03.881426 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 571/1139] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:37:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:37:03.888271 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8e435-0fb5-4764-b490-5277ed06f17c None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:03.888783 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8e435-0fb5-4764-b490-5277ed06f17c None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:03.889290 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8e435-0fb5-4764-b490-5277ed06f17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:03.918973 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-47a8e435-0fb5-4764-b490-5277ed06f17c None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:37:03.920698 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-47a8e435-0fb5-4764-b490-5277ed06f17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:37:04.016879 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 569/1140] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:37:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:37:04.296279 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c83cc-9730-48d4-b8c6-16cfee625a98 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:37:04.427660 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c83cc-9730-48d4-b8c6-16cfee625a98 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:37:04.473471 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f89d1f-bd45-4382-a9db-12c3a0706975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:37:04.474379 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f89d1f-bd45-4382-a9db-12c3a0706975 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:04.474658 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f89d1f-bd45-4382-a9db-12c3a0706975 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:04.474927 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f89d1f-bd45-4382-a9db-12c3a0706975 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:04.488434 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f89d1f-bd45-4382-a9db-12c3a0706975 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:37:04.493641 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-78f89d1f-bd45-4382-a9db-12c3a0706975 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:37:04.493641 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:37:04.493641 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:37:04.493641 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:37:04.493641 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:37:04.493641 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:37:04.493641 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:37:04.493641 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:37:04.493641 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:37:04.493641 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:37:04.493641 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:37:04.493641 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:37:04.493641 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:37:04.493641 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:37:04.493641 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:37:04.493641 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:37:04.495937 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:37:04.495937 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:37:04.495937 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:37:04.495937 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:37:04.495937 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:37:04.495937 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:37:04.495937 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:37:04.495937 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:37:04.495937 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:37:04.495937 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:37:04.495937 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:37:04.495937 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:37:04.495937 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:37:04.495937 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:37:04.495937 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:37:04.495937 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:37:04.498040 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:37:04.498040 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:37:04.498040 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:37:04.498040 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:37:04.498040 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:37:04.498040 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:37:04.498040 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:37:04.498040 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:37:04.498040 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:37:04.498040 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:37:04.498040 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:37:04.498040 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:37:04.498040 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 572/1141] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 8 13:37:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:37:04.501738 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8e435-0fb5-4764-b490-5277ed06f17c None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:37:04.507229 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:04.680095 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8e435-0fb5-4764-b490-5277ed06f17c None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:37:04.721344 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea1971-ecd7-41e0-b061-9370a87f3028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:37:04.722479 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea1971-ecd7-41e0-b061-9370a87f3028 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:04.722806 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea1971-ecd7-41e0-b061-9370a87f3028 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:04.723133 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea1971-ecd7-41e0-b061-9370a87f3028 None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:04.724128 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaea1971-ecd7-41e0-b061-9370a87f3028 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:37:04.724481 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaea1971-ecd7-41e0-b061-9370a87f3028 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:37:04.725968 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaea1971-ecd7-41e0-b061-9370a87f3028 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:37:04.735699 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 570/1142] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:37:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:37:04.742394 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f89d1f-bd45-4382-a9db-12c3a0706975 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:37:04.782795 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:04.859196 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f89d1f-bd45-4382-a9db-12c3a0706975 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:37:04.900055 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e6c87-a4ac-495f-8d32-22766fdbb1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:37:04.901093 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e6c87-a4ac-495f-8d32-22766fdbb1e5 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:04.901615 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e6c87-a4ac-495f-8d32-22766fdbb1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:04.902094 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e6c87-a4ac-495f-8d32-22766fdbb1e5 None admin] PATH_INFO: `/v3/users/b5e38bc821ab482395443ff8e1a4902e` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:04.929772 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e6c87-a4ac-495f-8d32-22766fdbb1e5 None admin] RBAC: Authorizing `identity:get_user(user_id=b5e38bc821ab482395443ff8e1a4902e)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:37:04.932529 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e6c87-a4ac-495f-8d32-22766fdbb1e5 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:37:04.935737 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 573/1143] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:37:04 2022] GET /identity/v3/users/b5e38bc821ab482395443ff8e1a4902e => generated 286 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:37:04.944515 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea1971-ecd7-41e0-b061-9370a87f3028 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:37:05.027818 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:05.068982 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea1971-ecd7-41e0-b061-9370a87f3028 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:37:05.108110 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967723d-4dd0-44a2-9016-b5b75bf0ecb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:37:05.108736 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967723d-4dd0-44a2-9016-b5b75bf0ecb4 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:05.109049 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967723d-4dd0-44a2-9016-b5b75bf0ecb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:05.109340 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967723d-4dd0-44a2-9016-b5b75bf0ecb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:05.189132 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8967723d-4dd0-44a2-9016-b5b75bf0ecb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:37:05.191064 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8967723d-4dd0-44a2-9016-b5b75bf0ecb4 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:37:05.269182 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:05.311211 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 571/1144] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:37:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 13:37:05.318802 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e6c87-a4ac-495f-8d32-22766fdbb1e5 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:37:05.475131 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:05.485998 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e6c87-a4ac-495f-8d32-22766fdbb1e5 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:37:05.527183 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f5ea38-df50-4c75-9ea6-4c6cad23e4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:37:05.527820 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5ea38-df50-4c75-9ea6-4c6cad23e4e1 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:05.528093 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5ea38-df50-4c75-9ea6-4c6cad23e4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:05.528359 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f5ea38-df50-4c75-9ea6-4c6cad23e4e1 None admin] PATH_INFO: `/v3/projects/1a1758e0c2f5499ba407af35f6f63701` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:05.529627 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f5ea38-df50-4c75-9ea6-4c6cad23e4e1 None admin] RBAC: Authorizing `identity:get_project(project_id=1a1758e0c2f5499ba407af35f6f63701)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:37:05.531340 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f5ea38-df50-4c75-9ea6-4c6cad23e4e1 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:37:05.533567 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 574/1145] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:37:05 2022] GET /identity/v3/projects/1a1758e0c2f5499ba407af35f6f63701 => generated 311 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:37:05.540932 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967723d-4dd0-44a2-9016-b5b75bf0ecb4 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:37:05.658282 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967723d-4dd0-44a2-9016-b5b75bf0ecb4 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:37:05.703915 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b8ad79-d97b-4fb8-aa18-cd6b8a225e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:37:05.704961 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8ad79-d97b-4fb8-aa18-cd6b8a225e14 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:05.705500 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8ad79-d97b-4fb8-aa18-cd6b8a225e14 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:05.706491 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b8ad79-d97b-4fb8-aa18-cd6b8a225e14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:05.707916 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b8ad79-d97b-4fb8-aa18-cd6b8a225e14 None admin] RBAC: Adding query filter params (role.id=9c76f398c9e04caeab83842e70eb824b, scope.project.id=1a1758e0c2f5499ba407af35f6f63701, user.id=b5e38bc821ab482395443ff8e1a4902e) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:37:05.708476 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b8ad79-d97b-4fb8-aa18-cd6b8a225e14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:37:05.711216 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b8ad79-d97b-4fb8-aa18-cd6b8a225e14 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:37:05.719473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 572/1146] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 8 13:37:05 2022] GET /identity/v3/role_assignments?user.id=b5e38bc821ab482395443ff8e1a4902e&scope.project.id=1a1758e0c2f5499ba407af35f6f63701&role.id=9c76f398c9e04caeab83842e70eb824b => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:37:08.222365 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb86020-8bd4-4b70-b97f-a6285b79edb7 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:08.223073 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb86020-8bd4-4b70-b97f-a6285b79edb7 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:08.223073 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb86020-8bd4-4b70-b97f-a6285b79edb7 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:08.225356 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 575/1147] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:37:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:37:08.231664 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab432ed-e787-4f92-85e8-b49824eba5c5 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:08.232235 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab432ed-e787-4f92-85e8-b49824eba5c5 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:08.232235 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab432ed-e787-4f92-85e8-b49824eba5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:08.252127 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-9ab432ed-e787-4f92-85e8-b49824eba5c5 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:37:08.253384 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-9ab432ed-e787-4f92-85e8-b49824eba5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:37:08.282707 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:08.339597 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 573/1148] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:37:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:37:08.620889 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb86020-8bd4-4b70-b97f-a6285b79edb7 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:37:08.767219 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb86020-8bd4-4b70-b97f-a6285b79edb7 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:37:08.808702 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732996e9-8d14-447f-83a6-8fad529050bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:37:08.809475 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732996e9-8d14-447f-83a6-8fad529050bb None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:08.809828 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732996e9-8d14-447f-83a6-8fad529050bb None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:08.810148 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732996e9-8d14-447f-83a6-8fad529050bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:08.830187 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732996e9-8d14-447f-83a6-8fad529050bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:37:08.835996 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-732996e9-8d14-447f-83a6-8fad529050bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:37:08.835996 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:37:08.835996 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:37:08.835996 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:37:08.835996 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:37:08.835996 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:37:08.835996 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:37:08.835996 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:37:08.835996 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:37:08.835996 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:37:08.835996 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:37:08.835996 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:37:08.835996 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:37:08.835996 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:37:08.835996 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:37:08.835996 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:37:08.837881 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:37:08.837881 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:37:08.837881 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:37:08.837881 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:37:08.837881 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:37:08.837881 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:37:08.837881 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:37:08.837881 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:37:08.837881 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:37:08.837881 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:37:08.837881 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:37:08.837881 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:37:08.837881 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:37:08.837881 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:37:08.837881 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:37:08.837881 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:37:08.839882 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:37:08.839882 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:37:08.839882 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:37:08.839882 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:37:08.839882 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:37:08.839882 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:37:08.839882 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:37:08.839882 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:37:08.839882 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:37:08.839882 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:37:08.839882 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:37:08.839882 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:37:08.839882 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 576/1149] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 8 13:37:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:37:08.846232 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab432ed-e787-4f92-85e8-b49824eba5c5 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:37:08.976835 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab432ed-e787-4f92-85e8-b49824eba5c5 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:37:09.034526 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6df26-8931-482c-bd84-8a788cfe4173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:37:09.036009 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6df26-8931-482c-bd84-8a788cfe4173 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:09.036447 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6df26-8931-482c-bd84-8a788cfe4173 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:09.036810 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6df26-8931-482c-bd84-8a788cfe4173 None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:09.038056 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6df26-8931-482c-bd84-8a788cfe4173 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:37:09.038504 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6df26-8931-482c-bd84-8a788cfe4173 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:37:09.040095 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6df26-8931-482c-bd84-8a788cfe4173 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:37:09.051223 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 574/1150] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:37:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:37:09.057896 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732996e9-8d14-447f-83a6-8fad529050bb None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:37:09.091078 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:09.229017 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732996e9-8d14-447f-83a6-8fad529050bb None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:37:09.294962 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa4fe93-9bb4-4c01-9cd5-a83cf87ecfae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:37:09.296067 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4fe93-9bb4-4c01-9cd5-a83cf87ecfae None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:09.296560 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4fe93-9bb4-4c01-9cd5-a83cf87ecfae None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:09.297048 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4fe93-9bb4-4c01-9cd5-a83cf87ecfae None admin] PATH_INFO: `/v3/users/b5e38bc821ab482395443ff8e1a4902e` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:09.300345 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa4fe93-9bb4-4c01-9cd5-a83cf87ecfae None admin] RBAC: Authorizing `identity:get_user(user_id=b5e38bc821ab482395443ff8e1a4902e)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:37:09.303932 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa4fe93-9bb4-4c01-9cd5-a83cf87ecfae None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:37:09.307363 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 577/1151] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:37:09 2022] GET /identity/v3/users/b5e38bc821ab482395443ff8e1a4902e => generated 286 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:37:09.316843 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6df26-8931-482c-bd84-8a788cfe4173 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:37:09.350896 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:09.451077 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6df26-8931-482c-bd84-8a788cfe4173 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:37:09.496673 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb725fa-ad73-4963-92ed-4eafb3b26346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:37:09.497436 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb725fa-ad73-4963-92ed-4eafb3b26346 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:09.497845 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb725fa-ad73-4963-92ed-4eafb3b26346 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:09.498229 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb725fa-ad73-4963-92ed-4eafb3b26346 None admin] PATH_INFO: `/v3/projects/1a1758e0c2f5499ba407af35f6f63701` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:09.499664 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb725fa-ad73-4963-92ed-4eafb3b26346 None admin] RBAC: Authorizing `identity:get_project(project_id=1a1758e0c2f5499ba407af35f6f63701)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:37:09.501461 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb725fa-ad73-4963-92ed-4eafb3b26346 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:37:09.503650 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 575/1152] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:37:09 2022] GET /identity/v3/projects/1a1758e0c2f5499ba407af35f6f63701 => generated 311 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:37:09.513778 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa4fe93-9bb4-4c01-9cd5-a83cf87ecfae None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:37:09.678346 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:09.702115 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa4fe93-9bb4-4c01-9cd5-a83cf87ecfae None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:37:09.767011 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6269ac-1381-4718-8268-550d8849b66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:37:09.768046 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6269ac-1381-4718-8268-550d8849b66c None admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:09.768580 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6269ac-1381-4718-8268-550d8849b66c None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:09.769329 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6269ac-1381-4718-8268-550d8849b66c None admin] PATH_INFO: `/v3/projects/1a1758e0c2f5499ba407af35f6f63701/users/b5e38bc821ab482395443ff8e1a4902e/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:09.774271 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6269ac-1381-4718-8268-550d8849b66c None admin] RBAC: Authorizing `identity:create_grant(project_id=1a1758e0c2f5499ba407af35f6f63701, user_id=b5e38bc821ab482395443ff8e1a4902e, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:37:09.777489 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6269ac-1381-4718-8268-550d8849b66c None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:37:09.806461 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 578/1153] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Sep 8 13:37:09 2022] PUT /identity/v3/projects/1a1758e0c2f5499ba407af35f6f63701/users/b5e38bc821ab482395443ff8e1a4902e/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:37:12.840565 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94d8c8-ef55-48eb-940a-726514620d52 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:12.841255 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94d8c8-ef55-48eb-940a-726514620d52 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:12.841762 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94d8c8-ef55-48eb-940a-726514620d52 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:12.844289 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 576/1154] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:37:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:37:12.853665 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91ef7e-3289-4bcd-848c-9bda808f2a2e None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:12.854320 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91ef7e-3289-4bcd-848c-9bda808f2a2e None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:12.854320 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91ef7e-3289-4bcd-848c-9bda808f2a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:12.879011 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-5e91ef7e-3289-4bcd-848c-9bda808f2a2e None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:37:12.880458 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-5e91ef7e-3289-4bcd-848c-9bda808f2a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:37:12.982840 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 579/1155] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:37:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:37:13.276407 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c94d8c8-ef55-48eb-940a-726514620d52 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:37:13.389050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:13.403040 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c94d8c8-ef55-48eb-940a-726514620d52 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:37:13.443436 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32518e93-898e-4c91-b2a2-3b4156fcf3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:37:13.444081 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32518e93-898e-4c91-b2a2-3b4156fcf3ed None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:13.444361 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32518e93-898e-4c91-b2a2-3b4156fcf3ed None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:13.444640 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32518e93-898e-4c91-b2a2-3b4156fcf3ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:13.458777 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32518e93-898e-4c91-b2a2-3b4156fcf3ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:37:13.464397 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-32518e93-898e-4c91-b2a2-3b4156fcf3ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:37:13.464397 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:37:13.464397 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:37:13.464397 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:37:13.464397 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:37:13.464397 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:37:13.464397 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:37:13.464397 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:37:13.464397 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:37:13.464397 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:37:13.464397 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:37:13.464397 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:37:13.464397 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:37:13.464397 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:37:13.464397 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:37:13.464397 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:37:13.466206 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:37:13.466206 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:37:13.466206 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:37:13.466206 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:37:13.466206 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:37:13.466206 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:37:13.466206 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:37:13.466206 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:37:13.466206 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:37:13.466206 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:37:13.466206 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:37:13.466206 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:37:13.466206 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:37:13.466206 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:37:13.466206 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:37:13.466206 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:37:13.467489 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:37:13.467489 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:37:13.467489 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:37:13.467489 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:37:13.467489 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:37:13.467489 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:37:13.467489 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:37:13.467489 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:37:13.467489 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:37:13.467489 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:37:13.467489 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:37:13.467489 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:37:13.467489 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 577/1156] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 8 13:37:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:37:13.473531 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91ef7e-3289-4bcd-848c-9bda808f2a2e None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:37:13.571573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:13.601133 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91ef7e-3289-4bcd-848c-9bda808f2a2e None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:37:13.642311 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71a6ed-5fc0-4ae4-93b3-70f3e99ac77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:37:13.643074 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71a6ed-5fc0-4ae4-93b3-70f3e99ac77a None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:13.643516 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71a6ed-5fc0-4ae4-93b3-70f3e99ac77a None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:13.643849 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71a6ed-5fc0-4ae4-93b3-70f3e99ac77a None admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:13.645045 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e71a6ed-5fc0-4ae4-93b3-70f3e99ac77a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:37:13.645445 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e71a6ed-5fc0-4ae4-93b3-70f3e99ac77a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:37:13.646931 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e71a6ed-5fc0-4ae4-93b3-70f3e99ac77a None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:37:13.657004 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 580/1157] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:37:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:37:13.663971 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32518e93-898e-4c91-b2a2-3b4156fcf3ed None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:37:13.804500 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32518e93-898e-4c91-b2a2-3b4156fcf3ed None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:37:13.844537 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6ffb3-9f74-4f2d-8e8e-e00597e85bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:37:13.845592 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6ffb3-9f74-4f2d-8e8e-e00597e85bb2 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:13.845592 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6ffb3-9f74-4f2d-8e8e-e00597e85bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:13.845898 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6ffb3-9f74-4f2d-8e8e-e00597e85bb2 None admin] PATH_INFO: `/v3/users/b5e38bc821ab482395443ff8e1a4902e` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:13.847594 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a6ffb3-9f74-4f2d-8e8e-e00597e85bb2 None admin] RBAC: Authorizing `identity:get_user(user_id=b5e38bc821ab482395443ff8e1a4902e)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:37:13.849169 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a6ffb3-9f74-4f2d-8e8e-e00597e85bb2 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:37:13.850906 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 578/1158] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:37:13 2022] GET /identity/v3/users/b5e38bc821ab482395443ff8e1a4902e => generated 286 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:37:13.857495 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71a6ed-5fc0-4ae4-93b3-70f3e99ac77a None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:37:13.995592 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71a6ed-5fc0-4ae4-93b3-70f3e99ac77a None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:37:14.034348 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b9023-8e3a-42b9-b00e-2c344f1f162a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:37:14.034957 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b9023-8e3a-42b9-b00e-2c344f1f162a None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:14.035240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b9023-8e3a-42b9-b00e-2c344f1f162a None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:14.035512 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7b9023-8e3a-42b9-b00e-2c344f1f162a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:14.047812 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:14.122492 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7b9023-8e3a-42b9-b00e-2c344f1f162a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:37:14.124058 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7b9023-8e3a-42b9-b00e-2c344f1f162a None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:37:14.251042 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 581/1159] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:37:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 08 13:37:14.258197 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6ffb3-9f74-4f2d-8e8e-e00597e85bb2 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:37:14.283393 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:14.398295 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6ffb3-9f74-4f2d-8e8e-e00597e85bb2 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:37:14.440186 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f72a4-59b1-4692-b0ff-ce2b0a8558a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:37:14.440843 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f72a4-59b1-4692-b0ff-ce2b0a8558a0 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:14.441119 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f72a4-59b1-4692-b0ff-ce2b0a8558a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:14.441420 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f72a4-59b1-4692-b0ff-ce2b0a8558a0 None admin] PATH_INFO: `/v3/projects/1a1758e0c2f5499ba407af35f6f63701` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:14.442677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f72a4-59b1-4692-b0ff-ce2b0a8558a0 None admin] RBAC: Authorizing `identity:get_project(project_id=1a1758e0c2f5499ba407af35f6f63701)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:37:14.444225 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f72a4-59b1-4692-b0ff-ce2b0a8558a0 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:37:14.446106 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 579/1160] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:37:14 2022] GET /identity/v3/projects/1a1758e0c2f5499ba407af35f6f63701 => generated 311 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:37:14.453015 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b9023-8e3a-42b9-b00e-2c344f1f162a None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:37:14.503913 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:14.577775 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7b9023-8e3a-42b9-b00e-2c344f1f162a None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:37:14.629325 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae7792-6fb6-4098-ae5a-537dda3a4eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:37:14.629981 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae7792-6fb6-4098-ae5a-537dda3a4eab None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:14.630262 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae7792-6fb6-4098-ae5a-537dda3a4eab None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:14.630534 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae7792-6fb6-4098-ae5a-537dda3a4eab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:14.631278 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae7792-6fb6-4098-ae5a-537dda3a4eab None admin] RBAC: Adding query filter params (role.id=9c76f398c9e04caeab83842e70eb824b, scope.project.id=1a1758e0c2f5499ba407af35f6f63701, user.id=b5e38bc821ab482395443ff8e1a4902e) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:37:14.631590 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae7792-6fb6-4098-ae5a-537dda3a4eab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:37:14.633067 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae7792-6fb6-4098-ae5a-537dda3a4eab None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:37:14.640004 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 582/1161] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 8 13:37:14 2022] GET /identity/v3/role_assignments?user.id=b5e38bc821ab482395443ff8e1a4902e&scope.project.id=1a1758e0c2f5499ba407af35f6f63701&role.id=9c76f398c9e04caeab83842e70eb824b => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:37:17.106753 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a606e0-921b-4858-8c09-0a13f292c640 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:17.107398 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a606e0-921b-4858-8c09-0a13f292c640 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:17.107709 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a606e0-921b-4858-8c09-0a13f292c640 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:17.110301 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 580/1162] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:37:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:37:17.120898 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32acfbe1-458c-44ca-b446-48f90a795d3e None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:17.121513 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32acfbe1-458c-44ca-b446-48f90a795d3e None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:17.121869 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32acfbe1-458c-44ca-b446-48f90a795d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:17.153651 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-32acfbe1-458c-44ca-b446-48f90a795d3e None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:37:17.155772 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-32acfbe1-458c-44ca-b446-48f90a795d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:37:17.273489 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 583/1163] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:37:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:37:17.700751 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a606e0-921b-4858-8c09-0a13f292c640 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:37:17.844881 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:17.872479 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a606e0-921b-4858-8c09-0a13f292c640 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:37:17.943861 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb723c7a-162c-427e-abee-56059a2289c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:37:17.944930 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb723c7a-162c-427e-abee-56059a2289c2 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:17.945454 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb723c7a-162c-427e-abee-56059a2289c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:17.945907 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb723c7a-162c-427e-abee-56059a2289c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:18.031420 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb723c7a-162c-427e-abee-56059a2289c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:37:18.032858 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb723c7a-162c-427e-abee-56059a2289c2 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:37:18.150152 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:18.172762 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 581/1164] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:37:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 13:37:18.180690 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32acfbe1-458c-44ca-b446-48f90a795d3e None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:37:18.236048 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:18.352827 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32acfbe1-458c-44ca-b446-48f90a795d3e None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:37:18.420261 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1e1fe-4bb8-4e10-8525-71b64949c9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:37:18.421345 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1e1fe-4bb8-4e10-8525-71b64949c9be None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:18.421875 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1e1fe-4bb8-4e10-8525-71b64949c9be None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:18.422338 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1e1fe-4bb8-4e10-8525-71b64949c9be None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:18.436302 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c1e1fe-4bb8-4e10-8525-71b64949c9be None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:37:18.439210 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c1e1fe-4bb8-4e10-8525-71b64949c9be None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:37:18.462920 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-54c1e1fe-4bb8-4e10-8525-71b64949c9be None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 08 13:37:18.462920 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:37:18.462920 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 08 13:37:18.462920 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 08 13:37:18.462920 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:37:18.462920 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:37:18.462920 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:37:18.462920 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:37:18.462920 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 08 13:37:18.462920 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:37:18.462920 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:37:18.462920 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:37:18.462920 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:37:18.462920 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:37:18.462920 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:37:18.462920 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:37:18.462920 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:37:18.465141 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:37:18.465141 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:37:18.465141 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:37:18.465141 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:37:18.465141 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:37:18.465141 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:37:18.465141 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:37:18.465141 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:37:18.465141 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:37:18.465141 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:37:18.465141 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:37:18.465141 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:37:18.465141 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:37:18.465141 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:37:18.465141 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:37:18.465141 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:37:18.467108 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:37:18.467108 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:37:18.467108 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:37:18.467108 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:37:18.467108 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:37:18.467108 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:37:18.467108 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:37:18.467108 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:37:18.467108 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:37:18.467108 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:37:18.467108 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 08 13:37:18.467108 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:37:18.467108 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 08 13:37:18.467108 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:37:18.467108 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 584/1165] 10.222.0.69 () {56 vars in 1117 bytes} [Thu Sep 8 13:37:18 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:37:18.475436 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb723c7a-162c-427e-abee-56059a2289c2 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:37:18.669552 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb723c7a-162c-427e-abee-56059a2289c2 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:37:18.740214 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff7830-f5e9-4876-8063-534004731696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:37:18.741294 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff7830-f5e9-4876-8063-534004731696 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:18.741812 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff7830-f5e9-4876-8063-534004731696 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:18.742281 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff7830-f5e9-4876-8063-534004731696 None admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:18.743511 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff7830-f5e9-4876-8063-534004731696 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:37:18.744057 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff7830-f5e9-4876-8063-534004731696 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:37:18.747046 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff7830-f5e9-4876-8063-534004731696 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:37:18.764822 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 582/1166] 10.222.0.69 () {56 vars in 1115 bytes} [Thu Sep 8 13:37:18 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:37:21.896656 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621a3c1-ba99-4df8-97ca-47b9ccdc0963 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:21.897283 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621a3c1-ba99-4df8-97ca-47b9ccdc0963 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:21.897630 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621a3c1-ba99-4df8-97ca-47b9ccdc0963 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:21.900193 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 585/1167] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:37:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:37:21.910786 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46722d38-e06e-4e22-8867-07d4a1bac33b None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:21.911383 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46722d38-e06e-4e22-8867-07d4a1bac33b None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:21.911775 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46722d38-e06e-4e22-8867-07d4a1bac33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:21.945477 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-46722d38-e06e-4e22-8867-07d4a1bac33b None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:37:21.947619 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-46722d38-e06e-4e22-8867-07d4a1bac33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:37:22.042849 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:22.083054 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 583/1168] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:37:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:37:22.597250 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621a3c1-ba99-4df8-97ca-47b9ccdc0963 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:37:22.759519 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:22.774286 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621a3c1-ba99-4df8-97ca-47b9ccdc0963 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:37:22.840582 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c852f-e2c0-46f5-bed5-6c5ec7d46889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:37:22.841521 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c852f-e2c0-46f5-bed5-6c5ec7d46889 None admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:22.842007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c852f-e2c0-46f5-bed5-6c5ec7d46889 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:22.842478 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c852f-e2c0-46f5-bed5-6c5ec7d46889 None admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:22.843765 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c852f-e2c0-46f5-bed5-6c5ec7d46889 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:37:22.846396 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c852f-e2c0-46f5-bed5-6c5ec7d46889 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:37:22.874366 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 586/1169] 10.222.0.69 () {60 vars in 1138 bytes} [Thu Sep 8 13:37:22 2022] POST /identity/v3/domains => generated 267 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:37:26.179001 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e2b00-1301-4c0a-9cff-baffd105f27f None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:26.179857 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e2b00-1301-4c0a-9cff-baffd105f27f None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:26.179857 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e2b00-1301-4c0a-9cff-baffd105f27f None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:26.181474 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 584/1170] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:37:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:37:26.188434 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d510001-b1b0-40e2-9b06-ff5fd37612ad None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:26.189029 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d510001-b1b0-40e2-9b06-ff5fd37612ad None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:26.189029 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d510001-b1b0-40e2-9b06-ff5fd37612ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:26.211994 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-4d510001-b1b0-40e2-9b06-ff5fd37612ad None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:37:26.213225 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-4d510001-b1b0-40e2-9b06-ff5fd37612ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:37:26.326979 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 587/1171] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:37:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:37:26.613924 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e2b00-1301-4c0a-9cff-baffd105f27f None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:37:26.746386 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e2b00-1301-4c0a-9cff-baffd105f27f None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:37:26.789293 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fc89e8-d0fb-4bfd-834b-e8ea2627d1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:37:26.790138 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc89e8-d0fb-4bfd-834b-e8ea2627d1f7 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:26.790598 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc89e8-d0fb-4bfd-834b-e8ea2627d1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:26.791057 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc89e8-d0fb-4bfd-834b-e8ea2627d1f7 None admin] PATH_INFO: `/v3/domains/8c9b72b1b6654c51a5493d025d61ee5a` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:26.804430 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fc89e8-d0fb-4bfd-834b-e8ea2627d1f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=8c9b72b1b6654c51a5493d025d61ee5a)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:37:26.806122 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fc89e8-d0fb-4bfd-834b-e8ea2627d1f7 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:37:26.808124 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 585/1172] 10.222.0.69 () {56 vars in 1183 bytes} [Thu Sep 8 13:37:26 2022] GET /identity/v3/domains/8c9b72b1b6654c51a5493d025d61ee5a => generated 267 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:37:26.814501 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d510001-b1b0-40e2-9b06-ff5fd37612ad None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:37:26.920219 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:26.942466 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d510001-b1b0-40e2-9b06-ff5fd37612ad None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:37:26.989402 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698cc4d-bd2e-4b51-baa2-70cc50661cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:37:26.990025 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698cc4d-bd2e-4b51-baa2-70cc50661cb2 None admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:26.990305 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698cc4d-bd2e-4b51-baa2-70cc50661cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:26.990576 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698cc4d-bd2e-4b51-baa2-70cc50661cb2 None admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:26.991539 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f698cc4d-bd2e-4b51-baa2-70cc50661cb2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:37:26.993009 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f698cc4d-bd2e-4b51-baa2-70cc50661cb2 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:37:27.033866 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 588/1173] 10.222.0.69 () {60 vars in 1141 bytes} [Thu Sep 8 13:37:26 2022] POST /identity/v3/projects => generated 361 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:37:29.511868 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb5ce1-f562-458c-87a6-2be2670a7c17 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:29.512469 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb5ce1-f562-458c-87a6-2be2670a7c17 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:29.512469 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cb5ce1-f562-458c-87a6-2be2670a7c17 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:29.513870 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 586/1174] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:37:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:37:29.521059 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb2249-6336-460b-883c-a0ce80191b69 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:29.521651 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb2249-6336-460b-883c-a0ce80191b69 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:29.522019 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb2249-6336-460b-883c-a0ce80191b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:29.553738 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-17bb2249-6336-460b-883c-a0ce80191b69 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:37:29.555669 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-17bb2249-6336-460b-883c-a0ce80191b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:37:29.667571 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 589/1175] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:37:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:37:29.975574 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb5ce1-f562-458c-87a6-2be2670a7c17 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:37:30.035847 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:30.104732 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cb5ce1-f562-458c-87a6-2be2670a7c17 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:37:30.149430 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b7258-2041-489e-8bac-2fe739f0ae8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:37:30.150074 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b7258-2041-489e-8bac-2fe739f0ae8e None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:30.150351 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b7258-2041-489e-8bac-2fe739f0ae8e None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:30.150621 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b7258-2041-489e-8bac-2fe739f0ae8e None admin] PATH_INFO: `/v3/domains/8c9b72b1b6654c51a5493d025d61ee5a` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:30.151847 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b7258-2041-489e-8bac-2fe739f0ae8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=8c9b72b1b6654c51a5493d025d61ee5a)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:37:30.153302 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b7258-2041-489e-8bac-2fe739f0ae8e None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:37:30.155005 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 587/1176] 10.222.0.69 () {56 vars in 1183 bytes} [Thu Sep 8 13:37:29 2022] GET /identity/v3/domains/8c9b72b1b6654c51a5493d025d61ee5a => generated 267 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:37:30.161719 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb2249-6336-460b-883c-a0ce80191b69 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:37:30.239242 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:30.284701 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb2249-6336-460b-883c-a0ce80191b69 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:37:30.346361 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140fb9d6-633c-4132-a1cd-2c465c83e039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:37:30.347516 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140fb9d6-633c-4132-a1cd-2c465c83e039 None admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:30.347901 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140fb9d6-633c-4132-a1cd-2c465c83e039 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:30.348381 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140fb9d6-633c-4132-a1cd-2c465c83e039 None admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:30.349906 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140fb9d6-633c-4132-a1cd-2c465c83e039 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:37:30.352468 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140fb9d6-633c-4132-a1cd-2c465c83e039 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:37:30.383593 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 590/1177] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Sep 8 13:37:30 2022] POST /identity/v3/users => generated 311 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:37:33.009685 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d031f-6e44-409e-9e20-2b8830500e06 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:33.010548 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d031f-6e44-409e-9e20-2b8830500e06 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:33.010548 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d031f-6e44-409e-9e20-2b8830500e06 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:33.012197 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 588/1178] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:37:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:37:33.018593 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1e2f0-796d-4fec-a685-db3bffeeb95c None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:33.019478 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1e2f0-796d-4fec-a685-db3bffeeb95c None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:33.019478 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1e2f0-796d-4fec-a685-db3bffeeb95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:33.041455 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-3df1e2f0-796d-4fec-a685-db3bffeeb95c None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:37:33.042718 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-3df1e2f0-796d-4fec-a685-db3bffeeb95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:37:33.132832 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 591/1179] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:37:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:37:33.414597 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d031f-6e44-409e-9e20-2b8830500e06 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:37:33.556414 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d031f-6e44-409e-9e20-2b8830500e06 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:37:33.568487 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:33.602720 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe86e36-5e91-417b-b1c7-ca24a6d9f325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:37:33.603518 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe86e36-5e91-417b-b1c7-ca24a6d9f325 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:33.603914 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe86e36-5e91-417b-b1c7-ca24a6d9f325 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:33.604298 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe86e36-5e91-417b-b1c7-ca24a6d9f325 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:33.619722 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe86e36-5e91-417b-b1c7-ca24a6d9f325 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:37:33.624839 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-2fe86e36-5e91-417b-b1c7-ca24a6d9f325 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:37:33.624839 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:37:33.624839 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:37:33.624839 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:37:33.624839 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:37:33.624839 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:37:33.624839 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:37:33.624839 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:37:33.624839 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:37:33.624839 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:37:33.624839 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:37:33.624839 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:37:33.624839 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:37:33.624839 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:37:33.624839 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:37:33.624839 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:37:33.627827 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:37:33.627827 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:37:33.627827 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:37:33.627827 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:37:33.627827 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:37:33.627827 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:37:33.627827 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:37:33.627827 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:37:33.627827 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:37:33.627827 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:37:33.627827 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:37:33.627827 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:37:33.627827 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:37:33.627827 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:37:33.627827 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:37:33.627827 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:37:33.629982 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:37:33.629982 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:37:33.629982 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:37:33.629982 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:37:33.629982 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:37:33.629982 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:37:33.629982 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:37:33.629982 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:37:33.629982 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:37:33.629982 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:37:33.629982 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:37:33.629982 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:37:33.629982 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 589/1180] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 8 13:37:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:37:33.637130 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df1e2f0-796d-4fec-a685-db3bffeeb95c None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:37:33.721838 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:33.788229 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df1e2f0-796d-4fec-a685-db3bffeeb95c None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:37:33.834296 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec97c21c-0eb7-4a75-bb21-763bd69197c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:37:33.834885 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97c21c-0eb7-4a75-bb21-763bd69197c8 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:33.835210 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97c21c-0eb7-4a75-bb21-763bd69197c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:33.835534 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97c21c-0eb7-4a75-bb21-763bd69197c8 None admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:33.836388 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec97c21c-0eb7-4a75-bb21-763bd69197c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:37:33.836748 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec97c21c-0eb7-4a75-bb21-763bd69197c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:37:33.838429 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec97c21c-0eb7-4a75-bb21-763bd69197c8 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:37:33.849819 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 592/1181] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:37:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:37:33.856640 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe86e36-5e91-417b-b1c7-ca24a6d9f325 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:37:34.006620 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe86e36-5e91-417b-b1c7-ca24a6d9f325 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:37:34.048085 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b6acec-c55b-4194-9ad5-f89b882d92e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:37:34.049136 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6acec-c55b-4194-9ad5-f89b882d92e3 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:34.049136 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6acec-c55b-4194-9ad5-f89b882d92e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:34.049593 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6acec-c55b-4194-9ad5-f89b882d92e3 None admin] PATH_INFO: `/v3/users/8cef5b87502d4d93804d17b38c3164ed` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:34.081299 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b6acec-c55b-4194-9ad5-f89b882d92e3 None admin] RBAC: Authorizing `identity:get_user(user_id=8cef5b87502d4d93804d17b38c3164ed)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:37:34.082962 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b6acec-c55b-4194-9ad5-f89b882d92e3 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:37:34.084943 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 590/1182] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:37:33 2022] GET /identity/v3/users/8cef5b87502d4d93804d17b38c3164ed => generated 311 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:37:34.094885 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec97c21c-0eb7-4a75-bb21-763bd69197c8 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:37:34.278949 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec97c21c-0eb7-4a75-bb21-763bd69197c8 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:37:34.296784 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:34.329201 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a635bb8-09dc-4948-a56c-bf7d12d2dfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:37:34.330310 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a635bb8-09dc-4948-a56c-bf7d12d2dfe9 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:34.330785 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a635bb8-09dc-4948-a56c-bf7d12d2dfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:34.331261 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a635bb8-09dc-4948-a56c-bf7d12d2dfe9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:34.470898 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a635bb8-09dc-4948-a56c-bf7d12d2dfe9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:37:34.474450 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a635bb8-09dc-4948-a56c-bf7d12d2dfe9 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:37:34.639045 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 593/1183] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:37:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 13:37:34.647239 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b6acec-c55b-4194-9ad5-f89b882d92e3 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:37:34.684614 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:34.806119 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b6acec-c55b-4194-9ad5-f89b882d92e3 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:37:34.848541 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72edeaa2-8fd1-4fea-b62f-f302fa5e8ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:37:34.849630 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72edeaa2-8fd1-4fea-b62f-f302fa5e8ac0 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:34.850087 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72edeaa2-8fd1-4fea-b62f-f302fa5e8ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:34.850385 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72edeaa2-8fd1-4fea-b62f-f302fa5e8ac0 None admin] PATH_INFO: `/v3/projects/1fce7e814a024c5d875cbb6664695e81` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:34.852156 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72edeaa2-8fd1-4fea-b62f-f302fa5e8ac0 None admin] RBAC: Authorizing `identity:get_project(project_id=1fce7e814a024c5d875cbb6664695e81)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:37:34.853979 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72edeaa2-8fd1-4fea-b62f-f302fa5e8ac0 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:37:34.855878 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 591/1184] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:37:34 2022] GET /identity/v3/projects/1fce7e814a024c5d875cbb6664695e81 => generated 361 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:37:34.863918 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a635bb8-09dc-4948-a56c-bf7d12d2dfe9 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:37:34.886265 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:35.011906 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a635bb8-09dc-4948-a56c-bf7d12d2dfe9 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:37:35.059187 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d4bb69-ed0e-49f2-bddb-cf327fb2a256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:37:35.059711 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4bb69-ed0e-49f2-bddb-cf327fb2a256 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:35.059992 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4bb69-ed0e-49f2-bddb-cf327fb2a256 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:35.060267 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4bb69-ed0e-49f2-bddb-cf327fb2a256 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:35.061047 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d4bb69-ed0e-49f2-bddb-cf327fb2a256 None admin] RBAC: Adding query filter params (role.id=9c76f398c9e04caeab83842e70eb824b, scope.project.id=1fce7e814a024c5d875cbb6664695e81, user.id=8cef5b87502d4d93804d17b38c3164ed) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:37:35.061474 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d4bb69-ed0e-49f2-bddb-cf327fb2a256 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:37:35.063314 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d4bb69-ed0e-49f2-bddb-cf327fb2a256 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:37:35.072144 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 594/1185] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 8 13:37:34 2022] GET /identity/v3/role_assignments?user.id=8cef5b87502d4d93804d17b38c3164ed&scope.project.id=1fce7e814a024c5d875cbb6664695e81&role.id=9c76f398c9e04caeab83842e70eb824b => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:37:37.773941 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810156c-8f95-4bf6-ac53-9c975812f523 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:37.774802 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810156c-8f95-4bf6-ac53-9c975812f523 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:37.774950 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810156c-8f95-4bf6-ac53-9c975812f523 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:37.777547 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 592/1186] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:37:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:37:37.787590 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70285ab7-6a2e-40ff-964f-9f1d1906ef01 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:37.788429 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70285ab7-6a2e-40ff-964f-9f1d1906ef01 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:37.788611 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70285ab7-6a2e-40ff-964f-9f1d1906ef01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:37.823566 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-70285ab7-6a2e-40ff-964f-9f1d1906ef01 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:37:37.825842 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-70285ab7-6a2e-40ff-964f-9f1d1906ef01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:37:37.911588 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 595/1187] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:37:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:37:38.403563 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810156c-8f95-4bf6-ac53-9c975812f523 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:37:38.586751 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:38.604312 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810156c-8f95-4bf6-ac53-9c975812f523 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:37:38.682199 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e2163-14b5-4bc4-80b1-df2aec9ddddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:37:38.683296 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e2163-14b5-4bc4-80b1-df2aec9ddddb None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:38.683770 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e2163-14b5-4bc4-80b1-df2aec9ddddb None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:38.684241 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e2163-14b5-4bc4-80b1-df2aec9ddddb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:38.706403 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e2163-14b5-4bc4-80b1-df2aec9ddddb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:37:38.712296 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-df4e2163-14b5-4bc4-80b1-df2aec9ddddb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:37:38.712296 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:37:38.712296 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:37:38.712296 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:37:38.712296 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:37:38.712296 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:37:38.712296 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:37:38.712296 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:37:38.712296 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:37:38.712296 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:37:38.712296 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:37:38.712296 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:37:38.712296 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:37:38.712296 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:37:38.712296 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:37:38.712296 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:37:38.714179 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:37:38.714179 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:37:38.714179 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:37:38.714179 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:37:38.714179 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:37:38.714179 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:37:38.714179 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:37:38.714179 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:37:38.714179 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:37:38.714179 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:37:38.714179 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:37:38.714179 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:37:38.714179 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:37:38.714179 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:37:38.714179 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:37:38.714179 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:37:38.716101 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:37:38.716101 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:37:38.716101 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:37:38.716101 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:37:38.716101 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:37:38.716101 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:37:38.716101 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:37:38.716101 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:37:38.716101 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:37:38.716101 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:37:38.716101 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:37:38.716101 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:37:38.716101 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 593/1188] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 8 13:37:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:37:38.725259 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70285ab7-6a2e-40ff-964f-9f1d1906ef01 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:37:38.739025 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:38.891455 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70285ab7-6a2e-40ff-964f-9f1d1906ef01 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:37:38.959329 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da160e7-2c5e-4929-b5dc-0ba71d4e37f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:37:38.960422 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da160e7-2c5e-4929-b5dc-0ba71d4e37f1 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:38.960909 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da160e7-2c5e-4929-b5dc-0ba71d4e37f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:38.961417 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da160e7-2c5e-4929-b5dc-0ba71d4e37f1 None admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:38.962772 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da160e7-2c5e-4929-b5dc-0ba71d4e37f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:37:38.963308 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da160e7-2c5e-4929-b5dc-0ba71d4e37f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:37:38.966087 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da160e7-2c5e-4929-b5dc-0ba71d4e37f1 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:37:38.983558 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 596/1189] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:37:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:37:38.993427 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e2163-14b5-4bc4-80b1-df2aec9ddddb None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:37:39.203815 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e2163-14b5-4bc4-80b1-df2aec9ddddb None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:37:39.270711 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4d190-4374-4b2a-acbb-d7946d4c94fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:37:39.271798 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4d190-4374-4b2a-acbb-d7946d4c94fe None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:39.272286 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4d190-4374-4b2a-acbb-d7946d4c94fe None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:39.272782 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4d190-4374-4b2a-acbb-d7946d4c94fe None admin] PATH_INFO: `/v3/users/8cef5b87502d4d93804d17b38c3164ed` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:39.275014 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de4d190-4374-4b2a-acbb-d7946d4c94fe None admin] RBAC: Authorizing `identity:get_user(user_id=8cef5b87502d4d93804d17b38c3164ed)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:37:39.277776 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de4d190-4374-4b2a-acbb-d7946d4c94fe None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:37:39.280916 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 594/1190] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:37:38 2022] GET /identity/v3/users/8cef5b87502d4d93804d17b38c3164ed => generated 311 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:37:39.290664 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da160e7-2c5e-4929-b5dc-0ba71d4e37f1 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:37:39.402483 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:39.460289 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da160e7-2c5e-4929-b5dc-0ba71d4e37f1 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:37:39.527509 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd5b999-d73e-4e0b-8253-dc7ce8be7e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:37:39.528607 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5b999-d73e-4e0b-8253-dc7ce8be7e68 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:39.529094 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5b999-d73e-4e0b-8253-dc7ce8be7e68 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:39.529602 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd5b999-d73e-4e0b-8253-dc7ce8be7e68 None admin] PATH_INFO: `/v3/projects/1fce7e814a024c5d875cbb6664695e81` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:39.531753 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd5b999-d73e-4e0b-8253-dc7ce8be7e68 None admin] RBAC: Authorizing `identity:get_project(project_id=1fce7e814a024c5d875cbb6664695e81)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:37:39.534625 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd5b999-d73e-4e0b-8253-dc7ce8be7e68 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:37:39.537863 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 597/1191] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:37:39 2022] GET /identity/v3/projects/1fce7e814a024c5d875cbb6664695e81 => generated 361 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:37:39.545918 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4d190-4374-4b2a-acbb-d7946d4c94fe None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:37:39.598791 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:39.769671 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4d190-4374-4b2a-acbb-d7946d4c94fe None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:37:39.820523 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a980c-8e35-474e-b9aa-cf7f2b6c29eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:37:39.821303 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a980c-8e35-474e-b9aa-cf7f2b6c29eb None admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:39.821767 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a980c-8e35-474e-b9aa-cf7f2b6c29eb None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:39.822053 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a980c-8e35-474e-b9aa-cf7f2b6c29eb None admin] PATH_INFO: `/v3/projects/1fce7e814a024c5d875cbb6664695e81/users/8cef5b87502d4d93804d17b38c3164ed/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:39.824633 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a980c-8e35-474e-b9aa-cf7f2b6c29eb None admin] RBAC: Authorizing `identity:create_grant(project_id=1fce7e814a024c5d875cbb6664695e81, user_id=8cef5b87502d4d93804d17b38c3164ed, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:37:39.826151 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a980c-8e35-474e-b9aa-cf7f2b6c29eb None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:37:39.847866 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 595/1192] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Sep 8 13:37:39 2022] PUT /identity/v3/projects/1fce7e814a024c5d875cbb6664695e81/users/8cef5b87502d4d93804d17b38c3164ed/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:37:43.524202 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d22cc-0dc4-4ade-aeb4-71dd8f8d41f6 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:43.525028 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d22cc-0dc4-4ade-aeb4-71dd8f8d41f6 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:43.525182 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d22cc-0dc4-4ade-aeb4-71dd8f8d41f6 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:43.528048 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 598/1193] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:37:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:37:43.537425 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218417cb-a416-4f4b-844d-aa07c50f2328 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:43.538297 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218417cb-a416-4f4b-844d-aa07c50f2328 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:43.538297 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218417cb-a416-4f4b-844d-aa07c50f2328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:43.568079 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-218417cb-a416-4f4b-844d-aa07c50f2328 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:37:43.571167 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-218417cb-a416-4f4b-844d-aa07c50f2328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:37:43.702505 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 596/1194] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:37:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:37:44.041947 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d22cc-0dc4-4ade-aeb4-71dd8f8d41f6 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:37:44.282436 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d22cc-0dc4-4ade-aeb4-71dd8f8d41f6 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:37:44.363125 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5f848-7f9e-4666-b892-43057b1e7c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:37:44.364106 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5f848-7f9e-4666-b892-43057b1e7c37 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:44.364588 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5f848-7f9e-4666-b892-43057b1e7c37 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:44.365076 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5f848-7f9e-4666-b892-43057b1e7c37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:44.379822 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:44.388068 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec5f848-7f9e-4666-b892-43057b1e7c37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:37:44.398396 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-5ec5f848-7f9e-4666-b892-43057b1e7c37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:37:44.398396 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:37:44.398396 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:37:44.398396 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:37:44.398396 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:37:44.398396 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:37:44.398396 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:37:44.398396 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:37:44.398396 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:37:44.398396 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:37:44.398396 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:37:44.398396 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:37:44.398396 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:37:44.398396 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:37:44.398396 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:37:44.398396 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:37:44.400612 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:37:44.400612 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:37:44.400612 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:37:44.400612 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:37:44.400612 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:37:44.400612 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:37:44.400612 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:37:44.400612 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:37:44.400612 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:37:44.400612 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:37:44.400612 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:37:44.400612 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:37:44.400612 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:37:44.400612 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:37:44.400612 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:37:44.400612 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:37:44.402684 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:37:44.402684 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:37:44.402684 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:37:44.402684 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:37:44.402684 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:37:44.402684 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:37:44.402684 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:37:44.402684 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:37:44.402684 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:37:44.402684 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:37:44.402684 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:37:44.402684 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:37:44.402684 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 599/1195] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 8 13:37:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:37:44.411913 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218417cb-a416-4f4b-844d-aa07c50f2328 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:37:44.440416 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:44.603797 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218417cb-a416-4f4b-844d-aa07c50f2328 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:37:44.660052 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c050c-0a37-45f3-81ad-cf17613e877f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:37:44.660642 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c050c-0a37-45f3-81ad-cf17613e877f None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:44.660956 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c050c-0a37-45f3-81ad-cf17613e877f None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:44.661237 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695c050c-0a37-45f3-81ad-cf17613e877f None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:44.662018 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695c050c-0a37-45f3-81ad-cf17613e877f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:37:44.662328 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695c050c-0a37-45f3-81ad-cf17613e877f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:37:44.663945 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695c050c-0a37-45f3-81ad-cf17613e877f None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:37:44.675737 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 597/1196] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:37:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:37:44.683929 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5f848-7f9e-4666-b892-43057b1e7c37 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:37:44.884844 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5f848-7f9e-4666-b892-43057b1e7c37 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:37:44.954521 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e6ae2-786a-4572-b802-b9d8042ad09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:37:44.956889 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e6ae2-786a-4572-b802-b9d8042ad09f None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:44.957181 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e6ae2-786a-4572-b802-b9d8042ad09f None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:44.957491 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e6ae2-786a-4572-b802-b9d8042ad09f None admin] PATH_INFO: `/v3/users/8cef5b87502d4d93804d17b38c3164ed` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:44.959438 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8e6ae2-786a-4572-b802-b9d8042ad09f None admin] RBAC: Authorizing `identity:get_user(user_id=8cef5b87502d4d93804d17b38c3164ed)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:37:44.960968 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8e6ae2-786a-4572-b802-b9d8042ad09f None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:37:44.963548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 600/1197] 10.222.0.69 () {56 vars in 1177 bytes} [Thu Sep 8 13:37:44 2022] GET /identity/v3/users/8cef5b87502d4d93804d17b38c3164ed => generated 311 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:37:44.974490 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c050c-0a37-45f3-81ad-cf17613e877f None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:37:45.130775 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:45.188910 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695c050c-0a37-45f3-81ad-cf17613e877f None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:37:45.261336 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b3978-66bb-4181-b7b6-4ff73014e3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:37:45.261894 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b3978-66bb-4181-b7b6-4ff73014e3df None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:45.262171 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b3978-66bb-4181-b7b6-4ff73014e3df None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:45.262441 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b3978-66bb-4181-b7b6-4ff73014e3df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:45.366199 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b3978-66bb-4181-b7b6-4ff73014e3df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:37:45.367662 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b3978-66bb-4181-b7b6-4ff73014e3df None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:37:45.495564 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:45.535229 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 598/1198] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:37:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 13:37:45.542860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e6ae2-786a-4572-b802-b9d8042ad09f None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:37:45.659257 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:45.712297 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e6ae2-786a-4572-b802-b9d8042ad09f None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:37:45.766812 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6980f671-5dc9-43f9-8616-3fc137bd71f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:37:45.768245 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980f671-5dc9-43f9-8616-3fc137bd71f2 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:45.768524 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980f671-5dc9-43f9-8616-3fc137bd71f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:45.768851 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980f671-5dc9-43f9-8616-3fc137bd71f2 None admin] PATH_INFO: `/v3/projects/1fce7e814a024c5d875cbb6664695e81` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:45.770531 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6980f671-5dc9-43f9-8616-3fc137bd71f2 None admin] RBAC: Authorizing `identity:get_project(project_id=1fce7e814a024c5d875cbb6664695e81)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:37:45.773056 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6980f671-5dc9-43f9-8616-3fc137bd71f2 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:37:45.776349 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 601/1199] 10.222.0.69 () {56 vars in 1186 bytes} [Thu Sep 8 13:37:45 2022] GET /identity/v3/projects/1fce7e814a024c5d875cbb6664695e81 => generated 361 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:37:45.788858 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b3978-66bb-4181-b7b6-4ff73014e3df None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:37:45.933231 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b3978-66bb-4181-b7b6-4ff73014e3df None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:37:45.992311 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e1498d-bd6a-4fea-b86c-4aa4cc1a01dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:37:45.992943 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1498d-bd6a-4fea-b86c-4aa4cc1a01dd None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:37:45.993307 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1498d-bd6a-4fea-b86c-4aa4cc1a01dd None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:37:45.993833 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1498d-bd6a-4fea-b86c-4aa4cc1a01dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:37:45.994688 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1498d-bd6a-4fea-b86c-4aa4cc1a01dd None admin] RBAC: Adding query filter params (role.id=9c76f398c9e04caeab83842e70eb824b, scope.project.id=1fce7e814a024c5d875cbb6664695e81, user.id=8cef5b87502d4d93804d17b38c3164ed) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:37:45.995229 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1498d-bd6a-4fea-b86c-4aa4cc1a01dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:37:45.997780 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e1498d-bd6a-4fea-b86c-4aa4cc1a01dd None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:37:46.008123 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 599/1200] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 8 13:37:45 2022] GET /identity/v3/role_assignments?user.id=8cef5b87502d4d93804d17b38c3164ed&scope.project.id=1fce7e814a024c5d875cbb6664695e81&role.id=9c76f398c9e04caeab83842e70eb824b => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:37:55.759300 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=33 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:56.003671 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=81 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:38:58.780015 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404487f-80b0-4680-83ce-791dce058af4 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:38:58.781591 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404487f-80b0-4680-83ce-791dce058af4 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:38:58.781591 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404487f-80b0-4680-83ce-791dce058af4 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:38:58.784056 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 602/1201] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:38:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:38:58.795731 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f18c4-8fc0-4cdd-9ce2-5dbb7d409db3 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:38:58.795731 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f18c4-8fc0-4cdd-9ce2-5dbb7d409db3 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:38:58.795731 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f18c4-8fc0-4cdd-9ce2-5dbb7d409db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:38:58.826055 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-928f18c4-8fc0-4cdd-9ce2-5dbb7d409db3 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:38:58.829008 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-928f18c4-8fc0-4cdd-9ce2-5dbb7d409db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:38:58.991435 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 600/1202] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:38:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:38:59.625843 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404487f-80b0-4680-83ce-791dce058af4 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:38:59.914526 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404487f-80b0-4680-83ce-791dce058af4 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:38:59.997063 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ab45b-8d67-4688-b2cb-61e08f8bc836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:38:59.997930 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ab45b-8d67-4688-b2cb-61e08f8bc836 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:38:59.998311 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ab45b-8d67-4688-b2cb-61e08f8bc836 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:38:59.998597 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7ab45b-8d67-4688-b2cb-61e08f8bc836 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:00.022197 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7ab45b-8d67-4688-b2cb-61e08f8bc836 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:00.024663 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7ab45b-8d67-4688-b2cb-61e08f8bc836 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:00.054503 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-bc7ab45b-8d67-4688-b2cb-61e08f8bc836 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:39:00.054503 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:39:00.054503 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:39:00.054503 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:39:00.054503 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:39:00.054503 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:39:00.054503 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:39:00.054503 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:39:00.054503 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:39:00.054503 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:39:00.054503 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:39:00.054503 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:39:00.054503 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:39:00.054503 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:39:00.054503 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:39:00.054503 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:39:00.056708 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:39:00.056708 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:39:00.056708 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:39:00.056708 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:39:00.056708 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:39:00.056708 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:39:00.056708 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:39:00.056708 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:39:00.056708 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:39:00.056708 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:39:00.056708 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:39:00.056708 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:39:00.056708 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:39:00.056708 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:39:00.056708 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:39:00.056708 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:39:00.056708 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:39:00.058257 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:39:00.058257 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:39:00.058257 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:39:00.058257 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 603/1203] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:38:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 432 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:39:00.065314 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f18c4-8fc0-4cdd-9ce2-5dbb7d409db3 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:00.382044 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f18c4-8fc0-4cdd-9ce2-5dbb7d409db3 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:00.466809 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:00.487429 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c7dee-7003-465e-a071-15a91b7a606d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:00.488871 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c7dee-7003-465e-a071-15a91b7a606d None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:00.489727 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c7dee-7003-465e-a071-15a91b7a606d None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:00.490370 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c7dee-7003-465e-a071-15a91b7a606d None admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:00.491629 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c7dee-7003-465e-a071-15a91b7a606d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:39:00.492061 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c7dee-7003-465e-a071-15a91b7a606d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:00.494767 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c7dee-7003-465e-a071-15a91b7a606d None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:00.530551 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 601/1204] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:39:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 466 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:39:00.538456 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ab45b-8d67-4688-b2cb-61e08f8bc836 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:00.654071 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:00.787677 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7ab45b-8d67-4688-b2cb-61e08f8bc836 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:00.868536 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d3406-8ca7-48e8-a2c0-9b19ffa472e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:00.869563 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d3406-8ca7-48e8-a2c0-9b19ffa472e7 None admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:00.870013 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d3406-8ca7-48e8-a2c0-9b19ffa472e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:00.870489 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d3406-8ca7-48e8-a2c0-9b19ffa472e7 None admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:00.871768 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d3406-8ca7-48e8-a2c0-9b19ffa472e7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:00.875598 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d3406-8ca7-48e8-a2c0-9b19ffa472e7 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:00.931048 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 604/1205] 10.222.0.69 () {60 vars in 1132 bytes} [Thu Sep 8 13:39:00 2022] POST /identity/v3/users => generated 251 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:39:04.511472 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf1d83-715e-4dd6-b4aa-4964e5f77e2b None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:04.512476 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf1d83-715e-4dd6-b4aa-4964e5f77e2b None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:04.512476 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf1d83-715e-4dd6-b4aa-4964e5f77e2b None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:04.514598 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 602/1206] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:39:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:39:04.523079 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032b9a8-f6e1-4e54-ba86-d28b459b5984 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:04.525388 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032b9a8-f6e1-4e54-ba86-d28b459b5984 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:04.525388 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032b9a8-f6e1-4e54-ba86-d28b459b5984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:04.576285 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-e032b9a8-f6e1-4e54-ba86-d28b459b5984 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:39:04.580322 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-e032b9a8-f6e1-4e54-ba86-d28b459b5984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:39:04.729120 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 605/1207] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:39:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:39:05.138911 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf1d83-715e-4dd6-b4aa-4964e5f77e2b None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:05.434821 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf1d83-715e-4dd6-b4aa-4964e5f77e2b None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:05.503996 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789df13-072e-4611-8b94-5886fb90413c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:05.505155 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789df13-072e-4611-8b94-5886fb90413c None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:05.505606 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789df13-072e-4611-8b94-5886fb90413c None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:05.506097 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789df13-072e-4611-8b94-5886fb90413c None admin] PATH_INFO: `/v3/roles/service` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:05.531816 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789df13-072e-4611-8b94-5886fb90413c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:39:05.541864 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-2789df13-072e-4611-8b94-5886fb90413c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:39:05.541864 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:39:05.541864 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:39:05.541864 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:39:05.541864 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:39:05.541864 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:39:05.541864 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:39:05.541864 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:39:05.541864 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:39:05.541864 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:39:05.541864 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:39:05.541864 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:39:05.541864 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:39:05.541864 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:39:05.541864 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:39:05.541864 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:39:05.545997 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:39:05.545997 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:39:05.545997 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:39:05.545997 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:39:05.545997 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:39:05.545997 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:39:05.545997 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:39:05.545997 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:39:05.545997 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:39:05.545997 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:39:05.545997 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:39:05.545997 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:39:05.545997 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:39:05.545997 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:39:05.545997 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:39:05.545997 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:39:05.547906 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:39:05.547906 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:39:05.547906 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:39:05.547906 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:39:05.547906 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:39:05.547906 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:39:05.547906 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:39:05.547906 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:39:05.547906 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:39:05.547906 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:39:05.547906 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:39:05.547906 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:39:05.547906 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 603/1208] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Sep 8 13:39:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:39:05.552838 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032b9a8-f6e1-4e54-ba86-d28b459b5984 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:05.650793 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:05.800029 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032b9a8-f6e1-4e54-ba86-d28b459b5984 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:05.875976 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1799838-0aa9-46fc-8bf4-e3c04fe2477c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:05.877059 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1799838-0aa9-46fc-8bf4-e3c04fe2477c None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:05.877634 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1799838-0aa9-46fc-8bf4-e3c04fe2477c None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:05.878111 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1799838-0aa9-46fc-8bf4-e3c04fe2477c None admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:05.879779 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1799838-0aa9-46fc-8bf4-e3c04fe2477c None admin] RBAC: Adding query filter params (name=service) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:39:05.879945 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1799838-0aa9-46fc-8bf4-e3c04fe2477c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:05.882871 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1799838-0aa9-46fc-8bf4-e3c04fe2477c None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:05.910764 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 606/1209] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Sep 8 13:39:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:39:05.920506 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789df13-072e-4611-8b94-5886fb90413c None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:06.039922 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:06.125797 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789df13-072e-4611-8b94-5886fb90413c None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:06.182272 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c546fd8-0f87-44d1-b506-d88c74ceefe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:06.185436 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c546fd8-0f87-44d1-b506-d88c74ceefe2 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:06.185436 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c546fd8-0f87-44d1-b506-d88c74ceefe2 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:06.185436 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c546fd8-0f87-44d1-b506-d88c74ceefe2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:06.204398 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c546fd8-0f87-44d1-b506-d88c74ceefe2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:06.207179 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c546fd8-0f87-44d1-b506-d88c74ceefe2 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:06.243315 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-5c546fd8-0f87-44d1-b506-d88c74ceefe2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:39:06.243315 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:39:06.243315 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:39:06.243315 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:39:06.243315 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:39:06.243315 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:39:06.243315 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:39:06.243315 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:39:06.243315 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:39:06.243315 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:39:06.243315 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:39:06.243315 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:39:06.243315 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:39:06.243315 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:39:06.243315 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:39:06.243315 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:39:06.253158 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:39:06.253158 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:39:06.253158 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:39:06.253158 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:39:06.253158 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:39:06.253158 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:39:06.253158 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:39:06.253158 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:39:06.253158 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:39:06.253158 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:39:06.253158 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:39:06.253158 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:39:06.253158 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:39:06.253158 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:39:06.253158 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:39:06.253158 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:39:06.253158 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:39:06.254694 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:39:06.254694 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:39:06.254694 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:39:06.254694 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 604/1210] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:39:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:39:06.255165 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1799838-0aa9-46fc-8bf4-e3c04fe2477c None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:06.508068 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:06.514296 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1799838-0aa9-46fc-8bf4-e3c04fe2477c None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:06.591583 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a97d9e-8114-4bb4-bf3a-c0470c91d7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:06.593090 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a97d9e-8114-4bb4-bf3a-c0470c91d7ab None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:06.593090 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a97d9e-8114-4bb4-bf3a-c0470c91d7ab None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:06.593090 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a97d9e-8114-4bb4-bf3a-c0470c91d7ab None admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:06.595196 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a97d9e-8114-4bb4-bf3a-c0470c91d7ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:39:06.595705 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a97d9e-8114-4bb4-bf3a-c0470c91d7ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:06.598323 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a97d9e-8114-4bb4-bf3a-c0470c91d7ab None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:06.625326 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 607/1211] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:39:06.633259 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c546fd8-0f87-44d1-b506-d88c74ceefe2 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:06.839913 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c546fd8-0f87-44d1-b506-d88c74ceefe2 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:06.842756 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:06.917628 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678f010-811e-4610-9611-c4044c68f504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:06.918722 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678f010-811e-4610-9611-c4044c68f504 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:06.919193 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678f010-811e-4610-9611-c4044c68f504 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:06.919675 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678f010-811e-4610-9611-c4044c68f504 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:06.936631 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9678f010-811e-4610-9611-c4044c68f504 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:06.939939 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9678f010-811e-4610-9611-c4044c68f504 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:06.968267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-9678f010-811e-4610-9611-c4044c68f504 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 08 13:39:06.968267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:39:06.968267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:39:06.968267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:39:06.968267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:39:06.968267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:39:06.968267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:39:06.968267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:39:06.968267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:39:06.968267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:39:06.968267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:39:06.968267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:39:06.968267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:39:06.968267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:39:06.968267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:39:06.968267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:39:06.970242 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:39:06.970242 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:39:06.970242 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:39:06.970242 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:39:06.970242 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:39:06.970242 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:39:06.970242 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:39:06.970242 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:39:06.970242 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:39:06.970242 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:39:06.970242 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:39:06.970242 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:39:06.970242 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:39:06.970242 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:39:06.970242 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:39:06.970242 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:39:06.970242 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:39:06.970242 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:39:06.972194 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:39:06.972194 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:39:06.972194 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:39:06.972194 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:39:06.972194 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:39:06.972194 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:39:06.972194 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:39:06.972194 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:39:06.972194 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 08 13:39:06.972194 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:39:06.972194 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 605/1212] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:39:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:39:06.983005 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a97d9e-8114-4bb4-bf3a-c0470c91d7ab None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:07.201968 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a97d9e-8114-4bb4-bf3a-c0470c91d7ab None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:07.301141 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91701f93-c048-4d5d-99d9-1b89e419ef0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:07.302132 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91701f93-c048-4d5d-99d9-1b89e419ef0c None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:07.302680 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91701f93-c048-4d5d-99d9-1b89e419ef0c None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:07.303024 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91701f93-c048-4d5d-99d9-1b89e419ef0c None admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:07.304063 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91701f93-c048-4d5d-99d9-1b89e419ef0c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:39:07.304620 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91701f93-c048-4d5d-99d9-1b89e419ef0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:07.308978 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91701f93-c048-4d5d-99d9-1b89e419ef0c None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:07.349849 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 608/1213] 10.222.0.69 () {56 vars in 1143 bytes} [Thu Sep 8 13:39:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:39:07.360009 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678f010-811e-4610-9611-c4044c68f504 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:07.624999 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678f010-811e-4610-9611-c4044c68f504 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:07.690777 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c8311-24dd-447c-95ec-03e119b3a507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:07.692173 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c8311-24dd-447c-95ec-03e119b3a507 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:07.692316 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c8311-24dd-447c-95ec-03e119b3a507 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:07.693113 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c8311-24dd-447c-95ec-03e119b3a507 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:07.751191 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:07.832345 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c8311-24dd-447c-95ec-03e119b3a507 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:07.834246 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c8311-24dd-447c-95ec-03e119b3a507 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:08.033176 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 606/1214] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:39:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 675 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 13:39:08.041944 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91701f93-c048-4d5d-99d9-1b89e419ef0c None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:08.081840 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:08.227136 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91701f93-c048-4d5d-99d9-1b89e419ef0c None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:08.306509 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d2d39-adcd-4ca9-8eb1-0ffac5f63aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:08.307232 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d2d39-adcd-4ca9-8eb1-0ffac5f63aef None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:08.307612 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d2d39-adcd-4ca9-8eb1-0ffac5f63aef None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:08.308030 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d2d39-adcd-4ca9-8eb1-0ffac5f63aef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:08.329266 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63d2d39-adcd-4ca9-8eb1-0ffac5f63aef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:08.331425 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63d2d39-adcd-4ca9-8eb1-0ffac5f63aef None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:08.358468 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-d63d2d39-adcd-4ca9-8eb1-0ffac5f63aef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:39:08.358468 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:39:08.358468 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:39:08.358468 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:39:08.358468 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:39:08.358468 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:39:08.358468 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:39:08.358468 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:39:08.358468 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:39:08.358468 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:39:08.358468 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:39:08.358468 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:39:08.358468 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:39:08.358468 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:39:08.358468 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:39:08.358468 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:39:08.360860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:39:08.360860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:39:08.360860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:39:08.360860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:39:08.360860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:39:08.360860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:39:08.360860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:39:08.360860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:39:08.360860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:39:08.360860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:39:08.360860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:39:08.360860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:39:08.360860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:39:08.360860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:39:08.360860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:39:08.360860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:39:08.360860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:39:08.363316 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:39:08.363316 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:39:08.363316 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:39:08.363316 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 609/1215] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:39:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:39:08.370724 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c8311-24dd-447c-95ec-03e119b3a507 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:08.512921 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:08.587281 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c8311-24dd-447c-95ec-03e119b3a507 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:08.666521 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed4755-f659-47f1-9ca7-987b10f5975d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:08.667331 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed4755-f659-47f1-9ca7-987b10f5975d None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:08.667687 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed4755-f659-47f1-9ca7-987b10f5975d None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:08.668046 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed4755-f659-47f1-9ca7-987b10f5975d None admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:08.668838 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ed4755-f659-47f1-9ca7-987b10f5975d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:39:08.669227 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ed4755-f659-47f1-9ca7-987b10f5975d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:08.670758 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ed4755-f659-47f1-9ca7-987b10f5975d None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:08.688711 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 607/1216] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:39:08.698526 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d2d39-adcd-4ca9-8eb1-0ffac5f63aef None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:08.849959 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:08.914926 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d2d39-adcd-4ca9-8eb1-0ffac5f63aef None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:08.997658 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d444c235-b6d7-4e2d-90fb-eac1dcebe3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:08.998731 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444c235-b6d7-4e2d-90fb-eac1dcebe3b7 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:08.999206 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444c235-b6d7-4e2d-90fb-eac1dcebe3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:09.000133 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444c235-b6d7-4e2d-90fb-eac1dcebe3b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:09.016587 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d444c235-b6d7-4e2d-90fb-eac1dcebe3b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:09.020457 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d444c235-b6d7-4e2d-90fb-eac1dcebe3b7 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:09.047087 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-d444c235-b6d7-4e2d-90fb-eac1dcebe3b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:39:09.047087 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:39:09.047087 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:39:09.047087 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:39:09.047087 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:39:09.047087 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:39:09.047087 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:39:09.047087 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:39:09.047087 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:39:09.047087 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:39:09.047087 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:39:09.047087 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:39:09.047087 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:39:09.047087 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:39:09.047087 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:39:09.049950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:39:09.049950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:39:09.049950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:39:09.049950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:39:09.049950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:39:09.049950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:39:09.049950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:39:09.049950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:39:09.049950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:39:09.049950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:39:09.049950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:39:09.049950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:39:09.049950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:39:09.049950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:39:09.049950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:39:09.049950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:39:09.049950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:39:09.051073 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:39:09.051073 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:39:09.051073 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:39:09.051073 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:39:09.051073 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:39:09.051073 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:39:09.051073 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:39:09.051073 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:39:09.051073 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 610/1217] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:39:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:39:09.056869 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed4755-f659-47f1-9ca7-987b10f5975d None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:09.259354 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed4755-f659-47f1-9ca7-987b10f5975d None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:09.319469 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:09.353319 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878fa157-6b36-4a45-b56c-31c8ce7e1764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:09.354824 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fa157-6b36-4a45-b56c-31c8ce7e1764 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:09.355367 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fa157-6b36-4a45-b56c-31c8ce7e1764 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:09.356441 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fa157-6b36-4a45-b56c-31c8ce7e1764 None admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:09.358455 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878fa157-6b36-4a45-b56c-31c8ce7e1764 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:39:09.359327 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878fa157-6b36-4a45-b56c-31c8ce7e1764 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:09.364237 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878fa157-6b36-4a45-b56c-31c8ce7e1764 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:09.398919 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 608/1218] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 8 13:39:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:39:09.407706 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d444c235-b6d7-4e2d-90fb-eac1dcebe3b7 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:09.624041 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d444c235-b6d7-4e2d-90fb-eac1dcebe3b7 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:09.673475 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:09.685484 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde36cdf-da6e-4967-a4fc-d818e4b8b46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:09.686518 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde36cdf-da6e-4967-a4fc-d818e4b8b46f None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:09.687027 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde36cdf-da6e-4967-a4fc-d818e4b8b46f None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:09.687511 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde36cdf-da6e-4967-a4fc-d818e4b8b46f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:09.689332 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde36cdf-da6e-4967-a4fc-d818e4b8b46f None admin] RBAC: Adding query filter params (role.id=e5f27e532c9d4bc7a57e31856ecee597, scope.project.id=88de9f1470c6415b97866ad5a3256ef2, user.id=733797f12a1741e1a55332991e867aab) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:39:09.689945 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde36cdf-da6e-4967-a4fc-d818e4b8b46f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:09.692421 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde36cdf-da6e-4967-a4fc-d818e4b8b46f None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:09.704556 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 611/1219] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 8 13:39:09 2022] GET /identity/v3/role_assignments?user.id=733797f12a1741e1a55332991e867aab&scope.project.id=88de9f1470c6415b97866ad5a3256ef2&role.id=e5f27e532c9d4bc7a57e31856ecee597 => generated 259 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:39:13.305657 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e9dd9-ccee-4364-813b-e182f14b203f None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:13.306515 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e9dd9-ccee-4364-813b-e182f14b203f None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:13.306515 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e9dd9-ccee-4364-813b-e182f14b203f None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:13.308474 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 609/1220] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:39:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:39:13.318096 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7be33-344f-4dbc-9245-9af2d8ce0cd7 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:13.318692 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7be33-344f-4dbc-9245-9af2d8ce0cd7 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:13.318978 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7be33-344f-4dbc-9245-9af2d8ce0cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:13.350168 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-40e7be33-344f-4dbc-9245-9af2d8ce0cd7 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:39:13.352996 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-40e7be33-344f-4dbc-9245-9af2d8ce0cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:39:13.526520 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 612/1221] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:39:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:39:13.943919 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e9dd9-ccee-4364-813b-e182f14b203f None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:14.119142 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e9dd9-ccee-4364-813b-e182f14b203f None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:14.195923 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b06c6c-225f-4102-a72a-c54e766cb90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:14.197112 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b06c6c-225f-4102-a72a-c54e766cb90b None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:14.197717 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b06c6c-225f-4102-a72a-c54e766cb90b None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:14.198213 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b06c6c-225f-4102-a72a-c54e766cb90b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:14.216221 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b06c6c-225f-4102-a72a-c54e766cb90b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:39:14.224062 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-b3b06c6c-225f-4102-a72a-c54e766cb90b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:39:14.224062 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:39:14.224062 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:39:14.224062 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:39:14.224062 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:39:14.224062 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:39:14.224062 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:39:14.224062 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:39:14.224062 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:39:14.224062 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:39:14.224062 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:39:14.224062 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:39:14.224062 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:39:14.224062 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:39:14.224062 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:39:14.224062 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:39:14.226472 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:39:14.226472 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:39:14.226472 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:39:14.226472 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:39:14.226472 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:39:14.226472 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:39:14.226472 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:39:14.226472 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:39:14.226472 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:39:14.226472 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:39:14.226472 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:39:14.226472 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:39:14.226472 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:39:14.226472 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:39:14.226472 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:39:14.226472 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:39:14.228425 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:39:14.228425 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:39:14.228425 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:39:14.228425 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:39:14.228425 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:39:14.228425 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:39:14.228425 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:39:14.228425 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:39:14.228425 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:39:14.228425 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:39:14.228425 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:39:14.228425 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:39:14.228425 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 610/1222] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Sep 8 13:39:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:39:14.236649 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7be33-344f-4dbc-9245-9af2d8ce0cd7 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:14.464318 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7be33-344f-4dbc-9245-9af2d8ce0cd7 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:14.515575 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:14.538844 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34c7ef-4ff1-4190-bc27-ef47ad3d1f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:14.539850 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34c7ef-4ff1-4190-bc27-ef47ad3d1f4e None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:14.540325 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34c7ef-4ff1-4190-bc27-ef47ad3d1f4e None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:14.540888 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34c7ef-4ff1-4190-bc27-ef47ad3d1f4e None admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:14.540888 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf34c7ef-4ff1-4190-bc27-ef47ad3d1f4e None admin] RBAC: Adding query filter params (name=service) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:39:14.542250 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf34c7ef-4ff1-4190-bc27-ef47ad3d1f4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:14.544474 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf34c7ef-4ff1-4190-bc27-ef47ad3d1f4e None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:14.560330 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 613/1223] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Sep 8 13:39:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:39:14.572466 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b06c6c-225f-4102-a72a-c54e766cb90b None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:14.675353 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:14.806786 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b06c6c-225f-4102-a72a-c54e766cb90b None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:14.872744 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ffb12-f5b6-400f-8bc1-bf371f8a228c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:14.873895 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ffb12-f5b6-400f-8bc1-bf371f8a228c None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:14.874949 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ffb12-f5b6-400f-8bc1-bf371f8a228c None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:14.875497 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ffb12-f5b6-400f-8bc1-bf371f8a228c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:14.896732 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ffb12-f5b6-400f-8bc1-bf371f8a228c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:14.898348 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ffb12-f5b6-400f-8bc1-bf371f8a228c None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:14.930850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-3a4ffb12-f5b6-400f-8bc1-bf371f8a228c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:39:14.930850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:39:14.930850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:39:14.930850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:39:14.930850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:39:14.930850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:39:14.930850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:39:14.930850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:39:14.930850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:39:14.930850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:39:14.930850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:39:14.930850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:39:14.930850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:39:14.930850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:39:14.930850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:39:14.930850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:39:14.932452 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:39:14.932452 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:39:14.932452 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:39:14.932452 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:39:14.932452 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:39:14.932452 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:39:14.932452 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:39:14.932452 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:39:14.932452 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:39:14.932452 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:39:14.932452 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:39:14.932452 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:39:14.932452 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:39:14.932452 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:39:14.932452 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:39:14.932452 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:39:14.932452 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:39:14.933996 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:39:14.933996 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:39:14.933996 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:39:14.933996 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 611/1224] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:39:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:39:14.943632 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34c7ef-4ff1-4190-bc27-ef47ad3d1f4e None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:15.155677 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34c7ef-4ff1-4190-bc27-ef47ad3d1f4e None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:15.217539 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889d3dc-11e7-41ca-a2c6-2f05dbe2ff8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:15.218343 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889d3dc-11e7-41ca-a2c6-2f05dbe2ff8a None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:15.218645 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889d3dc-11e7-41ca-a2c6-2f05dbe2ff8a None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:15.218931 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889d3dc-11e7-41ca-a2c6-2f05dbe2ff8a None admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:15.219640 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7889d3dc-11e7-41ca-a2c6-2f05dbe2ff8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:39:15.219961 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7889d3dc-11e7-41ca-a2c6-2f05dbe2ff8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:15.221481 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7889d3dc-11e7-41ca-a2c6-2f05dbe2ff8a None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:15.246107 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 614/1225] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:39:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:39:15.251167 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ffb12-f5b6-400f-8bc1-bf371f8a228c None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:15.452269 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:15.475772 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ffb12-f5b6-400f-8bc1-bf371f8a228c None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:15.551456 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863efddd-428e-4194-8a0a-6bb730176f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:15.552888 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863efddd-428e-4194-8a0a-6bb730176f00 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:15.553704 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863efddd-428e-4194-8a0a-6bb730176f00 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:15.554385 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863efddd-428e-4194-8a0a-6bb730176f00 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:15.567903 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863efddd-428e-4194-8a0a-6bb730176f00 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:15.570712 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863efddd-428e-4194-8a0a-6bb730176f00 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:15.596290 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-863efddd-428e-4194-8a0a-6bb730176f00 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 08 13:39:15.596290 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:39:15.596290 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:39:15.596290 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:39:15.596290 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:39:15.596290 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:39:15.596290 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:39:15.596290 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:39:15.596290 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:39:15.596290 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:39:15.596290 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:39:15.596290 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:39:15.596290 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:39:15.596290 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:39:15.596290 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:39:15.596290 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:39:15.599793 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:39:15.599793 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:39:15.599793 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:39:15.599793 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:39:15.599793 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:39:15.599793 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:39:15.599793 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:39:15.599793 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:39:15.599793 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:39:15.599793 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:39:15.599793 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:39:15.599793 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:39:15.599793 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:39:15.599793 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:39:15.599793 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:39:15.599793 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:39:15.599793 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:39:15.599793 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:39:15.610479 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:39:15.610479 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:39:15.610479 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:39:15.610479 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:39:15.610479 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:39:15.610479 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:39:15.610479 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:39:15.610479 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:39:15.610479 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 08 13:39:15.610479 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:39:15.610479 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 612/1226] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:39:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:39:15.611854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889d3dc-11e7-41ca-a2c6-2f05dbe2ff8a None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:15.709406 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:15.814540 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889d3dc-11e7-41ca-a2c6-2f05dbe2ff8a None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:15.878678 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00553c2a-e6e3-4fa3-9322-0fe34efe524b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:15.879715 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00553c2a-e6e3-4fa3-9322-0fe34efe524b None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:15.880207 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00553c2a-e6e3-4fa3-9322-0fe34efe524b None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:15.880488 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00553c2a-e6e3-4fa3-9322-0fe34efe524b None admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:15.881253 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00553c2a-e6e3-4fa3-9322-0fe34efe524b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:39:15.881651 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00553c2a-e6e3-4fa3-9322-0fe34efe524b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:15.883315 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00553c2a-e6e3-4fa3-9322-0fe34efe524b None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:15.916012 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 615/1227] 10.222.0.69 () {56 vars in 1143 bytes} [Thu Sep 8 13:39:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:39:15.925337 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863efddd-428e-4194-8a0a-6bb730176f00 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:16.126605 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863efddd-428e-4194-8a0a-6bb730176f00 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:16.215092 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe432b3-c984-4651-9290-64e6a94941d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:16.216324 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe432b3-c984-4651-9290-64e6a94941d6 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:16.217002 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe432b3-c984-4651-9290-64e6a94941d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:16.217578 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe432b3-c984-4651-9290-64e6a94941d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:16.241936 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe432b3-c984-4651-9290-64e6a94941d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:16.244765 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe432b3-c984-4651-9290-64e6a94941d6 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:16.274157 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-5fe432b3-c984-4651-9290-64e6a94941d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:39:16.274157 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:39:16.274157 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:39:16.274157 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:39:16.274157 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:39:16.274157 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:39:16.274157 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:39:16.274157 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:39:16.274157 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:39:16.274157 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:39:16.274157 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:39:16.274157 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:39:16.274157 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:39:16.274157 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:39:16.274157 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:39:16.274157 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:39:16.275978 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:39:16.275978 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:39:16.275978 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:39:16.275978 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:39:16.275978 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:39:16.275978 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:39:16.275978 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:39:16.275978 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:39:16.275978 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:39:16.275978 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:39:16.275978 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:39:16.275978 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:39:16.275978 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:39:16.275978 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:39:16.275978 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:39:16.275978 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:39:16.275978 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:39:16.277846 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:39:16.277846 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:39:16.277846 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:39:16.277846 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 613/1228] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:39:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:39:16.283901 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00553c2a-e6e3-4fa3-9322-0fe34efe524b None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:16.482988 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00553c2a-e6e3-4fa3-9322-0fe34efe524b None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:16.487588 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:16.554620 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e739c2-961c-404a-9b3e-08efbec7968b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:16.555671 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e739c2-961c-404a-9b3e-08efbec7968b None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:16.557018 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e739c2-961c-404a-9b3e-08efbec7968b None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:16.557530 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e739c2-961c-404a-9b3e-08efbec7968b None admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:16.558385 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e739c2-961c-404a-9b3e-08efbec7968b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:39:16.558960 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e739c2-961c-404a-9b3e-08efbec7968b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:16.561212 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e739c2-961c-404a-9b3e-08efbec7968b None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:16.585240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 616/1229] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:39:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:39:16.596818 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe432b3-c984-4651-9290-64e6a94941d6 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:16.615318 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:16.783694 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe432b3-c984-4651-9290-64e6a94941d6 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:16.849912 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeaf24e-7517-4976-b049-5861198966cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:16.850969 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeaf24e-7517-4976-b049-5861198966cc None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:16.851448 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeaf24e-7517-4976-b049-5861198966cc None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:16.851916 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeaf24e-7517-4976-b049-5861198966cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:16.865116 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeaf24e-7517-4976-b049-5861198966cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:16.867518 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeaf24e-7517-4976-b049-5861198966cc None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:16.892145 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-8eeaf24e-7517-4976-b049-5861198966cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:39:16.892145 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:39:16.892145 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:39:16.892145 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:39:16.892145 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:39:16.892145 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:39:16.892145 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:39:16.892145 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:39:16.892145 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:39:16.892145 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:39:16.892145 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:39:16.892145 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:39:16.892145 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:39:16.892145 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:39:16.892145 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:39:16.899579 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:39:16.899579 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:39:16.899579 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:39:16.899579 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:39:16.899579 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:39:16.899579 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:39:16.899579 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:39:16.899579 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:39:16.899579 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:39:16.899579 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:39:16.899579 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:39:16.899579 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:39:16.899579 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:39:16.899579 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:39:16.899579 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:39:16.899579 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:39:16.899579 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:39:16.919794 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:39:16.919794 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:39:16.919794 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:39:16.919794 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:39:16.919794 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:39:16.919794 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:39:16.919794 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:39:16.919794 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:39:16.919794 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 614/1230] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:39:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:39:16.920850 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e739c2-961c-404a-9b3e-08efbec7968b None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:17.136715 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e739c2-961c-404a-9b3e-08efbec7968b None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:17.214865 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0922f3-d58a-4938-a428-31de7fd1d22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:17.215603 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0922f3-d58a-4938-a428-31de7fd1d22d None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:17.216177 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0922f3-d58a-4938-a428-31de7fd1d22d None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:17.219066 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0922f3-d58a-4938-a428-31de7fd1d22d None admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:17.220283 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0922f3-d58a-4938-a428-31de7fd1d22d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:39:17.220283 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0922f3-d58a-4938-a428-31de7fd1d22d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:17.222096 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0922f3-d58a-4938-a428-31de7fd1d22d None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:17.253427 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 617/1231] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 8 13:39:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:39:17.256218 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeaf24e-7517-4976-b049-5861198966cc None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:17.425444 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:17.521030 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeaf24e-7517-4976-b049-5861198966cc None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:17.601258 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d73f2-758a-4ef2-992c-093df4020c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:17.602471 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d73f2-758a-4ef2-992c-093df4020c90 None admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:17.602912 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d73f2-758a-4ef2-992c-093df4020c90 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:17.603402 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d73f2-758a-4ef2-992c-093df4020c90 None admin] PATH_INFO: `/v3/projects/88de9f1470c6415b97866ad5a3256ef2/users/733797f12a1741e1a55332991e867aab/roles/e5f27e532c9d4bc7a57e31856ecee597` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:17.631031 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968d73f2-758a-4ef2-992c-093df4020c90 None admin] RBAC: Authorizing `identity:create_grant(project_id=88de9f1470c6415b97866ad5a3256ef2, user_id=733797f12a1741e1a55332991e867aab, role_id=e5f27e532c9d4bc7a57e31856ecee597)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:17.633924 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968d73f2-758a-4ef2-992c-093df4020c90 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:17.664124 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 615/1232] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Sep 8 13:39:17 2022] PUT /identity/v3/projects/88de9f1470c6415b97866ad5a3256ef2/users/733797f12a1741e1a55332991e867aab/roles/e5f27e532c9d4bc7a57e31856ecee597 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:39:20.820045 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bd1d2-2a7d-43a2-9172-858f71977fd3 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:20.821960 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bd1d2-2a7d-43a2-9172-858f71977fd3 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:20.821960 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bd1d2-2a7d-43a2-9172-858f71977fd3 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:20.823768 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 618/1233] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:39:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:39:20.836065 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c904dd-427e-418c-bfa4-2d47ee08b900 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:20.837257 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c904dd-427e-418c-bfa4-2d47ee08b900 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:20.837257 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c904dd-427e-418c-bfa4-2d47ee08b900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:20.874865 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-03c904dd-427e-418c-bfa4-2d47ee08b900 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:39:20.877687 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-03c904dd-427e-418c-bfa4-2d47ee08b900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:39:21.033902 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 616/1234] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:39:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:39:21.610762 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3bd1d2-2a7d-43a2-9172-858f71977fd3 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:21.665417 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:21.855597 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3bd1d2-2a7d-43a2-9172-858f71977fd3 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:21.933266 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a53418-6e17-42a6-a0e1-b65f0a2e0466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:21.934686 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a53418-6e17-42a6-a0e1-b65f0a2e0466 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:21.935505 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a53418-6e17-42a6-a0e1-b65f0a2e0466 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:21.936228 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a53418-6e17-42a6-a0e1-b65f0a2e0466 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:21.965733 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a53418-6e17-42a6-a0e1-b65f0a2e0466 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:39:21.971349 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-18a53418-6e17-42a6-a0e1-b65f0a2e0466 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:39:21.971349 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:39:21.971349 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:39:21.971349 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:39:21.971349 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:39:21.971349 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:39:21.971349 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:39:21.971349 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:39:21.971349 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:39:21.971349 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:39:21.971349 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:39:21.971349 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:39:21.971349 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:39:21.971349 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:39:21.971349 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:39:21.971349 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:39:21.973687 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:39:21.973687 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:39:21.973687 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:39:21.973687 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:39:21.973687 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:39:21.973687 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:39:21.973687 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:39:21.973687 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:39:21.973687 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:39:21.973687 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:39:21.973687 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:39:21.973687 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:39:21.973687 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:39:21.973687 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:39:21.973687 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:39:21.973687 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:39:21.976083 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:39:21.976083 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:39:21.976083 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:39:21.976083 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:39:21.976083 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:39:21.976083 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:39:21.976083 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:39:21.976083 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:39:21.976083 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:39:21.976083 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:39:21.976083 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 08 13:39:21.976083 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:39:21.976083 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 619/1235] 10.222.0.69 () {56 vars in 1102 bytes} [Thu Sep 8 13:39:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:39:21.983541 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c904dd-427e-418c-bfa4-2d47ee08b900 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:22.095610 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:22.246670 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c904dd-427e-418c-bfa4-2d47ee08b900 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:22.354541 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46dccb2-f13a-4993-9c2c-df6d705c8135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:22.358987 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46dccb2-f13a-4993-9c2c-df6d705c8135 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:22.359884 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46dccb2-f13a-4993-9c2c-df6d705c8135 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:22.360357 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46dccb2-f13a-4993-9c2c-df6d705c8135 None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:22.361690 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46dccb2-f13a-4993-9c2c-df6d705c8135 None admin] RBAC: Adding query filter params (name=service) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:39:22.362244 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46dccb2-f13a-4993-9c2c-df6d705c8135 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:22.364810 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46dccb2-f13a-4993-9c2c-df6d705c8135 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:22.384721 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 617/1236] 10.222.0.69 () {56 vars in 1103 bytes} [Thu Sep 8 13:39:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:39:22.396464 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a53418-6e17-42a6-a0e1-b65f0a2e0466 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:22.580253 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:22.622640 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a53418-6e17-42a6-a0e1-b65f0a2e0466 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:22.677929 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767551b-b608-4b77-9278-0e53bafe2cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:22.678753 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767551b-b608-4b77-9278-0e53bafe2cf1 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:22.679038 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767551b-b608-4b77-9278-0e53bafe2cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:22.679312 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767551b-b608-4b77-9278-0e53bafe2cf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:22.692901 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6767551b-b608-4b77-9278-0e53bafe2cf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:22.694446 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6767551b-b608-4b77-9278-0e53bafe2cf1 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:22.715039 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-6767551b-b608-4b77-9278-0e53bafe2cf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:39:22.715039 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:39:22.715039 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:39:22.715039 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:39:22.715039 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:39:22.715039 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:39:22.715039 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:39:22.715039 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:39:22.715039 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:39:22.715039 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:39:22.715039 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:39:22.715039 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:39:22.715039 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:39:22.715039 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:39:22.715039 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:39:22.715039 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:39:22.716963 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:39:22.716963 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:39:22.716963 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:39:22.716963 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:39:22.716963 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:39:22.716963 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:39:22.716963 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:39:22.716963 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:39:22.716963 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:39:22.716963 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:39:22.716963 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:39:22.716963 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:39:22.716963 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:39:22.716963 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:39:22.716963 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:39:22.716963 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:39:22.716963 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:39:22.718973 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:39:22.718973 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:39:22.718973 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:39:22.718973 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 620/1237] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:39:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:39:22.726989 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46dccb2-f13a-4993-9c2c-df6d705c8135 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:22.959288 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46dccb2-f13a-4993-9c2c-df6d705c8135 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:22.980777 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:23.042522 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06330a7a-9ca5-4027-a2ac-166b9030ab5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:23.043723 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06330a7a-9ca5-4027-a2ac-166b9030ab5d None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:23.043900 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06330a7a-9ca5-4027-a2ac-166b9030ab5d None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:23.044340 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06330a7a-9ca5-4027-a2ac-166b9030ab5d None admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:23.045459 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06330a7a-9ca5-4027-a2ac-166b9030ab5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:39:23.046393 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06330a7a-9ca5-4027-a2ac-166b9030ab5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:23.049071 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06330a7a-9ca5-4027-a2ac-166b9030ab5d None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:23.081192 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 618/1238] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:39:23.088615 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767551b-b608-4b77-9278-0e53bafe2cf1 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:23.317007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767551b-b608-4b77-9278-0e53bafe2cf1 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:23.400430 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d615607-32bb-4d8e-b83d-52a6c183423f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:23.401263 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d615607-32bb-4d8e-b83d-52a6c183423f None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:23.401578 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d615607-32bb-4d8e-b83d-52a6c183423f None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:23.401849 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d615607-32bb-4d8e-b83d-52a6c183423f None admin] PATH_INFO: `/v3/users/placement` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:23.406949 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:23.416876 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d615607-32bb-4d8e-b83d-52a6c183423f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:23.419526 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d615607-32bb-4d8e-b83d-52a6c183423f None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:23.442635 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-4d615607-32bb-4d8e-b83d-52a6c183423f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 08 13:39:23.442635 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:39:23.442635 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:39:23.442635 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:39:23.442635 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:39:23.442635 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:39:23.442635 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:39:23.442635 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:39:23.442635 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:39:23.442635 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:39:23.442635 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:39:23.442635 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:39:23.442635 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:39:23.442635 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:39:23.442635 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:39:23.442635 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:39:23.444757 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:39:23.444757 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:39:23.444757 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:39:23.444757 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:39:23.444757 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:39:23.444757 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:39:23.444757 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:39:23.444757 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:39:23.444757 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:39:23.444757 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:39:23.444757 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:39:23.444757 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:39:23.444757 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:39:23.444757 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:39:23.444757 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:39:23.444757 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:39:23.444757 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:39:23.444757 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:39:23.447245 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:39:23.447245 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:39:23.447245 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:39:23.447245 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:39:23.447245 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:39:23.447245 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:39:23.447245 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:39:23.447245 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:39:23.447245 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 08 13:39:23.447245 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:39:23.447245 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 621/1239] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:39:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:39:23.456012 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06330a7a-9ca5-4027-a2ac-166b9030ab5d None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:23.669965 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06330a7a-9ca5-4027-a2ac-166b9030ab5d None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:23.759114 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca48ba3-7014-409d-a54b-f3cfff9a5ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:23.760143 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca48ba3-7014-409d-a54b-f3cfff9a5ce8 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:23.760581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca48ba3-7014-409d-a54b-f3cfff9a5ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:23.761006 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca48ba3-7014-409d-a54b-f3cfff9a5ce8 None admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:23.762322 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca48ba3-7014-409d-a54b-f3cfff9a5ce8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:39:23.762884 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca48ba3-7014-409d-a54b-f3cfff9a5ce8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:23.765874 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca48ba3-7014-409d-a54b-f3cfff9a5ce8 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:23.805968 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 619/1240] 10.222.0.69 () {56 vars in 1143 bytes} [Thu Sep 8 13:39:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:39:23.822185 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d615607-32bb-4d8e-b83d-52a6c183423f None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:24.058405 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d615607-32bb-4d8e-b83d-52a6c183423f None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:24.122913 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09eec49-08b7-4a5d-bd82-7d9b7aa8663c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:24.124518 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09eec49-08b7-4a5d-bd82-7d9b7aa8663c None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:24.124972 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09eec49-08b7-4a5d-bd82-7d9b7aa8663c None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:24.125435 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09eec49-08b7-4a5d-bd82-7d9b7aa8663c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:24.283821 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:24.305491 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09eec49-08b7-4a5d-bd82-7d9b7aa8663c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:24.309294 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09eec49-08b7-4a5d-bd82-7d9b7aa8663c None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:24.559110 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 622/1241] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:39:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 738 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 08 13:39:24.571743 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca48ba3-7014-409d-a54b-f3cfff9a5ce8 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:24.633097 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:24.794152 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca48ba3-7014-409d-a54b-f3cfff9a5ce8 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:24.867227 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b3ad7-a19a-47e3-af44-f1d5d49ece5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:24.868309 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b3ad7-a19a-47e3-af44-f1d5d49ece5f None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:24.868773 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b3ad7-a19a-47e3-af44-f1d5d49ece5f None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:24.869189 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b3ad7-a19a-47e3-af44-f1d5d49ece5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:24.894176 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6b3ad7-a19a-47e3-af44-f1d5d49ece5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:24.897066 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6b3ad7-a19a-47e3-af44-f1d5d49ece5f None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:24.923509 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-4b6b3ad7-a19a-47e3-af44-f1d5d49ece5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:39:24.923509 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:39:24.923509 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:39:24.923509 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:39:24.923509 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:39:24.923509 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:39:24.923509 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:39:24.923509 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:39:24.923509 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:39:24.923509 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:39:24.923509 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:39:24.923509 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:39:24.923509 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:39:24.923509 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:39:24.923509 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:39:24.923509 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:39:24.934693 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:39:24.934693 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:39:24.934693 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:39:24.934693 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:39:24.934693 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:39:24.934693 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:39:24.934693 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:39:24.934693 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:39:24.934693 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:39:24.934693 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:39:24.934693 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:39:24.934693 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:39:24.934693 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:39:24.934693 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:39:24.934693 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:39:24.934693 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:39:24.934693 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:39:24.936943 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:39:24.936943 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:39:24.936943 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:39:24.936943 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 620/1242] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:39:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:39:24.937401 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09eec49-08b7-4a5d-bd82-7d9b7aa8663c None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:25.155713 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:25.166558 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09eec49-08b7-4a5d-bd82-7d9b7aa8663c None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:25.245180 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd8b103-fcc2-4ff5-9e06-b5b09e6234e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:25.246149 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8b103-fcc2-4ff5-9e06-b5b09e6234e0 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:25.246671 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8b103-fcc2-4ff5-9e06-b5b09e6234e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:25.247179 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd8b103-fcc2-4ff5-9e06-b5b09e6234e0 None admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:25.247763 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd8b103-fcc2-4ff5-9e06-b5b09e6234e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:39:25.248090 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd8b103-fcc2-4ff5-9e06-b5b09e6234e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:25.251027 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd8b103-fcc2-4ff5-9e06-b5b09e6234e0 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:25.283070 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 623/1243] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:39:25.302225 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b3ad7-a19a-47e3-af44-f1d5d49ece5f None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:25.483033 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:25.532717 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b3ad7-a19a-47e3-af44-f1d5d49ece5f None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:25.614806 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9952636-6562-45bc-81bd-8e150dd3301b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:25.615893 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9952636-6562-45bc-81bd-8e150dd3301b None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:25.616283 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9952636-6562-45bc-81bd-8e150dd3301b None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:25.616764 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9952636-6562-45bc-81bd-8e150dd3301b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:25.631350 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9952636-6562-45bc-81bd-8e150dd3301b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:25.634266 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9952636-6562-45bc-81bd-8e150dd3301b None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:25.660242 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-f9952636-6562-45bc-81bd-8e150dd3301b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:39:25.660242 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:39:25.660242 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:39:25.660242 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:39:25.660242 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:39:25.660242 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:39:25.660242 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:39:25.660242 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:39:25.660242 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:39:25.660242 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:39:25.660242 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:39:25.660242 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:39:25.660242 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:39:25.660242 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:39:25.660242 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:39:25.662616 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:39:25.662616 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:39:25.662616 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:39:25.662616 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:39:25.662616 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:39:25.662616 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:39:25.662616 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:39:25.662616 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:39:25.662616 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:39:25.662616 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:39:25.662616 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:39:25.662616 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:39:25.662616 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:39:25.662616 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:39:25.662616 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:39:25.662616 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:39:25.662616 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:39:25.664796 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:39:25.664796 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:39:25.664796 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:39:25.664796 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:39:25.664796 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:39:25.664796 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:39:25.664796 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:39:25.664796 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:39:25.669613 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 621/1244] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:39:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:39:25.673296 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd8b103-fcc2-4ff5-9e06-b5b09e6234e0 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:25.877745 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd8b103-fcc2-4ff5-9e06-b5b09e6234e0 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:25.960549 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c969ec0-d626-4401-ae5f-477c2857cd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:25.961617 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c969ec0-d626-4401-ae5f-477c2857cd4e None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:25.962078 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c969ec0-d626-4401-ae5f-477c2857cd4e None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:25.962591 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c969ec0-d626-4401-ae5f-477c2857cd4e None admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:25.964059 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c969ec0-d626-4401-ae5f-477c2857cd4e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:39:25.964575 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c969ec0-d626-4401-ae5f-477c2857cd4e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:25.967094 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c969ec0-d626-4401-ae5f-477c2857cd4e None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:25.991217 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 624/1245] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 8 13:39:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:39:26.000535 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9952636-6562-45bc-81bd-8e150dd3301b None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:26.204121 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9952636-6562-45bc-81bd-8e150dd3301b None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:26.261980 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2ba00-4240-488c-9d94-14783d3af60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:26.263130 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2ba00-4240-488c-9d94-14783d3af60b None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:26.263588 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2ba00-4240-488c-9d94-14783d3af60b None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:26.263895 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2ba00-4240-488c-9d94-14783d3af60b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:26.266146 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2ba00-4240-488c-9d94-14783d3af60b None admin] RBAC: Adding query filter params (role.id=e5f27e532c9d4bc7a57e31856ecee597, scope.project.id=88de9f1470c6415b97866ad5a3256ef2, user.id=733797f12a1741e1a55332991e867aab) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:39:26.266478 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2ba00-4240-488c-9d94-14783d3af60b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:26.268460 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2ba00-4240-488c-9d94-14783d3af60b None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:26.279592 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 622/1246] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 8 13:39:25 2022] GET /identity/v3/role_assignments?user.id=733797f12a1741e1a55332991e867aab&scope.project.id=88de9f1470c6415b97866ad5a3256ef2&role.id=e5f27e532c9d4bc7a57e31856ecee597 => generated 608 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:39:29.772835 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d47a0d-5556-4938-a9e5-28e5674b4e67 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:29.773656 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d47a0d-5556-4938-a9e5-28e5674b4e67 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:29.773847 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d47a0d-5556-4938-a9e5-28e5674b4e67 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:29.776941 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 625/1247] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:39:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:39:29.785914 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08bbff-0c50-4a6e-9114-543bbbefca91 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:29.786467 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08bbff-0c50-4a6e-9114-543bbbefca91 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:29.786880 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08bbff-0c50-4a6e-9114-543bbbefca91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:29.797768 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:29.821695 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-5a08bbff-0c50-4a6e-9114-543bbbefca91 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:39:29.823838 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-5a08bbff-0c50-4a6e-9114-543bbbefca91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:39:29.954225 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 623/1248] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:39:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:39:30.352026 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d47a0d-5556-4938-a9e5-28e5674b4e67 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:30.384698 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:30.567293 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d47a0d-5556-4938-a9e5-28e5674b4e67 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:30.652021 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9c72f-499d-4635-82bf-0ca4473ca9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:30.653141 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9c72f-499d-4635-82bf-0ca4473ca9f2 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:30.653802 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9c72f-499d-4635-82bf-0ca4473ca9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:30.654157 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9c72f-499d-4635-82bf-0ca4473ca9f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:30.683300 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d9c72f-499d-4635-82bf-0ca4473ca9f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:39:30.694918 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-26d9c72f-499d-4635-82bf-0ca4473ca9f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:39:30.694918 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:39:30.694918 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:39:30.694918 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:39:30.694918 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:39:30.694918 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:39:30.694918 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:39:30.694918 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:39:30.694918 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:39:30.694918 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:39:30.694918 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:39:30.694918 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:39:30.694918 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:39:30.694918 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:39:30.694918 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:39:30.694918 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:39:30.701452 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:39:30.701452 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:39:30.701452 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:39:30.701452 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:39:30.701452 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:39:30.701452 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:39:30.701452 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:39:30.701452 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:39:30.701452 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:39:30.701452 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:39:30.701452 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:39:30.701452 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:39:30.701452 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:39:30.701452 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:39:30.701452 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:39:30.701452 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:39:30.703645 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:39:30.703645 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:39:30.703645 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:39:30.703645 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:39:30.703645 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:39:30.703645 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:39:30.703645 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:39:30.703645 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:39:30.703645 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:39:30.703645 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:39:30.703645 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:39:30.703645 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:39:30.703645 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 626/1249] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 8 13:39:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:39:30.706665 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08bbff-0c50-4a6e-9114-543bbbefca91 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:30.894582 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08bbff-0c50-4a6e-9114-543bbbefca91 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:30.933916 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:30.942111 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e855af-9f84-4349-93c3-8b3de056b4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:30.942839 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e855af-9f84-4349-93c3-8b3de056b4b3 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:30.943138 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e855af-9f84-4349-93c3-8b3de056b4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:30.943493 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e855af-9f84-4349-93c3-8b3de056b4b3 None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:30.944320 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e855af-9f84-4349-93c3-8b3de056b4b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:39:30.944809 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e855af-9f84-4349-93c3-8b3de056b4b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:30.946299 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e855af-9f84-4349-93c3-8b3de056b4b3 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:30.961342 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 624/1250] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:39:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:39:30.971639 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9c72f-499d-4635-82bf-0ca4473ca9f2 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:31.101227 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:31.150056 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9c72f-499d-4635-82bf-0ca4473ca9f2 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:31.199655 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec538955-4680-499e-8b34-4d07cfff744d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:31.200308 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec538955-4680-499e-8b34-4d07cfff744d None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:31.200590 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec538955-4680-499e-8b34-4d07cfff744d None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:31.200866 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec538955-4680-499e-8b34-4d07cfff744d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:31.216545 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec538955-4680-499e-8b34-4d07cfff744d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:31.218642 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec538955-4680-499e-8b34-4d07cfff744d None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:31.238562 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-ec538955-4680-499e-8b34-4d07cfff744d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:39:31.238562 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:39:31.238562 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:39:31.238562 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:39:31.238562 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:39:31.238562 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:39:31.238562 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:39:31.238562 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:39:31.238562 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:39:31.238562 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:39:31.238562 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:39:31.238562 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:39:31.238562 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:39:31.238562 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:39:31.238562 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:39:31.238562 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:39:31.240628 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:39:31.240628 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:39:31.240628 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:39:31.240628 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:39:31.240628 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:39:31.240628 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:39:31.240628 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:39:31.240628 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:39:31.240628 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:39:31.240628 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:39:31.240628 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:39:31.240628 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:39:31.240628 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:39:31.240628 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:39:31.240628 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:39:31.240628 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:39:31.240628 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:39:31.242640 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:39:31.242640 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:39:31.242640 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:39:31.245745 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 627/1251] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:39:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:39:31.247030 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e855af-9f84-4349-93c3-8b3de056b4b3 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:31.440268 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e855af-9f84-4349-93c3-8b3de056b4b3 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:31.512806 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fedab64-50b9-433c-9c0c-7e7d9fd5dfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:31.513813 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedab64-50b9-433c-9c0c-7e7d9fd5dfbf None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:31.514473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedab64-50b9-433c-9c0c-7e7d9fd5dfbf None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:31.515175 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedab64-50b9-433c-9c0c-7e7d9fd5dfbf None admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:31.516925 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fedab64-50b9-433c-9c0c-7e7d9fd5dfbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:39:31.517458 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fedab64-50b9-433c-9c0c-7e7d9fd5dfbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:31.520103 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fedab64-50b9-433c-9c0c-7e7d9fd5dfbf None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:31.545597 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 625/1252] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:39:31.553609 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec538955-4680-499e-8b34-4d07cfff744d None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:31.760882 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec538955-4680-499e-8b34-4d07cfff744d None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:31.808176 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:31.822776 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a6bf3-3aef-4a59-871e-425748dc5bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:31.823965 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a6bf3-3aef-4a59-871e-425748dc5bc1 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:31.824477 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a6bf3-3aef-4a59-871e-425748dc5bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:31.824997 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a6bf3-3aef-4a59-871e-425748dc5bc1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:31.838108 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a6bf3-3aef-4a59-871e-425748dc5bc1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:31.840498 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a6bf3-3aef-4a59-871e-425748dc5bc1 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:31.859012 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-8c1a6bf3-3aef-4a59-871e-425748dc5bc1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 08 13:39:31.859012 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:39:31.859012 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:39:31.859012 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:39:31.859012 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:39:31.859012 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:39:31.859012 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:39:31.859012 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:39:31.859012 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:39:31.859012 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:39:31.859012 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:39:31.859012 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:39:31.859012 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:39:31.859012 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:39:31.859012 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:39:31.859012 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:39:31.861419 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:39:31.861419 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:39:31.861419 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:39:31.861419 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:39:31.861419 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:39:31.861419 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:39:31.861419 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:39:31.861419 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:39:31.861419 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:39:31.861419 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:39:31.861419 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:39:31.861419 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:39:31.861419 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:39:31.861419 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:39:31.861419 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:39:31.861419 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:39:31.861419 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:39:31.861419 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:39:31.863552 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:39:31.863552 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:39:31.863552 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:39:31.863552 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:39:31.863552 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:39:31.863552 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:39:31.863552 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:39:31.863552 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:39:31.863552 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 08 13:39:31.863552 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:39:31.863552 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 628/1253] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:39:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:39:31.870876 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fedab64-50b9-433c-9c0c-7e7d9fd5dfbf None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:31.982676 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:32.052233 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fedab64-50b9-433c-9c0c-7e7d9fd5dfbf None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:32.108735 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902985a-0d48-4e95-85a0-b35ef6d434af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:32.109404 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902985a-0d48-4e95-85a0-b35ef6d434af None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:32.109858 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902985a-0d48-4e95-85a0-b35ef6d434af None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:32.110057 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902985a-0d48-4e95-85a0-b35ef6d434af None admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:32.110966 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5902985a-0d48-4e95-85a0-b35ef6d434af None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:39:32.111446 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5902985a-0d48-4e95-85a0-b35ef6d434af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:32.113095 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5902985a-0d48-4e95-85a0-b35ef6d434af None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:32.148332 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 626/1254] 10.222.0.69 () {56 vars in 1143 bytes} [Thu Sep 8 13:39:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:39:32.157415 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a6bf3-3aef-4a59-871e-425748dc5bc1 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:32.323608 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a6bf3-3aef-4a59-871e-425748dc5bc1 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:32.387061 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29d19f-811b-4490-9118-2cc96e1e904b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:32.387878 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29d19f-811b-4490-9118-2cc96e1e904b None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:32.388089 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29d19f-811b-4490-9118-2cc96e1e904b None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:32.388282 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec29d19f-811b-4490-9118-2cc96e1e904b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:32.519276 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:32.550485 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec29d19f-811b-4490-9118-2cc96e1e904b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:32.553313 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec29d19f-811b-4490-9118-2cc96e1e904b None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:32.766522 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 629/1255] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:39:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 13:39:32.773750 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902985a-0d48-4e95-85a0-b35ef6d434af None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:33.002623 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902985a-0d48-4e95-85a0-b35ef6d434af None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:33.026670 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:33.063802 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016a242-9dd7-47fd-bb12-b2ecc7711b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:33.064791 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016a242-9dd7-47fd-bb12-b2ecc7711b26 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:33.065199 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016a242-9dd7-47fd-bb12-b2ecc7711b26 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:33.067761 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016a242-9dd7-47fd-bb12-b2ecc7711b26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:33.085535 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6016a242-9dd7-47fd-bb12-b2ecc7711b26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:33.087715 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6016a242-9dd7-47fd-bb12-b2ecc7711b26 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:33.112463 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-6016a242-9dd7-47fd-bb12-b2ecc7711b26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:39:33.112463 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:39:33.112463 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:39:33.112463 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:39:33.112463 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:39:33.112463 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:39:33.112463 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:39:33.112463 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:39:33.112463 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:39:33.112463 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:39:33.112463 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:39:33.112463 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:39:33.112463 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:39:33.112463 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:39:33.112463 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:39:33.112463 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:39:33.114744 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:39:33.114744 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:39:33.114744 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:39:33.114744 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:39:33.114744 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:39:33.114744 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:39:33.114744 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:39:33.114744 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:39:33.114744 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:39:33.114744 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:39:33.114744 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:39:33.114744 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:39:33.114744 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:39:33.114744 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:39:33.114744 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:39:33.114744 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:39:33.114744 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:39:33.116789 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:39:33.116789 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:39:33.116789 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:39:33.116789 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 627/1256] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:39:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:39:33.122667 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29d19f-811b-4490-9118-2cc96e1e904b None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:33.262966 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:33.285148 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec29d19f-811b-4490-9118-2cc96e1e904b None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:33.339482 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7fe59-c971-404f-b4c2-7692bfb997fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:33.340203 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7fe59-c971-404f-b4c2-7692bfb997fa None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:33.340491 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7fe59-c971-404f-b4c2-7692bfb997fa None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:33.340766 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7fe59-c971-404f-b4c2-7692bfb997fa None admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:33.341565 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7fe59-c971-404f-b4c2-7692bfb997fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:39:33.341881 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7fe59-c971-404f-b4c2-7692bfb997fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:33.344247 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7fe59-c971-404f-b4c2-7692bfb997fa None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:33.360990 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 630/1257] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:39:33.368053 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016a242-9dd7-47fd-bb12-b2ecc7711b26 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:33.538660 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016a242-9dd7-47fd-bb12-b2ecc7711b26 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:33.588162 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab809dfa-8080-45b1-870b-6165bd008def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:33.588848 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab809dfa-8080-45b1-870b-6165bd008def None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:33.589151 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab809dfa-8080-45b1-870b-6165bd008def None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:33.589466 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab809dfa-8080-45b1-870b-6165bd008def None admin] PATH_INFO: `/v3/projects/service` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:33.598709 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab809dfa-8080-45b1-870b-6165bd008def None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:33.601140 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab809dfa-8080-45b1-870b-6165bd008def None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:33.616444 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-ab809dfa-8080-45b1-870b-6165bd008def None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:39:33.616444 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:39:33.616444 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:39:33.616444 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:39:33.616444 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:39:33.616444 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:39:33.616444 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:39:33.616444 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:39:33.616444 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:39:33.616444 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:39:33.616444 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:39:33.616444 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:39:33.616444 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:39:33.616444 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:39:33.616444 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:39:33.623344 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:39:33.623344 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:39:33.623344 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:39:33.623344 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:39:33.623344 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:39:33.623344 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:39:33.623344 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:39:33.623344 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:39:33.623344 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:39:33.623344 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:39:33.623344 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:39:33.623344 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:39:33.623344 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:39:33.623344 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:39:33.623344 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:39:33.623344 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:39:33.623344 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:39:33.624393 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:39:33.624393 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:39:33.624393 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:39:33.624393 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:39:33.624393 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:39:33.624393 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:39:33.624393 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:39:33.624393 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:39:33.624393 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 628/1258] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:39:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:39:33.624958 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7fe59-c971-404f-b4c2-7692bfb997fa None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:33.792292 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7fe59-c971-404f-b4c2-7692bfb997fa None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:33.868615 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba28891-f0f3-4737-9b73-78f75940ac3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:33.869756 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba28891-f0f3-4737-9b73-78f75940ac3a None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:33.870253 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba28891-f0f3-4737-9b73-78f75940ac3a None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:33.870775 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba28891-f0f3-4737-9b73-78f75940ac3a None admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:33.872135 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba28891-f0f3-4737-9b73-78f75940ac3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:39:33.872690 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba28891-f0f3-4737-9b73-78f75940ac3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:33.876431 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba28891-f0f3-4737-9b73-78f75940ac3a None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:33.904747 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 631/1259] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 8 13:39:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:39:33.916300 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab809dfa-8080-45b1-870b-6165bd008def None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:33.959801 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:34.118074 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab809dfa-8080-45b1-870b-6165bd008def None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:34.185482 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbcabfe-a184-4482-b404-61e1ed3e0302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:34.187209 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbcabfe-a184-4482-b404-61e1ed3e0302 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:34.187735 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbcabfe-a184-4482-b404-61e1ed3e0302 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:34.188448 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbcabfe-a184-4482-b404-61e1ed3e0302 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:34.190108 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbcabfe-a184-4482-b404-61e1ed3e0302 None admin] RBAC: Adding query filter params (role.id=9c76f398c9e04caeab83842e70eb824b, scope.project.id=88de9f1470c6415b97866ad5a3256ef2, user.id=733797f12a1741e1a55332991e867aab) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:39:34.190678 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbcabfe-a184-4482-b404-61e1ed3e0302 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:34.193917 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbcabfe-a184-4482-b404-61e1ed3e0302 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:34.205139 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 629/1260] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 8 13:39:33 2022] GET /identity/v3/role_assignments?user.id=733797f12a1741e1a55332991e867aab&scope.project.id=88de9f1470c6415b97866ad5a3256ef2&role.id=9c76f398c9e04caeab83842e70eb824b => generated 259 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:39:37.254393 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd0b8f-939f-4544-9dd2-43c1c74c2aa5 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:37.255312 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd0b8f-939f-4544-9dd2-43c1c74c2aa5 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:37.255312 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd0b8f-939f-4544-9dd2-43c1c74c2aa5 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:37.256637 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 632/1261] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:39:37.262873 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b0a17-6233-4bf9-9e69-82749c745b54 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:37.263456 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b0a17-6233-4bf9-9e69-82749c745b54 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:37.263456 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b0a17-6233-4bf9-9e69-82749c745b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:37.288875 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-8b8b0a17-6233-4bf9-9e69-82749c745b54 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:39:37.290549 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-8b8b0a17-6233-4bf9-9e69-82749c745b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:39:37.407373 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 630/1262] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:39:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:39:37.747520 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fd0b8f-939f-4544-9dd2-43c1c74c2aa5 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:37.769893 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:37.947453 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fd0b8f-939f-4544-9dd2-43c1c74c2aa5 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:38.002791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621397f-101e-4888-9ce0-62b62904b554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:38.003494 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621397f-101e-4888-9ce0-62b62904b554 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:38.003866 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621397f-101e-4888-9ce0-62b62904b554 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:38.004236 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621397f-101e-4888-9ce0-62b62904b554 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:38.025085 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d621397f-101e-4888-9ce0-62b62904b554 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:39:38.033342 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-d621397f-101e-4888-9ce0-62b62904b554 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:39:38.033342 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:39:38.033342 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:39:38.033342 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:39:38.033342 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:39:38.033342 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:39:38.033342 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:39:38.033342 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:39:38.033342 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:39:38.033342 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:39:38.033342 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:39:38.033342 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:39:38.033342 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:39:38.033342 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:39:38.033342 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:39:38.033342 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:39:38.035387 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:39:38.035387 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:39:38.035387 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:39:38.035387 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:39:38.035387 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:39:38.035387 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:39:38.035387 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:39:38.035387 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:39:38.035387 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:39:38.035387 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:39:38.035387 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:39:38.035387 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:39:38.035387 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:39:38.035387 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:39:38.035387 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:39:38.035387 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:39:38.037526 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:39:38.037526 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:39:38.037526 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:39:38.037526 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:39:38.037526 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:39:38.037526 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:39:38.037526 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:39:38.037526 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:39:38.037526 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:39:38.037526 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:39:38.037526 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:39:38.037526 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:39:38.037526 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 633/1263] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 8 13:39:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:39:38.045347 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b0a17-6233-4bf9-9e69-82749c745b54 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:38.079775 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:38.256762 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b0a17-6233-4bf9-9e69-82749c745b54 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:38.323538 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec53723-11bf-42d6-9510-a4439dc380a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:38.324575 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec53723-11bf-42d6-9510-a4439dc380a3 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:38.325080 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec53723-11bf-42d6-9510-a4439dc380a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:38.325571 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec53723-11bf-42d6-9510-a4439dc380a3 None admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:38.327283 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec53723-11bf-42d6-9510-a4439dc380a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:39:38.327825 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec53723-11bf-42d6-9510-a4439dc380a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:38.330513 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec53723-11bf-42d6-9510-a4439dc380a3 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:38.346249 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 631/1264] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:39:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:39:38.353695 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621397f-101e-4888-9ce0-62b62904b554 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:38.456504 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:38.499900 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621397f-101e-4888-9ce0-62b62904b554 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:38.544853 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda68f6-25d2-4794-8f5e-38bc05374fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:38.545507 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda68f6-25d2-4794-8f5e-38bc05374fb0 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:38.546287 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda68f6-25d2-4794-8f5e-38bc05374fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:38.546567 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda68f6-25d2-4794-8f5e-38bc05374fb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:38.559432 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda68f6-25d2-4794-8f5e-38bc05374fb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:38.562192 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda68f6-25d2-4794-8f5e-38bc05374fb0 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:38.592087 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-acda68f6-25d2-4794-8f5e-38bc05374fb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:39:38.592087 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:39:38.592087 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:39:38.592087 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:39:38.592087 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:39:38.592087 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:39:38.592087 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:39:38.592087 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:39:38.592087 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:39:38.592087 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:39:38.592087 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:39:38.592087 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:39:38.592087 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:39:38.592087 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:39:38.592087 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:39:38.592087 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:39:38.594860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:39:38.594860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:39:38.594860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:39:38.594860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:39:38.594860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:39:38.594860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:39:38.594860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:39:38.594860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:39:38.594860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:39:38.594860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:39:38.594860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:39:38.594860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:39:38.594860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:39:38.594860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:39:38.594860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:39:38.594860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:39:38.594860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:39:38.596447 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:39:38.596447 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:39:38.596447 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:39:38.596447 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 634/1265] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:39:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:39:38.605025 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec53723-11bf-42d6-9510-a4439dc380a3 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:38.776634 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:38.820974 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec53723-11bf-42d6-9510-a4439dc380a3 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:38.885250 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1bb0d3-b5b1-4c44-b325-48a23c3261d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:38.886025 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bb0d3-b5b1-4c44-b325-48a23c3261d8 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:38.886461 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bb0d3-b5b1-4c44-b325-48a23c3261d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:38.886630 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bb0d3-b5b1-4c44-b325-48a23c3261d8 None admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:38.888025 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1bb0d3-b5b1-4c44-b325-48a23c3261d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:39:38.888576 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1bb0d3-b5b1-4c44-b325-48a23c3261d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:38.890920 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1bb0d3-b5b1-4c44-b325-48a23c3261d8 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:38.910282 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 632/1266] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:39:38.919634 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda68f6-25d2-4794-8f5e-38bc05374fb0 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:39.103688 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda68f6-25d2-4794-8f5e-38bc05374fb0 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:39.146060 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:39.166228 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6832edb-d6df-4189-a565-3b8a94d20302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:39.167026 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6832edb-d6df-4189-a565-3b8a94d20302 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:39.167379 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6832edb-d6df-4189-a565-3b8a94d20302 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:39.167740 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6832edb-d6df-4189-a565-3b8a94d20302 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:39.180641 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6832edb-d6df-4189-a565-3b8a94d20302 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:39.182416 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6832edb-d6df-4189-a565-3b8a94d20302 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:39.199657 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-b6832edb-d6df-4189-a565-3b8a94d20302 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 08 13:39:39.199657 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:39:39.199657 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:39:39.199657 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:39:39.199657 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:39:39.199657 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:39:39.199657 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:39:39.199657 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:39:39.199657 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:39:39.199657 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:39:39.199657 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:39:39.199657 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:39:39.199657 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:39:39.199657 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:39:39.199657 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:39:39.199657 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:39:39.202069 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:39:39.202069 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:39:39.202069 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:39:39.202069 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:39:39.202069 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:39:39.202069 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:39:39.202069 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:39:39.202069 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:39:39.202069 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:39:39.202069 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:39:39.202069 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:39:39.202069 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:39:39.202069 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:39:39.202069 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:39:39.202069 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:39:39.202069 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:39:39.202069 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:39:39.202069 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:39:39.204335 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:39:39.204335 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:39:39.204335 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:39:39.204335 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:39:39.204335 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:39:39.204335 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:39:39.204335 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:39:39.204335 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:39:39.204335 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 08 13:39:39.204335 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:39:39.204335 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 635/1267] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:39:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:39:39.208653 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1bb0d3-b5b1-4c44-b325-48a23c3261d8 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:39.404033 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1bb0d3-b5b1-4c44-b325-48a23c3261d8 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:39.449538 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405be80-a4a5-4959-bc22-a63db8b0f3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:39.450209 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405be80-a4a5-4959-bc22-a63db8b0f3ed None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:39.450537 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405be80-a4a5-4959-bc22-a63db8b0f3ed None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:39.450861 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405be80-a4a5-4959-bc22-a63db8b0f3ed None admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:39.452187 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3405be80-a4a5-4959-bc22-a63db8b0f3ed None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:39:39.452712 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3405be80-a4a5-4959-bc22-a63db8b0f3ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:39.454283 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3405be80-a4a5-4959-bc22-a63db8b0f3ed None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:39.466135 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:39.479475 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 633/1268] 10.222.0.69 () {56 vars in 1143 bytes} [Thu Sep 8 13:39:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:39:39.487887 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6832edb-d6df-4189-a565-3b8a94d20302 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:39.653436 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6832edb-d6df-4189-a565-3b8a94d20302 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:39.723010 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61518539-47c6-4ef4-997a-d6c6a234b137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:39.723888 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61518539-47c6-4ef4-997a-d6c6a234b137 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:39.724403 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61518539-47c6-4ef4-997a-d6c6a234b137 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:39.725082 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61518539-47c6-4ef4-997a-d6c6a234b137 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:39.741889 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61518539-47c6-4ef4-997a-d6c6a234b137 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:39.743439 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61518539-47c6-4ef4-997a-d6c6a234b137 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:39.761878 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-61518539-47c6-4ef4-997a-d6c6a234b137 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:39:39.761878 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:39:39.761878 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:39:39.761878 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:39:39.761878 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:39:39.761878 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:39:39.761878 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:39:39.761878 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:39:39.761878 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:39:39.761878 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:39:39.761878 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:39:39.761878 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:39:39.761878 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:39:39.761878 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:39:39.761878 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:39:39.761878 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:39:39.764102 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:39:39.764102 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:39:39.764102 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:39:39.764102 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:39:39.764102 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:39:39.764102 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:39:39.764102 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:39:39.764102 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:39:39.764102 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:39:39.764102 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:39:39.764102 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:39:39.764102 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:39:39.764102 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:39:39.764102 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:39:39.764102 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:39:39.764102 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:39:39.764102 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:39:39.766278 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:39:39.766278 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:39:39.766278 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:39:39.766278 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 636/1269] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:39:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:39:39.770725 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405be80-a4a5-4959-bc22-a63db8b0f3ed None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:39.962278 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405be80-a4a5-4959-bc22-a63db8b0f3ed None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:40.031626 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48dce29-42ea-4508-b8e6-fc7436d9f0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:40.032512 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48dce29-42ea-4508-b8e6-fc7436d9f0ef None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:40.032997 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48dce29-42ea-4508-b8e6-fc7436d9f0ef None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:40.033513 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48dce29-42ea-4508-b8e6-fc7436d9f0ef None admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:40.034644 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48dce29-42ea-4508-b8e6-fc7436d9f0ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:39:40.034835 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48dce29-42ea-4508-b8e6-fc7436d9f0ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:40.036693 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48dce29-42ea-4508-b8e6-fc7436d9f0ef None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:40.058399 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 634/1270] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:39:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:39:40.069589 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61518539-47c6-4ef4-997a-d6c6a234b137 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:40.135664 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:40.270628 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61518539-47c6-4ef4-997a-d6c6a234b137 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:40.337241 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a544e-5336-4755-aa98-13d5bf6a8eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:40.338288 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a544e-5336-4755-aa98-13d5bf6a8eb5 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:40.338755 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a544e-5336-4755-aa98-13d5bf6a8eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:40.339184 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a544e-5336-4755-aa98-13d5bf6a8eb5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:40.350939 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a544e-5336-4755-aa98-13d5bf6a8eb5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:40.352589 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a544e-5336-4755-aa98-13d5bf6a8eb5 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:40.366828 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-c82a544e-5336-4755-aa98-13d5bf6a8eb5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:39:40.366828 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:39:40.366828 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:39:40.366828 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:39:40.366828 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:39:40.366828 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:39:40.366828 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:39:40.366828 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:39:40.366828 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:39:40.366828 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:39:40.366828 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:39:40.366828 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:39:40.366828 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:39:40.366828 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:39:40.366828 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:39:40.368737 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:39:40.368737 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:39:40.368737 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:39:40.368737 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:39:40.368737 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:39:40.368737 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:39:40.368737 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:39:40.368737 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:39:40.368737 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:39:40.368737 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:39:40.368737 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:39:40.368737 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:39:40.368737 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:39:40.368737 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:39:40.368737 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:39:40.368737 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:39:40.368737 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:39:40.371042 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:39:40.371042 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:39:40.371042 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:39:40.371042 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:39:40.371042 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:39:40.371042 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:39:40.371042 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:39:40.371042 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:39:40.371042 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 637/1271] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:39:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:39:40.377741 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48dce29-42ea-4508-b8e6-fc7436d9f0ef None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:40.488680 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:40.573401 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48dce29-42ea-4508-b8e6-fc7436d9f0ef None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:40.644913 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a3883-63cd-4ca0-a409-456fba6daf61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:40.645894 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a3883-63cd-4ca0-a409-456fba6daf61 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:40.646386 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a3883-63cd-4ca0-a409-456fba6daf61 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:40.646867 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a3883-63cd-4ca0-a409-456fba6daf61 None admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:40.648108 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a3883-63cd-4ca0-a409-456fba6daf61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:39:40.648619 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a3883-63cd-4ca0-a409-456fba6daf61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:40.651389 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a3883-63cd-4ca0-a409-456fba6daf61 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:40.670879 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 635/1272] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 8 13:39:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:39:40.680247 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a544e-5336-4755-aa98-13d5bf6a8eb5 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:40.865418 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:40.882684 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a544e-5336-4755-aa98-13d5bf6a8eb5 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:40.947346 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af809f7-773c-4f23-9502-eafc2771c10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:40.948021 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af809f7-773c-4f23-9502-eafc2771c10e None admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:40.948298 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af809f7-773c-4f23-9502-eafc2771c10e None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:40.948569 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af809f7-773c-4f23-9502-eafc2771c10e None admin] PATH_INFO: `/v3/projects/88de9f1470c6415b97866ad5a3256ef2/users/733797f12a1741e1a55332991e867aab/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:40.950687 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af809f7-773c-4f23-9502-eafc2771c10e None admin] RBAC: Authorizing `identity:create_grant(project_id=88de9f1470c6415b97866ad5a3256ef2, user_id=733797f12a1741e1a55332991e867aab, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:40.952394 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af809f7-773c-4f23-9502-eafc2771c10e None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:40.968782 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 638/1273] 10.222.0.69 () {58 vars in 1439 bytes} [Thu Sep 8 13:39:40 2022] PUT /identity/v3/projects/88de9f1470c6415b97866ad5a3256ef2/users/733797f12a1741e1a55332991e867aab/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:39:44.332535 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127963a7-c735-4534-9609-4ae7e5a8b78d None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:44.333809 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127963a7-c735-4534-9609-4ae7e5a8b78d None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:44.333809 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127963a7-c735-4534-9609-4ae7e5a8b78d None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:44.335312 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 636/1274] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:39:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:39:44.345061 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6976229a-0a84-45c8-8da6-13b7d24290ad None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:44.346060 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6976229a-0a84-45c8-8da6-13b7d24290ad None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:44.346060 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6976229a-0a84-45c8-8da6-13b7d24290ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:44.374542 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-6976229a-0a84-45c8-8da6-13b7d24290ad None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:39:44.375860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-6976229a-0a84-45c8-8da6-13b7d24290ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:39:44.507718 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 639/1275] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:39:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:39:44.789766 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127963a7-c735-4534-9609-4ae7e5a8b78d None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:44.927580 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127963a7-c735-4534-9609-4ae7e5a8b78d None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:44.950169 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:44.974941 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66dab0-036d-4d88-a73b-078d2b13f9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:44.975606 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66dab0-036d-4d88-a73b-078d2b13f9a8 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:44.975886 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66dab0-036d-4d88-a73b-078d2b13f9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:44.976159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66dab0-036d-4d88-a73b-078d2b13f9a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:44.989769 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e66dab0-036d-4d88-a73b-078d2b13f9a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 08 13:39:44.995298 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-4e66dab0-036d-4d88-a73b-078d2b13f9a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:39:44.995298 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:39:44.995298 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:39:44.995298 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:39:44.995298 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:39:44.995298 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:39:44.995298 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:39:44.995298 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:39:44.995298 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:39:44.995298 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:39:44.995298 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:39:44.995298 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:39:44.995298 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 08 13:39:44.995298 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 08 13:39:44.995298 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 08 13:39:44.995298 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 08 13:39:44.997121 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 08 13:39:44.997121 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 08 13:39:44.997121 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 08 13:39:44.997121 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 08 13:39:44.997121 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:39:44.997121 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:39:44.997121 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:39:44.997121 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:39:44.997121 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:39:44.997121 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:39:44.997121 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:39:44.997121 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:39:44.997121 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:39:44.997121 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:39:44.997121 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:39:44.997121 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:39:44.998837 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:39:44.998837 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:39:44.998837 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:39:44.998837 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:39:44.998837 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 08 13:39:44.998837 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 08 13:39:44.998837 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 08 13:39:44.998837 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 08 13:39:44.998837 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 08 13:39:44.998837 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 08 13:39:44.998837 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 08 13:39:44.998837 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:39:44.998837 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 637/1276] 10.222.0.69 () {56 vars in 1096 bytes} [Thu Sep 8 13:39:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:39:45.004156 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6976229a-0a84-45c8-8da6-13b7d24290ad None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:45.110590 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:45.149067 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6976229a-0a84-45c8-8da6-13b7d24290ad None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:45.224644 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df994f4-832a-45ee-888b-4a956b4ca179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:45.225988 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df994f4-832a-45ee-888b-4a956b4ca179 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:45.226472 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df994f4-832a-45ee-888b-4a956b4ca179 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:45.227006 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df994f4-832a-45ee-888b-4a956b4ca179 None admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:45.228284 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df994f4-832a-45ee-888b-4a956b4ca179 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:39:45.228836 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df994f4-832a-45ee-888b-4a956b4ca179 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:45.231680 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df994f4-832a-45ee-888b-4a956b4ca179 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:45.252977 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 640/1277] 10.222.0.69 () {56 vars in 1099 bytes} [Thu Sep 8 13:39:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:39:45.262125 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66dab0-036d-4d88-a73b-078d2b13f9a8 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:45.464753 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66dab0-036d-4d88-a73b-078d2b13f9a8 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:45.523679 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf65fe-6b0f-4331-b675-6ebaca0ef5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:45.524533 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf65fe-6b0f-4331-b675-6ebaca0ef5fd None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:45.524806 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf65fe-6b0f-4331-b675-6ebaca0ef5fd None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:45.525112 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf65fe-6b0f-4331-b675-6ebaca0ef5fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:45.542054 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcf65fe-6b0f-4331-b675-6ebaca0ef5fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:45.544171 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcf65fe-6b0f-4331-b675-6ebaca0ef5fd None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:45.571127 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-3dcf65fe-6b0f-4331-b675-6ebaca0ef5fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:39:45.571127 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:39:45.571127 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:39:45.571127 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:39:45.571127 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:39:45.571127 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:39:45.571127 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:39:45.571127 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:39:45.571127 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:39:45.571127 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:39:45.571127 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:39:45.571127 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:39:45.571127 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:39:45.571127 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:39:45.571127 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:39:45.571127 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:39:45.573031 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:39:45.573031 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:39:45.573031 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:39:45.573031 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:39:45.573031 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:39:45.573031 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:39:45.573031 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:39:45.573031 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:39:45.573031 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:39:45.573031 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:39:45.573031 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:39:45.573031 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:39:45.573031 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:39:45.573031 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:39:45.573031 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:39:45.573031 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:39:45.573031 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:39:45.574801 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:39:45.574801 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:39:45.574801 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:39:45.574801 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 638/1278] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:39:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:39:45.581585 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df994f4-832a-45ee-888b-4a956b4ca179 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:45.799218 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df994f4-832a-45ee-888b-4a956b4ca179 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:45.868229 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd090991-df68-414b-8db6-ef27545db24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:45.869281 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd090991-df68-414b-8db6-ef27545db24e None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:45.869809 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd090991-df68-414b-8db6-ef27545db24e None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:45.870299 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd090991-df68-414b-8db6-ef27545db24e None admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:45.871532 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd090991-df68-414b-8db6-ef27545db24e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:39:45.872081 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd090991-df68-414b-8db6-ef27545db24e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:45.876388 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd090991-df68-414b-8db6-ef27545db24e None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:45.900740 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 641/1279] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:39:45.907634 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf65fe-6b0f-4331-b675-6ebaca0ef5fd None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:45.965595 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:46.093096 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf65fe-6b0f-4331-b675-6ebaca0ef5fd None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:46.141995 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1508b-30f2-415d-876d-ea0c26191b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:46.142635 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1508b-30f2-415d-876d-ea0c26191b4d None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:46.142910 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1508b-30f2-415d-876d-ea0c26191b4d None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:46.143178 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1508b-30f2-415d-876d-ea0c26191b4d None admin] PATH_INFO: `/v3/users/placement` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:46.155179 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a1508b-30f2-415d-876d-ea0c26191b4d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:46.156871 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a1508b-30f2-415d-876d-ea0c26191b4d None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:46.175699 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-a5a1508b-30f2-415d-876d-ea0c26191b4d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 08 13:39:46.175699 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:39:46.175699 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:39:46.175699 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:39:46.175699 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:39:46.175699 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:39:46.175699 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:39:46.175699 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:39:46.175699 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:39:46.175699 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:39:46.175699 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:39:46.175699 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:39:46.175699 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 08 13:39:46.175699 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 08 13:39:46.175699 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 08 13:39:46.175699 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 08 13:39:46.177677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:39:46.177677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:39:46.177677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 08 13:39:46.177677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:39:46.177677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 08 13:39:46.177677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 08 13:39:46.177677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:39:46.177677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:39:46.177677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:39:46.177677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:39:46.177677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:39:46.177677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:39:46.177677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:39:46.177677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:39:46.177677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:39:46.177677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:39:46.177677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:39:46.177677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:39:46.179297 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:39:46.179297 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:39:46.179297 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 08 13:39:46.179297 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 08 13:39:46.179297 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 08 13:39:46.179297 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 08 13:39:46.179297 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 08 13:39:46.179297 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 08 13:39:46.179297 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 08 13:39:46.179297 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:39:46.179297 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 639/1280] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:39:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:39:46.191298 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd090991-df68-414b-8db6-ef27545db24e None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:46.195664 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:46.370552 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd090991-df68-414b-8db6-ef27545db24e None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:46.442460 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bad684-1aca-4629-aa6f-985e4c7ec587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:46.443488 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bad684-1aca-4629-aa6f-985e4c7ec587 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:46.444224 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bad684-1aca-4629-aa6f-985e4c7ec587 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:46.444704 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bad684-1aca-4629-aa6f-985e4c7ec587 None admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:46.446106 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bad684-1aca-4629-aa6f-985e4c7ec587 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:39:46.446652 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bad684-1aca-4629-aa6f-985e4c7ec587 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:46.449426 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bad684-1aca-4629-aa6f-985e4c7ec587 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:46.479533 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 642/1281] 10.222.0.69 () {56 vars in 1143 bytes} [Thu Sep 8 13:39:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:39:46.487123 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1508b-30f2-415d-876d-ea0c26191b4d None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:46.651805 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:46.668271 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a1508b-30f2-415d-876d-ea0c26191b4d None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:46.727006 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411aec5e-e8ea-499f-b54f-be9e9ddb253b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:46.727804 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411aec5e-e8ea-499f-b54f-be9e9ddb253b None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:46.728136 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411aec5e-e8ea-499f-b54f-be9e9ddb253b None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:46.728560 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411aec5e-e8ea-499f-b54f-be9e9ddb253b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:46.843665 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411aec5e-e8ea-499f-b54f-be9e9ddb253b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:46.845651 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411aec5e-e8ea-499f-b54f-be9e9ddb253b None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:47.015573 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:47.030440 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 640/1282] 10.222.0.69 () {58 vars in 1282 bytes} [Thu Sep 8 13:39:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 08 13:39:47.038465 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bad684-1aca-4629-aa6f-985e4c7ec587 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:47.167003 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:47.244118 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bad684-1aca-4629-aa6f-985e4c7ec587 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:47.298906 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda105c-35af-4533-99f1-0d8fdb8fa773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:47.299618 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda105c-35af-4533-99f1-0d8fdb8fa773 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:47.300005 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda105c-35af-4533-99f1-0d8fdb8fa773 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:47.300368 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda105c-35af-4533-99f1-0d8fdb8fa773 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:47.313774 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bda105c-35af-4533-99f1-0d8fdb8fa773 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:47.315459 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bda105c-35af-4533-99f1-0d8fdb8fa773 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:47.334476 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-4bda105c-35af-4533-99f1-0d8fdb8fa773 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:39:47.334476 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:39:47.334476 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:39:47.334476 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:39:47.334476 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:39:47.334476 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:39:47.334476 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:39:47.334476 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:39:47.334476 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:39:47.334476 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:39:47.334476 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:39:47.334476 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:39:47.334476 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 08 13:39:47.334476 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 08 13:39:47.334476 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 08 13:39:47.334476 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 08 13:39:47.336964 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:39:47.336964 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:39:47.336964 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:39:47.336964 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:39:47.336964 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:39:47.336964 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:39:47.336964 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:39:47.336964 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:39:47.336964 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:39:47.336964 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:39:47.336964 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:39:47.336964 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:39:47.336964 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:39:47.336964 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:39:47.336964 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:39:47.336964 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:39:47.336964 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 08 13:39:47.339111 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 08 13:39:47.339111 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 08 13:39:47.339111 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:39:47.339111 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 643/1283] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:39:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:39:47.347225 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411aec5e-e8ea-499f-b54f-be9e9ddb253b None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:47.480826 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411aec5e-e8ea-499f-b54f-be9e9ddb253b None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:47.535513 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532aa39-3306-4209-a352-5b63cf9728c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:47.536188 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532aa39-3306-4209-a352-5b63cf9728c8 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:47.536346 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532aa39-3306-4209-a352-5b63cf9728c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:47.536565 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532aa39-3306-4209-a352-5b63cf9728c8 None admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:47.537229 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532aa39-3306-4209-a352-5b63cf9728c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:39:47.537565 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532aa39-3306-4209-a352-5b63cf9728c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:47.538965 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532aa39-3306-4209-a352-5b63cf9728c8 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:47.556185 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 641/1284] 10.222.0.69 () {56 vars in 1109 bytes} [Thu Sep 8 13:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:39:47.566427 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda105c-35af-4533-99f1-0d8fdb8fa773 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:47.757756 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda105c-35af-4533-99f1-0d8fdb8fa773 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:47.787155 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:47.814749 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d33110-a237-45b7-87cc-ad25278ac322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:47.815451 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d33110-a237-45b7-87cc-ad25278ac322 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:47.815776 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d33110-a237-45b7-87cc-ad25278ac322 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:47.816096 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d33110-a237-45b7-87cc-ad25278ac322 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:47.826175 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d33110-a237-45b7-87cc-ad25278ac322 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:47.828425 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d33110-a237-45b7-87cc-ad25278ac322 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:47.844258 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application [None req-40d33110-a237-45b7-87cc-ad25278ac322 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:39:47.844258 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:39:47.844258 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:39:47.844258 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:39:47.844258 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:39:47.844258 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:39:47.844258 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:39:47.844258 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:39:47.844258 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:39:47.844258 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:39:47.844258 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:39:47.844258 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:39:47.844258 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 08 13:39:47.844258 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 08 13:39:47.844258 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 08 13:39:47.851188 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 08 13:39:47.851188 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:39:47.851188 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:39:47.851188 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:39:47.851188 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:39:47.851188 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:39:47.851188 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:39:47.851188 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:39:47.851188 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application with Lock( Sep 08 13:39:47.851188 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:39:47.851188 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:39:47.851188 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:39:47.851188 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:39:47.851188 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:39:47.851188 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:39:47.851188 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:39:47.851188 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:39:47.852359 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 08 13:39:47.852359 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 08 13:39:47.852359 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 08 13:39:47.852359 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 08 13:39:47.852359 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 08 13:39:47.852359 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 08 13:39:47.852359 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 08 13:39:47.852359 dv-cinder-856463-2-smb devstack@keystone.service[88207]: ERROR keystone.server.flask.application Sep 08 13:39:47.852359 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 644/1285] 10.222.0.69 () {56 vars in 1111 bytes} [Thu Sep 8 13:39:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:39:47.855935 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532aa39-3306-4209-a352-5b63cf9728c8 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:47.947974 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:48.031823 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532aa39-3306-4209-a352-5b63cf9728c8 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:48.079784 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c39ea-7c66-4a11-b606-50404b267b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:48.080311 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c39ea-7c66-4a11-b606-50404b267b1a None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:48.080586 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c39ea-7c66-4a11-b606-50404b267b1a None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:48.080856 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c39ea-7c66-4a11-b606-50404b267b1a None admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:48.081621 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983c39ea-7c66-4a11-b606-50404b267b1a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:39:48.081927 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983c39ea-7c66-4a11-b606-50404b267b1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:48.083581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983c39ea-7c66-4a11-b606-50404b267b1a None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:48.107153 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 642/1286] 10.222.0.69 () {56 vars in 1148 bytes} [Thu Sep 8 13:39:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:39:48.117928 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d33110-a237-45b7-87cc-ad25278ac322 None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:48.289241 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d33110-a237-45b7-87cc-ad25278ac322 None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:48.342324 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd7e0d-b7ec-43ff-b908-67b4c4a03c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:48.343245 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd7e0d-b7ec-43ff-b908-67b4c4a03c67 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:48.343594 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd7e0d-b7ec-43ff-b908-67b4c4a03c67 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:48.343922 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd7e0d-b7ec-43ff-b908-67b4c4a03c67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:48.344792 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bd7e0d-b7ec-43ff-b908-67b4c4a03c67 None admin] RBAC: Adding query filter params (role.id=9c76f398c9e04caeab83842e70eb824b, scope.project.id=88de9f1470c6415b97866ad5a3256ef2, user.id=733797f12a1741e1a55332991e867aab) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:39:48.345198 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bd7e0d-b7ec-43ff-b908-67b4c4a03c67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:48.347116 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bd7e0d-b7ec-43ff-b908-67b4c4a03c67 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:48.356139 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 645/1287] 10.222.0.69 () {56 vars in 1374 bytes} [Thu Sep 8 13:39:48 2022] GET /identity/v3/role_assignments?user.id=733797f12a1741e1a55332991e867aab&scope.project.id=88de9f1470c6415b97866ad5a3256ef2&role.id=9c76f398c9e04caeab83842e70eb824b => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:39:51.736216 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2e533-4263-4592-9c8e-fcd098b3a3f5 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:51.737205 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2e533-4263-4592-9c8e-fcd098b3a3f5 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:51.737205 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2e533-4263-4592-9c8e-fcd098b3a3f5 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:51.738421 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 643/1288] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:39:51.744944 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5916c-a76a-4640-b21c-5c8397a0e3b8 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:51.745861 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5916c-a76a-4640-b21c-5c8397a0e3b8 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:51.745861 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5916c-a76a-4640-b21c-5c8397a0e3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:51.772946 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-27a5916c-a76a-4640-b21c-5c8397a0e3b8 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:39:51.774547 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-27a5916c-a76a-4640-b21c-5c8397a0e3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:39:51.839541 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:51.910652 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 646/1289] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:39:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 08 13:39:52.423240 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2e533-4263-4592-9c8e-fcd098b3a3f5 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:52.628587 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2e533-4263-4592-9c8e-fcd098b3a3f5 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:52.651664 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:52.698029 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd168c-0b27-4e52-a2cd-9058c6c1672c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:52.699066 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd168c-0b27-4e52-a2cd-9058c6c1672c None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:52.699553 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd168c-0b27-4e52-a2cd-9058c6c1672c None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:52.700033 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd168c-0b27-4e52-a2cd-9058c6c1672c None admin] PATH_INFO: `/v3/services/placement` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:52.701094 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dd168c-0b27-4e52-a2cd-9058c6c1672c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:52.704328 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dd168c-0b27-4e52-a2cd-9058c6c1672c None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:52.722780 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-61dd168c-0b27-4e52-a2cd-9058c6c1672c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 13:39:52.722780 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:39:52.722780 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:39:52.722780 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:39:52.722780 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:39:52.722780 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:39:52.722780 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:39:52.722780 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:39:52.722780 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 13:39:52.722780 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:39:52.722780 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:39:52.722780 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:39:52.722780 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:39:52.722780 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:39:52.722780 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:39:52.722780 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:39:52.722780 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:39:52.725142 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:39:52.725142 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:39:52.725142 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:39:52.725142 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:39:52.725142 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:39:52.725142 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:39:52.725142 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:39:52.725142 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:39:52.725142 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:39:52.725142 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:39:52.725142 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:39:52.725142 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:39:52.725142 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:39:52.725142 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:39:52.725142 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:39:52.725142 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:39:52.726362 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:39:52.726362 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:39:52.726362 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:39:52.726362 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:39:52.726362 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:39:52.726362 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:39:52.726362 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:39:52.726362 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:39:52.726362 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:39:52.726362 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:39:52.726362 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:39:52.726362 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:39:52.726362 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 13:39:52.726362 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:39:52.726362 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 644/1290] 10.222.0.69 () {56 vars in 1117 bytes} [Thu Sep 8 13:39:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:39:52.736589 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5916c-a76a-4640-b21c-5c8397a0e3b8 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:52.927290 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5916c-a76a-4640-b21c-5c8397a0e3b8 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:52.971801 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aab36d-18f0-46e5-918e-677c4c5b7707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:52.972433 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aab36d-18f0-46e5-918e-677c4c5b7707 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:52.972713 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aab36d-18f0-46e5-918e-677c4c5b7707 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:52.972990 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aab36d-18f0-46e5-918e-677c4c5b7707 None admin] PATH_INFO: `/v3/services` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:52.973665 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aab36d-18f0-46e5-918e-677c4c5b7707 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:39:52.973970 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aab36d-18f0-46e5-918e-677c4c5b7707 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:52.975857 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aab36d-18f0-46e5-918e-677c4c5b7707 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:52.981719 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 647/1291] 10.222.0.69 () {56 vars in 1116 bytes} [Thu Sep 8 13:39:52 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:39:52.989900 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd168c-0b27-4e52-a2cd-9058c6c1672c None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:53.196434 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd168c-0b27-4e52-a2cd-9058c6c1672c None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:53.269040 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cee6da-f8f2-4cd8-9bba-884ee1cbf93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:53.270139 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cee6da-f8f2-4cd8-9bba-884ee1cbf93b None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:53.270626 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cee6da-f8f2-4cd8-9bba-884ee1cbf93b None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:53.271118 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cee6da-f8f2-4cd8-9bba-884ee1cbf93b None admin] PATH_INFO: `/v3/services` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:53.272325 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cee6da-f8f2-4cd8-9bba-884ee1cbf93b None admin] RBAC: Adding query filter params (type=placement) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:39:53.272886 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cee6da-f8f2-4cd8-9bba-884ee1cbf93b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:53.275947 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cee6da-f8f2-4cd8-9bba-884ee1cbf93b None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:53.285588 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 645/1292] 10.222.0.69 () {56 vars in 1116 bytes} [Thu Sep 8 13:39:52 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:39:56.031115 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcd232-f903-489c-8761-b932821a5476 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:56.031900 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcd232-f903-489c-8761-b932821a5476 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:56.031900 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfcd232-f903-489c-8761-b932821a5476 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:56.033272 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 648/1293] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:39:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:39:56.040557 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38dd1e-41be-4b7a-8fe5-f46db274499e None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:56.041345 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38dd1e-41be-4b7a-8fe5-f46db274499e None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:56.041345 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38dd1e-41be-4b7a-8fe5-f46db274499e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:56.072851 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-fd38dd1e-41be-4b7a-8fe5-f46db274499e None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:39:56.074737 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-fd38dd1e-41be-4b7a-8fe5-f46db274499e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:39:56.135446 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:56.219962 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 646/1294] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:39:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:39:56.561412 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfcd232-f903-489c-8761-b932821a5476 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:39:56.615890 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:56.754972 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfcd232-f903-489c-8761-b932821a5476 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:39:56.802564 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d47505-8365-408f-9c4e-903647d93534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:39:56.803186 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d47505-8365-408f-9c4e-903647d93534 None admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:56.803467 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d47505-8365-408f-9c4e-903647d93534 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:56.803830 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d47505-8365-408f-9c4e-903647d93534 None admin] PATH_INFO: `/v3/services` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:56.804520 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d47505-8365-408f-9c4e-903647d93534 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:39:56.806023 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d47505-8365-408f-9c4e-903647d93534 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:39:56.825486 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 649/1295] 10.222.0.69 () {60 vars in 1141 bytes} [Thu Sep 8 13:39:56 2022] POST /identity/v3/services => generated 246 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:39:59.884711 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cbf4f-4915-42f7-8777-602b057f8511 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:59.885649 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cbf4f-4915-42f7-8777-602b057f8511 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:59.885649 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cbf4f-4915-42f7-8777-602b057f8511 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:59.887287 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 647/1296] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:39:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:39:59.897088 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9643601-b6d9-4ba7-97e9-51be5e7103ba None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:39:59.897763 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9643601-b6d9-4ba7-97e9-51be5e7103ba None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:39:59.898087 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9643601-b6d9-4ba7-97e9-51be5e7103ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:39:59.930002 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-a9643601-b6d9-4ba7-97e9-51be5e7103ba None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:39:59.932235 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-a9643601-b6d9-4ba7-97e9-51be5e7103ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:40:00.074793 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 650/1297] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:39:59 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:40:00.472396 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676cbf4f-4915-42f7-8777-602b057f8511 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:00.628293 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676cbf4f-4915-42f7-8777-602b057f8511 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:00.697376 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a1966d-6079-43d3-8af4-c8ffd583b3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:00.698112 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1966d-6079-43d3-8af4-c8ffd583b3b5 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:00.698434 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1966d-6079-43d3-8af4-c8ffd583b3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:00.698748 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1966d-6079-43d3-8af4-c8ffd583b3b5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:00.699458 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a1966d-6079-43d3-8af4-c8ffd583b3b5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:00.700973 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a1966d-6079-43d3-8af4-c8ffd583b3b5 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:00.715713 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-48a1966d-6079-43d3-8af4-c8ffd583b3b5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 13:40:00.715713 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:40:00.715713 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:40:00.715713 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:40:00.715713 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:40:00.715713 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:40:00.715713 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:40:00.715713 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:40:00.715713 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 13:40:00.715713 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:40:00.715713 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:40:00.715713 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:40:00.715713 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:40:00.715713 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:40:00.715713 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:40:00.715713 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:40:00.715713 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:40:00.718319 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:40:00.718319 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:40:00.718319 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:40:00.718319 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:40:00.718319 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:40:00.718319 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:40:00.718319 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:40:00.718319 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:40:00.718319 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:40:00.718319 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:40:00.718319 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:40:00.718319 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:40:00.718319 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:40:00.718319 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:40:00.718319 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:40:00.718319 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:40:00.720113 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:40:00.720113 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:40:00.720113 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:40:00.720113 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:40:00.720113 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:40:00.720113 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:40:00.720113 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:40:00.720113 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:40:00.720113 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:40:00.720113 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:40:00.720113 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:40:00.720113 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:40:00.720113 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 13:40:00.720113 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:40:00.720113 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 648/1298] 10.222.0.69 () {56 vars in 1117 bytes} [Thu Sep 8 13:40:00 2022] GET /identity/v3/services/placement => generated 90 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 08 13:40:00.728530 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9643601-b6d9-4ba7-97e9-51be5e7103ba None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:00.752582 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:00.892953 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9643601-b6d9-4ba7-97e9-51be5e7103ba None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:00.939679 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53378d1d-8185-4e25-839e-4ce566903f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:00.940804 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53378d1d-8185-4e25-839e-4ce566903f3b None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:00.940804 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53378d1d-8185-4e25-839e-4ce566903f3b None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:00.940804 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53378d1d-8185-4e25-839e-4ce566903f3b None admin] PATH_INFO: `/v3/services` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:00.941556 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53378d1d-8185-4e25-839e-4ce566903f3b None admin] RBAC: Adding query filter params (name=placement) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:00.941935 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53378d1d-8185-4e25-839e-4ce566903f3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:00.943357 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53378d1d-8185-4e25-839e-4ce566903f3b None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:00.950502 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 651/1299] 10.222.0.69 () {56 vars in 1116 bytes} [Thu Sep 8 13:40:00 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:00.958916 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a1966d-6079-43d3-8af4-c8ffd583b3b5 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:01.022529 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:01.132043 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a1966d-6079-43d3-8af4-c8ffd583b3b5 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:01.182960 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223bd28c-b22a-4dfa-87f1-5d9c79911bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:01.183951 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223bd28c-b22a-4dfa-87f1-5d9c79911bca None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:01.184264 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223bd28c-b22a-4dfa-87f1-5d9c79911bca None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:01.184563 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223bd28c-b22a-4dfa-87f1-5d9c79911bca None admin] PATH_INFO: `/v3/endpoints` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:01.186352 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223bd28c-b22a-4dfa-87f1-5d9c79911bca None admin] RBAC: Adding query filter params (interface=public, service_id=7952b10d1e5a4f3ebd1cf37aa90d3e30, region_id=RegionOne) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:01.186910 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223bd28c-b22a-4dfa-87f1-5d9c79911bca None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:01.189084 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223bd28c-b22a-4dfa-87f1-5d9c79911bca None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:01.197808 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 649/1300] 10.222.0.69 () {56 vars in 1251 bytes} [Thu Sep 8 13:40:00 2022] GET /identity/v3/endpoints?service_id=7952b10d1e5a4f3ebd1cf37aa90d3e30&interface=public®ion_id=RegionOne => generated 194 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:01.205394 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53378d1d-8185-4e25-839e-4ce566903f3b None admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:01.328066 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:01.352291 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53378d1d-8185-4e25-839e-4ce566903f3b None admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:01.399248 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be1d96-3f15-4d81-8a81-217206dadb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:01.399897 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be1d96-3f15-4d81-8a81-217206dadb0a None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:01.400183 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be1d96-3f15-4d81-8a81-217206dadb0a None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:01.400456 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be1d96-3f15-4d81-8a81-217206dadb0a None admin] PATH_INFO: `/v3/services` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:01.401188 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6be1d96-3f15-4d81-8a81-217206dadb0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:01.402626 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6be1d96-3f15-4d81-8a81-217206dadb0a None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:01.411013 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 652/1301] 10.222.0.69 () {56 vars in 1087 bytes} [Thu Sep 8 13:40:01 2022] GET /identity/v3/services => generated 2191 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:40:04.193723 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7b14d-3db4-4923-8025-740bf5566977 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:04.194326 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7b14d-3db4-4923-8025-740bf5566977 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:04.194702 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae7b14d-3db4-4923-8025-740bf5566977 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:04.197185 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 650/1302] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:40:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:40:04.203995 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f38dc4-8f6b-48c9-88fa-a44f109c5c9b None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:04.204552 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f38dc4-8f6b-48c9-88fa-a44f109c5c9b None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:04.204669 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f38dc4-8f6b-48c9-88fa-a44f109c5c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:04.228598 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-32f38dc4-8f6b-48c9-88fa-a44f109c5c9b None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:40:04.230420 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-32f38dc4-8f6b-48c9-88fa-a44f109c5c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:40:04.368353 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 653/1303] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:40:04 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 08 13:40:04.752390 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7b14d-3db4-4923-8025-740bf5566977 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:04.926175 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:04.936272 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae7b14d-3db4-4923-8025-740bf5566977 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:04.983036 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858702a-0a13-4e33-abfd-6ba03dd9c710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:04.983848 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858702a-0a13-4e33-abfd-6ba03dd9c710 None admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:04.984187 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858702a-0a13-4e33-abfd-6ba03dd9c710 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:04.984430 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858702a-0a13-4e33-abfd-6ba03dd9c710 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:04.985317 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858702a-0a13-4e33-abfd-6ba03dd9c710 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:04.987577 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858702a-0a13-4e33-abfd-6ba03dd9c710 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:04.999727 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application [None req-f858702a-0a13-4e33-abfd-6ba03dd9c710 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 13:40:04.999727 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:40:04.999727 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 08 13:40:04.999727 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 08 13:40:04.999727 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 08 13:40:04.999727 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 08 13:40:04.999727 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 08 13:40:04.999727 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:40:04.999727 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 13:40:04.999727 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:40:04.999727 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 08 13:40:04.999727 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:40:04.999727 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 08 13:40:04.999727 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 08 13:40:04.999727 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 08 13:40:04.999727 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 08 13:40:04.999727 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 08 13:40:05.001934 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 08 13:40:05.001934 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 08 13:40:05.001934 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 08 13:40:05.001934 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 08 13:40:05.001934 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 08 13:40:05.001934 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 08 13:40:05.001934 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 08 13:40:05.001934 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 08 13:40:05.001934 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 08 13:40:05.001934 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 08 13:40:05.001934 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 08 13:40:05.001934 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 08 13:40:05.001934 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 08 13:40:05.001934 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 08 13:40:05.001934 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 08 13:40:05.001934 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.get_or_create( Sep 08 13:40:05.003541 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 08 13:40:05.003541 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application with Lock( Sep 08 13:40:05.003541 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 08 13:40:05.003541 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self._enter() Sep 08 13:40:05.003541 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 08 13:40:05.003541 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 08 13:40:05.003541 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 08 13:40:05.003541 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application return self.creator() Sep 08 13:40:05.003541 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 08 13:40:05.003541 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application created_value = creator( Sep 08 13:40:05.003541 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 08 13:40:05.003541 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 08 13:40:05.003541 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 08 13:40:05.003541 dv-cinder-856463-2-smb devstack@keystone.service[88208]: ERROR keystone.server.flask.application Sep 08 13:40:05.003541 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 651/1304] 10.222.0.69 () {56 vars in 1117 bytes} [Thu Sep 8 13:40:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 08 13:40:05.009936 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f38dc4-8f6b-48c9-88fa-a44f109c5c9b None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:05.143374 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:05.182929 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f38dc4-8f6b-48c9-88fa-a44f109c5c9b None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:05.245148 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47435c7-7065-42f2-a926-bccaa0e61b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:05.246262 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47435c7-7065-42f2-a926-bccaa0e61b13 None admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:05.246820 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47435c7-7065-42f2-a926-bccaa0e61b13 None admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:05.247280 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47435c7-7065-42f2-a926-bccaa0e61b13 None admin] PATH_INFO: `/v3/services` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:05.249325 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47435c7-7065-42f2-a926-bccaa0e61b13 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:40:05.249935 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47435c7-7065-42f2-a926-bccaa0e61b13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:05.252591 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47435c7-7065-42f2-a926-bccaa0e61b13 None admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:05.264161 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 654/1305] 10.222.0.69 () {56 vars in 1116 bytes} [Thu Sep 8 13:40:05 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:40:05.274517 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858702a-0a13-4e33-abfd-6ba03dd9c710 None admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:40:05.485331 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858702a-0a13-4e33-abfd-6ba03dd9c710 None admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:40:05.554518 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696fff6e-5a2b-46fe-83c7-2950be11a406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:40:05.555528 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696fff6e-5a2b-46fe-83c7-2950be11a406 None admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:40:05.556027 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696fff6e-5a2b-46fe-83c7-2950be11a406 None admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:40:05.556507 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696fff6e-5a2b-46fe-83c7-2950be11a406 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:40:05.557822 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696fff6e-5a2b-46fe-83c7-2950be11a406 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:40:05.560506 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696fff6e-5a2b-46fe-83c7-2950be11a406 None admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:40:05.596712 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 652/1306] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:40:05 2022] POST /identity/v3/endpoints => generated 331 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:40:15.256865 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=30 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:15.587958 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:43.787061 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35273e6-a29a-45ae-9534-9e6d9a97526e None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:43.788007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35273e6-a29a-45ae-9534-9e6d9a97526e None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:43.788461 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35273e6-a29a-45ae-9534-9e6d9a97526e None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:43.794419 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 655/1307] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:41:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:41:43.800619 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8028a-aaca-49e9-b809-4a693efa2751 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:43.801507 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8028a-aaca-49e9-b809-4a693efa2751 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:43.801601 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8028a-aaca-49e9-b809-4a693efa2751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:43.950634 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-ecb8028a-aaca-49e9-b809-4a693efa2751 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:41:43.952763 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-ecb8028a-aaca-49e9-b809-4a693efa2751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:41:44.197065 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 653/1308] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:41:44.636023 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544c022-8984-48a1-acb8-6a515f5516ae None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:44.637187 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544c022-8984-48a1-acb8-6a515f5516ae None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:44.637575 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544c022-8984-48a1-acb8-6a515f5516ae None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:44.639491 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 656/1309] 10.222.0.69 () {54 vars in 965 bytes} [Thu Sep 8 13:41:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:41:44.649049 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46aae56-4e4c-4670-9971-562695c434db None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:44.649579 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46aae56-4e4c-4670-9971-562695c434db None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:44.650086 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46aae56-4e4c-4670-9971-562695c434db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:44.797278 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-e46aae56-4e4c-4670-9971-562695c434db None None] MFA Rules not processed for user `db898158553743d3a28f3d6237e91a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:41:44.800049 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-e46aae56-4e4c-4670-9971-562695c434db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:41:44.847021 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:44.949346 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 654/1310] 10.222.0.69 () {58 vars in 1062 bytes} [Thu Sep 8 13:41:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:41:44.961802 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544c022-8984-48a1-acb8-6a515f5516ae None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:44.965789 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-5544c022-8984-48a1-acb8-6a515f5516ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:41:45.243213 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544c022-8984-48a1-acb8-6a515f5516ae None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:45.417609 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa6072d-fd72-4ba8-9c6a-a3b78a4ef0d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:45.418430 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6072d-fd72-4ba8-9c6a-a3b78a4ef0d1 service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:45.418766 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6072d-fd72-4ba8-9c6a-a3b78a4ef0d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:45.419192 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa6072d-fd72-4ba8-9c6a-a3b78a4ef0d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:45.421097 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-5aa6072d-fd72-4ba8-9c6a-a3b78a4ef0d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:41:45.509265 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:45.624159 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6072d-fd72-4ba8-9c6a-a3b78a4ef0d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:45.626331 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa6072d-fd72-4ba8-9c6a-a3b78a4ef0d1 service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:45.656516 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 657/1311] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:41:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 695 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:41:48.915713 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816853d-907c-4c20-85a1-ce909a0e2498 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:48.916337 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816853d-907c-4c20-85a1-ce909a0e2498 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:48.916337 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816853d-907c-4c20-85a1-ce909a0e2498 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:48.918658 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 655/1312] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:41:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:41:48.925938 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857306a5-f0db-4ecd-9c50-735ffb2ab735 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:48.926515 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857306a5-f0db-4ecd-9c50-735ffb2ab735 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:48.926515 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857306a5-f0db-4ecd-9c50-735ffb2ab735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:49.041318 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-857306a5-f0db-4ecd-9c50-735ffb2ab735 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:41:49.043163 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-857306a5-f0db-4ecd-9c50-735ffb2ab735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:41:49.187234 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 658/1313] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:41:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:41:49.568442 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40725c51-8614-4020-9179-a63d3837ffee None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:49.568652 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40725c51-8614-4020-9179-a63d3837ffee None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:49.569230 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40725c51-8614-4020-9179-a63d3837ffee None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:49.572553 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 656/1314] 10.222.0.69 () {54 vars in 965 bytes} [Thu Sep 8 13:41:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:41:49.580181 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bb5a3-8732-4e10-ac9c-1b64e80733ae None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:49.580517 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bb5a3-8732-4e10-ac9c-1b64e80733ae None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:49.580722 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bb5a3-8732-4e10-ac9c-1b64e80733ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:49.598391 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:49.725625 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-217bb5a3-8732-4e10-ac9c-1b64e80733ae None None] MFA Rules not processed for user `db898158553743d3a28f3d6237e91a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:41:49.727581 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-217bb5a3-8732-4e10-ac9c-1b64e80733ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:41:49.871678 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 659/1315] 10.222.0.69 () {58 vars in 1062 bytes} [Thu Sep 8 13:41:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:41:49.882666 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40725c51-8614-4020-9179-a63d3837ffee None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:49.884251 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-40725c51-8614-4020-9179-a63d3837ffee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:41:50.058702 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40725c51-8614-4020-9179-a63d3837ffee None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:50.176583 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:50.179727 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c541d23-6623-4012-9272-499ff39d327a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:50.182672 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c541d23-6623-4012-9272-499ff39d327a service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:50.183147 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c541d23-6623-4012-9272-499ff39d327a service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:50.184310 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c541d23-6623-4012-9272-499ff39d327a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:50.188759 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-5c541d23-6623-4012-9272-499ff39d327a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:41:50.356445 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c541d23-6623-4012-9272-499ff39d327a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:50.358254 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c541d23-6623-4012-9272-499ff39d327a service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:50.385230 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 657/1316] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:41:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:41:53.630544 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015da55-7c88-4dcc-8bab-412f91552e17 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:53.631226 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015da55-7c88-4dcc-8bab-412f91552e17 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:53.631226 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015da55-7c88-4dcc-8bab-412f91552e17 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:53.633271 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 660/1317] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:41:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:41:53.640986 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8904d9-0c7f-4340-9a4d-88383922612e None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:53.641759 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8904d9-0c7f-4340-9a4d-88383922612e None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:53.641759 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8904d9-0c7f-4340-9a4d-88383922612e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:53.748965 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-8a8904d9-0c7f-4340-9a4d-88383922612e None None] MFA Rules not processed for user `56f5aa59cf424559a6b65ae250308c09`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:41:53.750565 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-8a8904d9-0c7f-4340-9a4d-88383922612e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:41:53.843753 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:53.925692 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 658/1318] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:41:53 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:41:54.474396 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015da55-7c88-4dcc-8bab-412f91552e17 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:54.476230 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-c015da55-7c88-4dcc-8bab-412f91552e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:41:54.665880 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015da55-7c88-4dcc-8bab-412f91552e17 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:41:54.670296 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:54.803742 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ae6d5-46d5-48eb-8ba2-1a763c13f4c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:41:54.804370 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ae6d5-46d5-48eb-8ba2-1a763c13f4c6 service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:54.804645 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ae6d5-46d5-48eb-8ba2-1a763c13f4c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:54.804914 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ae6d5-46d5-48eb-8ba2-1a763c13f4c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:54.807068 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-e65ae6d5-46d5-48eb-8ba2-1a763c13f4c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:41:54.968297 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ae6d5-46d5-48eb-8ba2-1a763c13f4c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:41:54.970200 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ae6d5-46d5-48eb-8ba2-1a763c13f4c6 service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:41:54.994990 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 661/1319] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:41:54 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:41:59.116827 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3b59c-cbc6-4b1e-a36b-b25de6ede043 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:59.117593 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3b59c-cbc6-4b1e-a36b-b25de6ede043 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:59.117593 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c3b59c-cbc6-4b1e-a36b-b25de6ede043 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:59.118956 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 659/1320] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:41:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:41:59.126625 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d2d79-57a6-4daa-b198-e5e36431aec7 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:41:59.127441 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d2d79-57a6-4daa-b198-e5e36431aec7 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:41:59.127634 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46d2d79-57a6-4daa-b198-e5e36431aec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:41:59.200094 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:59.236147 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-f46d2d79-57a6-4daa-b198-e5e36431aec7 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:41:59.237499 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-f46d2d79-57a6-4daa-b198-e5e36431aec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:41:59.404936 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 662/1321] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:41:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:41:59.737190 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3b59c-cbc6-4b1e-a36b-b25de6ede043 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:41:59.738826 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-52c3b59c-cbc6-4b1e-a36b-b25de6ede043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:41:59.950993 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c3b59c-cbc6-4b1e-a36b-b25de6ede043 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:00.090538 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6641047-3881-4ad7-a4b4-85da2b52be55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:00.091185 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6641047-3881-4ad7-a4b4-85da2b52be55 service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:00.091588 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6641047-3881-4ad7-a4b4-85da2b52be55 service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:00.091939 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6641047-3881-4ad7-a4b4-85da2b52be55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:00.093781 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-f6641047-3881-4ad7-a4b4-85da2b52be55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:00.103112 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:00.279566 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6641047-3881-4ad7-a4b4-85da2b52be55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:00.281307 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6641047-3881-4ad7-a4b4-85da2b52be55 service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:00.313781 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 660/1322] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:41:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:42:04.678996 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19d854-3bf6-49a6-9e96-a8269e241469 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:04.679816 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19d854-3bf6-49a6-9e96-a8269e241469 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:04.680015 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19d854-3bf6-49a6-9e96-a8269e241469 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:04.682565 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 663/1323] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:42:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:42:04.694482 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce736c9-0f2b-4efe-920f-d369092abda7 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:04.695084 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce736c9-0f2b-4efe-920f-d369092abda7 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:04.695424 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce736c9-0f2b-4efe-920f-d369092abda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:04.818302 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-4ce736c9-0f2b-4efe-920f-d369092abda7 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:04.819989 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-4ce736c9-0f2b-4efe-920f-d369092abda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:04.895330 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:04.957514 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 661/1324] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:42:05.284678 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19d854-3bf6-49a6-9e96-a8269e241469 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:05.287797 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-df19d854-3bf6-49a6-9e96-a8269e241469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:05.506982 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19d854-3bf6-49a6-9e96-a8269e241469 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:05.534413 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:05.661705 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f38f8a-aa47-425d-b756-c7cecb39094d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:05.662704 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f38f8a-aa47-425d-b756-c7cecb39094d service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:05.663135 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f38f8a-aa47-425d-b756-c7cecb39094d service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:05.663635 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f38f8a-aa47-425d-b756-c7cecb39094d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:05.667619 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-c2f38f8a-aa47-425d-b756-c7cecb39094d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:05.851712 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f38f8a-aa47-425d-b756-c7cecb39094d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:05.855857 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f38f8a-aa47-425d-b756-c7cecb39094d service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:05.883551 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 664/1325] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:42:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:42:09.326118 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49ff5e-3d58-4d41-8fc3-54e46437f0d9 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:09.326707 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49ff5e-3d58-4d41-8fc3-54e46437f0d9 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:09.327131 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49ff5e-3d58-4d41-8fc3-54e46437f0d9 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:09.329800 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 662/1326] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:42:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:42:09.339630 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13f035-1564-4d11-8cf7-2aa31e4b8aee None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:09.340178 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13f035-1564-4d11-8cf7-2aa31e4b8aee None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:09.340592 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13f035-1564-4d11-8cf7-2aa31e4b8aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:09.429794 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:09.455652 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-9b13f035-1564-4d11-8cf7-2aa31e4b8aee None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:09.457180 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-9b13f035-1564-4d11-8cf7-2aa31e4b8aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:09.657139 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 665/1327] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:42:10.196648 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49ff5e-3d58-4d41-8fc3-54e46437f0d9 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:10.198662 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-ea49ff5e-3d58-4d41-8fc3-54e46437f0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:10.372905 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49ff5e-3d58-4d41-8fc3-54e46437f0d9 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:10.476242 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce71690-33b7-4d2c-82be-2140ebf17a85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:10.476974 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce71690-33b7-4d2c-82be-2140ebf17a85 service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:10.477397 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce71690-33b7-4d2c-82be-2140ebf17a85 service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:10.477800 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce71690-33b7-4d2c-82be-2140ebf17a85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:10.480789 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-5ce71690-33b7-4d2c-82be-2140ebf17a85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:10.504827 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:10.719138 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce71690-33b7-4d2c-82be-2140ebf17a85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:10.722268 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce71690-33b7-4d2c-82be-2140ebf17a85 service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:10.764373 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 663/1328] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:42:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:42:13.309951 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b2fc6-1874-4108-a29e-abaca919cd32 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:13.310790 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b2fc6-1874-4108-a29e-abaca919cd32 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:13.310790 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485b2fc6-1874-4108-a29e-abaca919cd32 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:13.311876 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 666/1329] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:42:13.318311 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22306a5-adcb-474a-9f95-277812825d0f None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:13.319507 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22306a5-adcb-474a-9f95-277812825d0f None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:13.319507 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22306a5-adcb-474a-9f95-277812825d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:13.422849 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-e22306a5-adcb-474a-9f95-277812825d0f None None] MFA Rules not processed for user `56f5aa59cf424559a6b65ae250308c09`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:13.424203 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-e22306a5-adcb-474a-9f95-277812825d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:13.515180 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:13.567889 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 664/1330] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:13 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:42:14.039649 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b2fc6-1874-4108-a29e-abaca919cd32 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:14.043070 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-485b2fc6-1874-4108-a29e-abaca919cd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:14.216746 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485b2fc6-1874-4108-a29e-abaca919cd32 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:14.262581 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:14.353893 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee2234-692b-41e4-8dbd-6ce6fe6ebbe2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:14.354899 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee2234-692b-41e4-8dbd-6ce6fe6ebbe2 service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:14.354899 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee2234-692b-41e4-8dbd-6ce6fe6ebbe2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:14.354899 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee2234-692b-41e4-8dbd-6ce6fe6ebbe2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:14.358788 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-70ee2234-692b-41e4-8dbd-6ce6fe6ebbe2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:14.577498 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee2234-692b-41e4-8dbd-6ce6fe6ebbe2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:14.580274 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee2234-692b-41e4-8dbd-6ce6fe6ebbe2 service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:14.616913 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 667/1331] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:42:14 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:42:17.697490 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55fc96-c3da-4d62-ba6c-5b48fb9dcb30 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:17.698346 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55fc96-c3da-4d62-ba6c-5b48fb9dcb30 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:17.698607 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55fc96-c3da-4d62-ba6c-5b48fb9dcb30 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:17.700224 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 665/1332] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:42:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:42:17.706641 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a121df7-6b4a-4baa-bb09-ef9242e67882 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:17.707441 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a121df7-6b4a-4baa-bb09-ef9242e67882 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:17.707441 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a121df7-6b4a-4baa-bb09-ef9242e67882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:17.786530 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:17.792325 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-0a121df7-6b4a-4baa-bb09-ef9242e67882 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:17.794005 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-0a121df7-6b4a-4baa-bb09-ef9242e67882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:17.934770 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 668/1333] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:42:18.390681 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55fc96-c3da-4d62-ba6c-5b48fb9dcb30 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:18.394158 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-9c55fc96-c3da-4d62-ba6c-5b48fb9dcb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:18.603225 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55fc96-c3da-4d62-ba6c-5b48fb9dcb30 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:18.740023 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a9b5b-b5b6-4264-950e-7e69db7d6e6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:18.741079 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a9b5b-b5b6-4264-950e-7e69db7d6e6b service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:18.741421 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a9b5b-b5b6-4264-950e-7e69db7d6e6b service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:18.741843 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a9b5b-b5b6-4264-950e-7e69db7d6e6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:18.743728 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-4c8a9b5b-b5b6-4264-950e-7e69db7d6e6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:18.776958 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:18.916798 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a9b5b-b5b6-4264-950e-7e69db7d6e6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:18.918680 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a9b5b-b5b6-4264-950e-7e69db7d6e6b service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:18.942071 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 666/1334] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:42:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:42:21.681850 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f04a7f-0f61-4521-b2f9-c76ab830e442 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:21.682660 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f04a7f-0f61-4521-b2f9-c76ab830e442 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:21.682826 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f04a7f-0f61-4521-b2f9-c76ab830e442 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:21.685514 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 669/1335] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:42:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:42:21.697732 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107017c1-256c-41a3-95e6-caab95eb2581 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:21.697732 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107017c1-256c-41a3-95e6-caab95eb2581 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:21.697732 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107017c1-256c-41a3-95e6-caab95eb2581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:21.844293 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-107017c1-256c-41a3-95e6-caab95eb2581 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:21.846489 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-107017c1-256c-41a3-95e6-caab95eb2581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:22.008517 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:22.060864 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 667/1336] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:42:22.617264 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f04a7f-0f61-4521-b2f9-c76ab830e442 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:22.621208 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-58f04a7f-0f61-4521-b2f9-c76ab830e442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:22.819499 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f04a7f-0f61-4521-b2f9-c76ab830e442 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:22.877242 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:22.956953 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb06833-97be-4b61-b303-87ff96d45499 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:22.957804 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb06833-97be-4b61-b303-87ff96d45499 service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:22.958131 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb06833-97be-4b61-b303-87ff96d45499 service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:22.958470 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb06833-97be-4b61-b303-87ff96d45499 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:22.960429 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-4bb06833-97be-4b61-b303-87ff96d45499 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:23.203531 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb06833-97be-4b61-b303-87ff96d45499 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:23.206829 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb06833-97be-4b61-b303-87ff96d45499 service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:23.250776 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 670/1337] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:42:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 635 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:42:26.375812 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e85991-440c-447e-8431-65378542a26b None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:26.376715 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e85991-440c-447e-8431-65378542a26b None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:26.376715 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e85991-440c-447e-8431-65378542a26b None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:26.378453 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 668/1338] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:42:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:42:26.386228 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34beeaaa-c2d3-4134-aa7c-97c582a4dcd7 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:26.386802 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34beeaaa-c2d3-4134-aa7c-97c582a4dcd7 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:26.387203 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34beeaaa-c2d3-4134-aa7c-97c582a4dcd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:26.509302 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-34beeaaa-c2d3-4134-aa7c-97c582a4dcd7 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:26.511285 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-34beeaaa-c2d3-4134-aa7c-97c582a4dcd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:26.525522 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:26.677229 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 671/1339] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:42:27.014206 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e85991-440c-447e-8431-65378542a26b None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:27.016536 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-58e85991-440c-447e-8431-65378542a26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:27.157446 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e85991-440c-447e-8431-65378542a26b None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:27.256058 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c6e59-2478-4428-9122-e84f8edb4a10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:27.257057 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c6e59-2478-4428-9122-e84f8edb4a10 service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:27.257454 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c6e59-2478-4428-9122-e84f8edb4a10 service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:27.258078 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c6e59-2478-4428-9122-e84f8edb4a10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:27.261041 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-782c6e59-2478-4428-9122-e84f8edb4a10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:27.310634 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:27.427628 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c6e59-2478-4428-9122-e84f8edb4a10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:27.431000 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c6e59-2478-4428-9122-e84f8edb4a10 service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:27.469084 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 669/1340] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:42:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:42:33.469964 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f6237-0b47-4ae7-833a-2902f17e67f2 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:33.470554 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f6237-0b47-4ae7-833a-2902f17e67f2 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:33.470790 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f6237-0b47-4ae7-833a-2902f17e67f2 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:33.473433 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 672/1341] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:42:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:42:33.483775 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a76db-1d3b-4a86-8aac-1e65e6721b49 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:33.484621 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a76db-1d3b-4a86-8aac-1e65e6721b49 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:33.484795 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a76db-1d3b-4a86-8aac-1e65e6721b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:33.619956 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-016a76db-1d3b-4a86-8aac-1e65e6721b49 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:33.622048 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-016a76db-1d3b-4a86-8aac-1e65e6721b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:33.788852 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:33.812575 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 670/1342] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:42:34.337793 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f6237-0b47-4ae7-833a-2902f17e67f2 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:34.340303 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-a92f6237-0b47-4ae7-833a-2902f17e67f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:34.551140 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f6237-0b47-4ae7-833a-2902f17e67f2 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:34.629847 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:34.691450 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959af8ae-c44b-4aa7-baac-532feeb8e937 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:34.692261 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959af8ae-c44b-4aa7-baac-532feeb8e937 service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:34.692670 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959af8ae-c44b-4aa7-baac-532feeb8e937 service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:34.693091 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959af8ae-c44b-4aa7-baac-532feeb8e937 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:34.695248 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-959af8ae-c44b-4aa7-baac-532feeb8e937 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:34.859854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959af8ae-c44b-4aa7-baac-532feeb8e937 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:34.861723 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959af8ae-c44b-4aa7-baac-532feeb8e937 service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:34.894848 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 673/1343] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:42:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:42:38.982237 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec6af6-016d-48d8-8481-b5a17858bc08 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:38.982932 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec6af6-016d-48d8-8481-b5a17858bc08 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:38.983192 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec6af6-016d-48d8-8481-b5a17858bc08 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:38.985795 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 671/1344] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:42:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:42:38.993557 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f28ea-cb35-49f7-9e86-667f3e408427 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:38.994705 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f28ea-cb35-49f7-9e86-667f3e408427 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:38.994705 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f28ea-cb35-49f7-9e86-667f3e408427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:39.093057 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-e72f28ea-cb35-49f7-9e86-667f3e408427 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:39.094557 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-e72f28ea-cb35-49f7-9e86-667f3e408427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:39.118952 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:39.227017 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 674/1345] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:42:39.545021 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec6af6-016d-48d8-8481-b5a17858bc08 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:39.548010 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-b5ec6af6-016d-48d8-8481-b5a17858bc08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:39.760728 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec6af6-016d-48d8-8481-b5a17858bc08 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:39.887546 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434fc6c-cbd3-4cbf-b4db-7fdaee617fca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:39.888162 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434fc6c-cbd3-4cbf-b4db-7fdaee617fca service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:39.888520 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434fc6c-cbd3-4cbf-b4db-7fdaee617fca service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:39.888691 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434fc6c-cbd3-4cbf-b4db-7fdaee617fca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:39.890642 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-0434fc6c-cbd3-4cbf-b4db-7fdaee617fca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:39.951552 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:40.043246 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0434fc6c-cbd3-4cbf-b4db-7fdaee617fca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:40.044622 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0434fc6c-cbd3-4cbf-b4db-7fdaee617fca service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:40.067228 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 672/1346] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:42:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:42:46.406955 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed60e52-8393-41d4-a7c7-2b204ddf7e92 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:46.407512 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed60e52-8393-41d4-a7c7-2b204ddf7e92 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:46.407650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed60e52-8393-41d4-a7c7-2b204ddf7e92 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:46.409223 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 675/1347] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:42:46.416877 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323c5cf-b85d-4850-bf7f-643e61b870d3 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:46.417457 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323c5cf-b85d-4850-bf7f-643e61b870d3 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:46.417711 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323c5cf-b85d-4850-bf7f-643e61b870d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:46.520936 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-0323c5cf-b85d-4850-bf7f-643e61b870d3 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:46.523009 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-0323c5cf-b85d-4850-bf7f-643e61b870d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:46.705540 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:46.708479 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 673/1348] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:42:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:42:47.222948 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed60e52-8393-41d4-a7c7-2b204ddf7e92 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:42:47.224984 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-4ed60e52-8393-41d4-a7c7-2b204ddf7e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:47.366796 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed60e52-8393-41d4-a7c7-2b204ddf7e92 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:42:47.434664 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:47.469022 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3e8266-94ac-4687-930c-c639e9773d11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:42:47.469672 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e8266-94ac-4687-930c-c639e9773d11 service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:47.469952 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e8266-94ac-4687-930c-c639e9773d11 service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:47.470221 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3e8266-94ac-4687-930c-c639e9773d11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:47.471946 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-cd3e8266-94ac-4687-930c-c639e9773d11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:47.650640 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3e8266-94ac-4687-930c-c639e9773d11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:42:47.652413 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3e8266-94ac-4687-930c-c639e9773d11 service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:42:47.684024 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 676/1349] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:42:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:42:54.703956 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93025c39-2e4b-4310-8e68-e12ab5a75b80 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:54.705705 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93025c39-2e4b-4310-8e68-e12ab5a75b80 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:54.706544 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93025c39-2e4b-4310-8e68-e12ab5a75b80 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:54.710032 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 674/1350] 10.222.0.69 () {54 vars in 921 bytes} [Thu Sep 8 13:42:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:42:54.721412 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3fc1b-b3e3-4342-8ef3-23ac9ec07594 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:42:54.722095 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3fc1b-b3e3-4342-8ef3-23ac9ec07594 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:42:54.722389 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3fc1b-b3e3-4342-8ef3-23ac9ec07594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:42:54.906989 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-40c3fc1b-b3e3-4342-8ef3-23ac9ec07594 None None] MFA Rules not processed for user `733797f12a1741e1a55332991e867aab`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:42:54.909123 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-40c3fc1b-b3e3-4342-8ef3-23ac9ec07594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:42:54.949125 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:55.238932 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 677/1351] 10.222.0.69 () {58 vars in 1018 bytes} [Thu Sep 8 13:42:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 519 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:43:01.770240 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d026597-a7ff-42c0-a5b1-596ec743a9d6 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:01.772077 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d026597-a7ff-42c0-a5b1-596ec743a9d6 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:01.775022 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d026597-a7ff-42c0-a5b1-596ec743a9d6 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:01.778235 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 675/1352] 10.222.0.69 () {54 vars in 921 bytes} [Thu Sep 8 13:43:01 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:43:01.787263 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946b3fd-c57d-44c1-a187-278fddcb7b97 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:01.788111 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946b3fd-c57d-44c1-a187-278fddcb7b97 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:01.788859 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3946b3fd-c57d-44c1-a187-278fddcb7b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:01.957741 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-3946b3fd-c57d-44c1-a187-278fddcb7b97 None None] MFA Rules not processed for user `733797f12a1741e1a55332991e867aab`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:43:01.960013 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-3946b3fd-c57d-44c1-a187-278fddcb7b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:02.128950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:02.217120 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 678/1353] 10.222.0.69 () {58 vars in 1018 bytes} [Thu Sep 8 13:43:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 431 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:43:04.151770 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a4620-ec7d-4a63-9870-d2fe3d6e5d78 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:04.152514 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a4620-ec7d-4a63-9870-d2fe3d6e5d78 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:04.152514 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a4620-ec7d-4a63-9870-d2fe3d6e5d78 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:04.155484 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 676/1354] 10.222.0.69 () {54 vars in 921 bytes} [Thu Sep 8 13:43:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:43:04.161660 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505db51-4075-4e1a-9376-a6a3a91f5b8e None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:04.162473 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505db51-4075-4e1a-9376-a6a3a91f5b8e None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:04.162669 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505db51-4075-4e1a-9376-a6a3a91f5b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:04.294037 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-d505db51-4075-4e1a-9376-a6a3a91f5b8e None None] MFA Rules not processed for user `733797f12a1741e1a55332991e867aab`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:43:04.295468 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-d505db51-4075-4e1a-9376-a6a3a91f5b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:04.526090 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 679/1355] 10.222.0.69 () {58 vars in 1018 bytes} [Thu Sep 8 13:43:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:43:09.572946 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5fa5d-6cb7-4c79-8609-1051c5e0c62e None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:09.573783 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5fa5d-6cb7-4c79-8609-1051c5e0c62e None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:09.574206 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f5fa5d-6cb7-4c79-8609-1051c5e0c62e None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:09.577702 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 677/1356] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:43:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:43:09.585675 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668fa15-2e8a-4ab2-9ecd-f0fe417920ff None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:09.585675 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668fa15-2e8a-4ab2-9ecd-f0fe417920ff None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:09.586657 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668fa15-2e8a-4ab2-9ecd-f0fe417920ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:09.670277 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:09.738872 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-1668fa15-2e8a-4ab2-9ecd-f0fe417920ff None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:43:09.741093 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-1668fa15-2e8a-4ab2-9ecd-f0fe417920ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:09.933528 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 680/1357] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:43:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:43:10.540409 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516dd7d-3a01-4d8e-ad2e-265e63f689f2 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:10.541588 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516dd7d-3a01-4d8e-ad2e-265e63f689f2 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:10.542386 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516dd7d-3a01-4d8e-ad2e-265e63f689f2 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:10.546696 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 678/1358] 10.222.0.69 () {54 vars in 962 bytes} [Thu Sep 8 13:43:10 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:43:10.558940 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e6003-e01d-4bfc-8749-b5aabc9df208 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:10.560204 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e6003-e01d-4bfc-8749-b5aabc9df208 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:10.561186 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e6003-e01d-4bfc-8749-b5aabc9df208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:10.745575 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-1d5e6003-e01d-4bfc-8749-b5aabc9df208 None None] MFA Rules not processed for user `c95448c1b8b1466cae37fda5c713d53f`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:43:10.748101 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-1d5e6003-e01d-4bfc-8749-b5aabc9df208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:10.854594 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:11.016423 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 681/1359] 10.222.0.69 () {58 vars in 1059 bytes} [Thu Sep 8 13:43:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:43:11.035252 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516dd7d-3a01-4d8e-ad2e-265e63f689f2 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:11.039976 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-c516dd7d-3a01-4d8e-ad2e-265e63f689f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:11.304513 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516dd7d-3a01-4d8e-ad2e-265e63f689f2 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:11.489414 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:11.553249 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86753b88-cd48-4803-ae95-1b94c96eb31d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:11.554671 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86753b88-cd48-4803-ae95-1b94c96eb31d service nova] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:11.555087 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86753b88-cd48-4803-ae95-1b94c96eb31d service nova] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:11.555562 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86753b88-cd48-4803-ae95-1b94c96eb31d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:11.557783 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-86753b88-cd48-4803-ae95-1b94c96eb31d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:11.785304 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86753b88-cd48-4803-ae95-1b94c96eb31d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:11.790240 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86753b88-cd48-4803-ae95-1b94c96eb31d service nova] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:11.829157 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 679/1360] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:43:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 795 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:43:15.889434 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30707f71-bd04-41ca-9f41-ff3210da188a None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:15.890242 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30707f71-bd04-41ca-9f41-ff3210da188a None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:15.890641 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30707f71-bd04-41ca-9f41-ff3210da188a None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:15.893284 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 682/1361] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:43:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:43:15.905569 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255aa32-1fac-402c-9a01-577ddb39ec14 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:15.906391 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255aa32-1fac-402c-9a01-577ddb39ec14 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:15.906762 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255aa32-1fac-402c-9a01-577ddb39ec14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:16.062682 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-f255aa32-1fac-402c-9a01-577ddb39ec14 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:43:16.063817 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-f255aa32-1fac-402c-9a01-577ddb39ec14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:16.130748 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:16.222957 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 680/1362] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:43:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:43:16.768154 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30707f71-bd04-41ca-9f41-ff3210da188a None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:16.770955 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-30707f71-bd04-41ca-9f41-ff3210da188a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:17.056186 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30707f71-bd04-41ca-9f41-ff3210da188a None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:17.069126 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:17.245573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfef3c5-03a3-4e07-92ce-08fa155d94f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:17.246674 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfef3c5-03a3-4e07-92ce-08fa155d94f0 service nova] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:17.247004 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfef3c5-03a3-4e07-92ce-08fa155d94f0 service nova] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:17.247360 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfef3c5-03a3-4e07-92ce-08fa155d94f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:17.249567 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-acfef3c5-03a3-4e07-92ce-08fa155d94f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:17.389796 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfef3c5-03a3-4e07-92ce-08fa155d94f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:17.391754 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfef3c5-03a3-4e07-92ce-08fa155d94f0 service nova] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:17.415405 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 683/1363] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:43:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 648 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:43:21.437122 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e4a7b-5d4e-4e17-a4f4-319bb00e3f9d None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:21.438032 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e4a7b-5d4e-4e17-a4f4-319bb00e3f9d None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:21.438187 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e4a7b-5d4e-4e17-a4f4-319bb00e3f9d None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:21.441841 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 681/1364] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:43:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:43:21.451186 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78693cac-05f1-4e72-b0fa-435682d670d0 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:21.452059 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78693cac-05f1-4e72-b0fa-435682d670d0 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:21.452208 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78693cac-05f1-4e72-b0fa-435682d670d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:21.484280 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:21.594443 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-78693cac-05f1-4e72-b0fa-435682d670d0 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:43:21.597554 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-78693cac-05f1-4e72-b0fa-435682d670d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:21.827421 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 684/1365] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:43:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:43:22.326068 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0048859-e718-48ec-abe7-e9619e8c2852 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:22.326822 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0048859-e718-48ec-abe7-e9619e8c2852 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:22.328254 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0048859-e718-48ec-abe7-e9619e8c2852 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:22.336643 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 682/1366] 10.222.0.69 () {54 vars in 962 bytes} [Thu Sep 8 13:43:22 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:43:22.345861 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd5fe8-ce77-4fe8-b04d-c15f02013e9d None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:22.346275 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd5fe8-ce77-4fe8-b04d-c15f02013e9d None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:22.346582 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd5fe8-ce77-4fe8-b04d-c15f02013e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:22.520794 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-7efd5fe8-ce77-4fe8-b04d-c15f02013e9d None None] MFA Rules not processed for user `c95448c1b8b1466cae37fda5c713d53f`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:43:22.527927 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-7efd5fe8-ce77-4fe8-b04d-c15f02013e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:22.590133 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:22.672049 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481c0b7-8daf-4a8a-a430-09d3257eb0ff None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:22.672841 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481c0b7-8daf-4a8a-a430-09d3257eb0ff None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:22.672841 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0481c0b7-8daf-4a8a-a430-09d3257eb0ff None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:22.675222 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 683/1367] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:43:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:43:22.683213 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8330c5-9770-44d2-8a99-c47a06058700 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:22.683663 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8330c5-9770-44d2-8a99-c47a06058700 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:22.684104 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8330c5-9770-44d2-8a99-c47a06058700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:22.801105 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 685/1368] 10.222.0.69 () {58 vars in 1059 bytes} [Thu Sep 8 13:43:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:43:22.812052 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd5fe8-ce77-4fe8-b04d-c15f02013e9d None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:22.829548 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-2d8330c5-9770-44d2-8a99-c47a06058700 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:43:22.830109 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd5fe8-ce77-4fe8-b04d-c15f02013e9d None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:22.831543 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-2d8330c5-9770-44d2-8a99-c47a06058700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:23.066710 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 684/1369] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:43:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:43:23.099400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e5920-67af-40ce-8539-99045bfbc3d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:23.101666 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e5920-67af-40ce-8539-99045bfbc3d5 service nova] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:23.102020 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e5920-67af-40ce-8539-99045bfbc3d5 service nova] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:23.102364 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e5920-67af-40ce-8539-99045bfbc3d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:23.104298 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-696e5920-67af-40ce-8539-99045bfbc3d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:23.148819 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:23.360563 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696e5920-67af-40ce-8539-99045bfbc3d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:23.363963 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696e5920-67af-40ce-8539-99045bfbc3d5 service nova] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:23.401943 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 686/1370] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:43:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:43:23.575597 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2f2ea-36ca-4a98-b650-dad94b4cdd5a None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:23.576015 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2f2ea-36ca-4a98-b650-dad94b4cdd5a None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:23.576504 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2f2ea-36ca-4a98-b650-dad94b4cdd5a None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:23.580192 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 685/1371] 10.222.0.69 () {54 vars in 964 bytes} [Thu Sep 8 13:43:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:43:23.588772 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78f13e-71d6-4731-b95e-30aeea49cf36 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:23.589686 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78f13e-71d6-4731-b95e-30aeea49cf36 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:23.589827 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78f13e-71d6-4731-b95e-30aeea49cf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:23.750896 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-1f78f13e-71d6-4731-b95e-30aeea49cf36 None None] MFA Rules not processed for user `d311099f51484141bd8504184b818ee8`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:43:23.753301 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-1f78f13e-71d6-4731-b95e-30aeea49cf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:23.980073 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 687/1372] 10.222.0.69 () {58 vars in 1061 bytes} [Thu Sep 8 13:43:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:43:23.981761 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab2f2ea-36ca-4a98-b650-dad94b4cdd5a None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:23.984322 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-4ab2f2ea-36ca-4a98-b650-dad94b4cdd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:24.017467 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:24.185276 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab2f2ea-36ca-4a98-b650-dad94b4cdd5a None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:24.384798 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29222e8f-b965-440e-9320-47511daccec5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:24.384798 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29222e8f-b965-440e-9320-47511daccec5 service cinder] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:24.384798 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29222e8f-b965-440e-9320-47511daccec5 service cinder] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:24.384798 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29222e8f-b965-440e-9320-47511daccec5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:24.389207 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-29222e8f-b965-440e-9320-47511daccec5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:24.556324 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:24.641021 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29222e8f-b965-440e-9320-47511daccec5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:24.644153 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29222e8f-b965-440e-9320-47511daccec5 service cinder] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:24.686490 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 686/1373] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:43:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 706 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:43:27.046636 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694db25-fa85-4c76-beb5-7f56d73fdc3d None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:27.047502 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694db25-fa85-4c76-beb5-7f56d73fdc3d None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:27.047669 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694db25-fa85-4c76-beb5-7f56d73fdc3d None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:27.049138 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 688/1374] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:43:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:43:27.057514 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9961a8-d015-4e5b-bdf8-00703fe6cf9e None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:27.058417 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9961a8-d015-4e5b-bdf8-00703fe6cf9e None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:27.058417 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9961a8-d015-4e5b-bdf8-00703fe6cf9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:27.186365 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-bd9961a8-d015-4e5b-bdf8-00703fe6cf9e None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:43:27.187622 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-bd9961a8-d015-4e5b-bdf8-00703fe6cf9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:27.364920 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 687/1375] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:43:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:43:27.847290 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694db25-fa85-4c76-beb5-7f56d73fdc3d None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:27.849983 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-b694db25-fa85-4c76-beb5-7f56d73fdc3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:27.861238 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:28.174940 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694db25-fa85-4c76-beb5-7f56d73fdc3d None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:28.331652 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:28.396504 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf248b-3296-4518-9882-0d94ec700cd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:28.397284 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf248b-3296-4518-9882-0d94ec700cd6 service nova] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:28.397599 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf248b-3296-4518-9882-0d94ec700cd6 service nova] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:28.397871 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf248b-3296-4518-9882-0d94ec700cd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:28.399665 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-5fcf248b-3296-4518-9882-0d94ec700cd6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:28.594978 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcf248b-3296-4518-9882-0d94ec700cd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:28.598177 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcf248b-3296-4518-9882-0d94ec700cd6 service nova] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:28.643395 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 689/1376] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:43:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 797 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:43:32.146038 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef64c0-5097-4ecc-a880-8b56247614b7 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:32.147634 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef64c0-5097-4ecc-a880-8b56247614b7 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:32.147634 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef64c0-5097-4ecc-a880-8b56247614b7 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:32.150555 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 688/1377] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:43:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:43:32.159828 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e229b9-c5fe-4688-ad03-97b19d170c47 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:32.160701 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e229b9-c5fe-4688-ad03-97b19d170c47 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:32.160701 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e229b9-c5fe-4688-ad03-97b19d170c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:32.307620 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-77e229b9-c5fe-4688-ad03-97b19d170c47 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:43:32.310210 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-77e229b9-c5fe-4688-ad03-97b19d170c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:32.420761 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:32.542765 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 690/1378] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:43:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:43:33.057044 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef64c0-5097-4ecc-a880-8b56247614b7 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:33.061525 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-44ef64c0-5097-4ecc-a880-8b56247614b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:33.156920 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:33.489457 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef64c0-5097-4ecc-a880-8b56247614b7 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:33.757719 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:33.788406 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817c5a70-6cac-4cad-964a-386bf34b76c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:33.790021 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c5a70-6cac-4cad-964a-386bf34b76c4 service nova] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:33.791150 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c5a70-6cac-4cad-964a-386bf34b76c4 service nova] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:33.791697 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817c5a70-6cac-4cad-964a-386bf34b76c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:33.795503 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-817c5a70-6cac-4cad-964a-386bf34b76c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:33.993823 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817c5a70-6cac-4cad-964a-386bf34b76c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:33.996591 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817c5a70-6cac-4cad-964a-386bf34b76c4 service nova] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:34.041855 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 689/1379] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:43:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 985 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:43:37.890690 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd3b58-f6ce-4cd9-b967-29be81915f8c None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:37.891537 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd3b58-f6ce-4cd9-b967-29be81915f8c None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:37.892069 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd3b58-f6ce-4cd9-b967-29be81915f8c None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:37.894743 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 691/1380] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:43:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:43:37.904977 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc1551-cdc7-44c4-8938-2789f0bca1bb None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:37.905795 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc1551-cdc7-44c4-8938-2789f0bca1bb None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:37.905967 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc1551-cdc7-44c4-8938-2789f0bca1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:38.084614 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-79cc1551-cdc7-44c4-8938-2789f0bca1bb None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:43:38.087622 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-79cc1551-cdc7-44c4-8938-2789f0bca1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:38.249299 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:38.363847 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 690/1381] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:43:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:43:38.990119 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd3b58-f6ce-4cd9-b967-29be81915f8c None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:38.993225 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-1edd3b58-f6ce-4cd9-b967-29be81915f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:39.393641 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd3b58-f6ce-4cd9-b967-29be81915f8c None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:39.472012 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:39.712587 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1a8f8-9aaf-41c2-8cdc-1ceeebbc486a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:39.713778 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1a8f8-9aaf-41c2-8cdc-1ceeebbc486a service nova] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:39.714280 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1a8f8-9aaf-41c2-8cdc-1ceeebbc486a service nova] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:39.714757 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1a8f8-9aaf-41c2-8cdc-1ceeebbc486a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:39.718113 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-6ad1a8f8-9aaf-41c2-8cdc-1ceeebbc486a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:39.929944 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad1a8f8-9aaf-41c2-8cdc-1ceeebbc486a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:39.933048 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad1a8f8-9aaf-41c2-8cdc-1ceeebbc486a service nova] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:39.980243 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 692/1382] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:43:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 992 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:43:44.208778 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df36a94-2133-41ab-9a04-d3af553a4efb None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:44.209656 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df36a94-2133-41ab-9a04-d3af553a4efb None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:44.209956 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df36a94-2133-41ab-9a04-d3af553a4efb None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:44.212870 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 691/1383] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:43:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:43:44.222343 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0eb38-9dc4-47fc-ba1b-cd273136cb96 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:44.223163 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0eb38-9dc4-47fc-ba1b-cd273136cb96 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:44.223295 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf0eb38-9dc4-47fc-ba1b-cd273136cb96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:44.316028 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:44.372285 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-1cf0eb38-9dc4-47fc-ba1b-cd273136cb96 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:43:44.374609 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-1cf0eb38-9dc4-47fc-ba1b-cd273136cb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:44.606929 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 693/1384] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:43:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:43:45.083966 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df36a94-2133-41ab-9a04-d3af553a4efb None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:45.092262 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-7df36a94-2133-41ab-9a04-d3af553a4efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:45.448249 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df36a94-2133-41ab-9a04-d3af553a4efb None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:45.577352 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:45.748307 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3641817-9e2c-426a-857b-798d3e69de6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:45.748986 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3641817-9e2c-426a-857b-798d3e69de6c service nova] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:45.749505 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3641817-9e2c-426a-857b-798d3e69de6c service nova] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:45.749948 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3641817-9e2c-426a-857b-798d3e69de6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:45.752610 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-b3641817-9e2c-426a-857b-798d3e69de6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:45.961090 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3641817-9e2c-426a-857b-798d3e69de6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:45.964451 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3641817-9e2c-426a-857b-798d3e69de6c service nova] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:46.007308 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 692/1385] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:43:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 926 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:43:46.874078 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9c5f9-b156-40cc-9aba-ca9b94c3702d None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:46.874900 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9c5f9-b156-40cc-9aba-ca9b94c3702d None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:46.875085 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9c5f9-b156-40cc-9aba-ca9b94c3702d None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:46.878260 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 694/1386] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:43:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:43:46.888368 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922f9e4-256d-411a-b438-00b6d7a2202a None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:46.889356 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922f9e4-256d-411a-b438-00b6d7a2202a None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:46.889356 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922f9e4-256d-411a-b438-00b6d7a2202a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:47.037684 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-d922f9e4-256d-411a-b438-00b6d7a2202a None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:43:47.039908 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-d922f9e4-256d-411a-b438-00b6d7a2202a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:47.043335 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:47.276049 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 693/1387] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:43:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:43:47.879663 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7a5ee-3303-4eb3-b020-a622fdeed6fe None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:47.880590 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7a5ee-3303-4eb3-b020-a622fdeed6fe None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:47.880976 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7a5ee-3303-4eb3-b020-a622fdeed6fe None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:47.883939 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 695/1388] 10.222.0.69 () {54 vars in 961 bytes} [Thu Sep 8 13:43:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:43:47.898065 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c1ce9-2a82-476c-817e-92a2b9c7803a None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:47.898874 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c1ce9-2a82-476c-817e-92a2b9c7803a None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:47.898874 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c1ce9-2a82-476c-817e-92a2b9c7803a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:48.065932 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-886c1ce9-2a82-476c-817e-92a2b9c7803a None None] MFA Rules not processed for user `6677b4518c094636bc8ed7b588103390`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:43:48.068679 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-886c1ce9-2a82-476c-817e-92a2b9c7803a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:48.247582 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:48.261652 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 694/1389] 10.222.0.69 () {58 vars in 1058 bytes} [Thu Sep 8 13:43:47 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:43:48.270688 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7a5ee-3303-4eb3-b020-a622fdeed6fe None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:48.273518 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-c5b7a5ee-3303-4eb3-b020-a622fdeed6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:48.534195 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7a5ee-3303-4eb3-b020-a622fdeed6fe None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:48.563655 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:48.693756 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca880851-8b70-44a7-9fce-0e5c3bf88738 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6677b4518c094636bc8ed7b588103390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:48.694857 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca880851-8b70-44a7-9fce-0e5c3bf88738 service glance] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:48.695327 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca880851-8b70-44a7-9fce-0e5c3bf88738 service glance] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:48.695816 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca880851-8b70-44a7-9fce-0e5c3bf88738 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:48.699100 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-ca880851-8b70-44a7-9fce-0e5c3bf88738 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:48.977556 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca880851-8b70-44a7-9fce-0e5c3bf88738 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:48.981729 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca880851-8b70-44a7-9fce-0e5c3bf88738 service glance] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:49.191667 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 696/1390] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:43:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 922 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:43:49.691765 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1d4bf-779d-4c05-bb0e-5993d9b37045 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:49.692677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1d4bf-779d-4c05-bb0e-5993d9b37045 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:49.692677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1d4bf-779d-4c05-bb0e-5993d9b37045 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:49.694718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 695/1391] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:43:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:43:49.703969 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea2f91-4dc0-4acd-b48e-e966198be54b None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:49.704437 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea2f91-4dc0-4acd-b48e-e966198be54b None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:49.704930 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea2f91-4dc0-4acd-b48e-e966198be54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:49.815391 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:49.868067 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-a8ea2f91-4dc0-4acd-b48e-e966198be54b None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:43:49.870164 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-a8ea2f91-4dc0-4acd-b48e-e966198be54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:50.109874 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 697/1392] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:43:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:43:50.639083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68878dd0-afd8-410d-b4ab-acdb167f5d2a None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:50.639740 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68878dd0-afd8-410d-b4ab-acdb167f5d2a None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:50.640060 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68878dd0-afd8-410d-b4ab-acdb167f5d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:50.657538 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea2f91-4dc0-4acd-b48e-e966198be54b None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:50.659857 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-a8ea2f91-4dc0-4acd-b48e-e966198be54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:50.812217 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-68878dd0-afd8-410d-b4ab-acdb167f5d2a None None] MFA Rules not processed for user `6d2dd101d1a14e5ab95f272ab1bbeb94`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:43:50.813956 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-68878dd0-afd8-410d-b4ab-acdb167f5d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:50.904624 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea2f91-4dc0-4acd-b48e-e966198be54b None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:50.925525 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:50.977688 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 696/1393] 10.222.0.69 () {58 vars in 1009 bytes} [Thu Sep 8 13:43:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:43:51.052688 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af731de9-e67d-4c9d-a99a-11f37f53391a None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:51.053330 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af731de9-e67d-4c9d-a99a-11f37f53391a None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:51.053996 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af731de9-e67d-4c9d-a99a-11f37f53391a None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:51.059280 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 697/1394] 10.222.0.69 () {54 vars in 943 bytes} [Thu Sep 8 13:43:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:43:51.082819 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949865ad-a347-4c9d-a540-db7d1fad958f None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:51.084244 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949865ad-a347-4c9d-a540-db7d1fad958f None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:51.084916 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949865ad-a347-4c9d-a540-db7d1fad958f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:51.157174 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf590091-c3b9-4613-8fdf-0fb3f2f89891 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:51.160087 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf590091-c3b9-4613-8fdf-0fb3f2f89891 service nova] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:51.160087 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf590091-c3b9-4613-8fdf-0fb3f2f89891 service nova] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:51.161227 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf590091-c3b9-4613-8fdf-0fb3f2f89891 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:51.164475 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-cf590091-c3b9-4613-8fdf-0fb3f2f89891 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:51.260081 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-949865ad-a347-4c9d-a540-db7d1fad958f None None] MFA Rules not processed for user `fa9b97592a6840c3865d7dcf886221e0`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:43:51.262255 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-949865ad-a347-4c9d-a540-db7d1fad958f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:51.330905 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:51.374800 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf590091-c3b9-4613-8fdf-0fb3f2f89891 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:51.377586 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf590091-c3b9-4613-8fdf-0fb3f2f89891 service nova] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:51.410562 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 698/1395] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:43:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 754 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:43:51.519533 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 698/1396] 10.222.0.69 () {58 vars in 1040 bytes} [Thu Sep 8 13:43:51 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 439 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:43:51.537701 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf590091-c3b9-4613-8fdf-0fb3f2f89891 service nova] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:51.540076 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-cf590091-c3b9-4613-8fdf-0fb3f2f89891 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:51.587197 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:51.768464 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf590091-c3b9-4613-8fdf-0fb3f2f89891 service nova] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:52.010182 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086b5c5-4f1b-49eb-bdd9-e495deb28071 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9b97592a6840c3865d7dcf886221e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:52.011416 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086b5c5-4f1b-49eb-bdd9-e495deb28071 service swift] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:52.011915 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086b5c5-4f1b-49eb-bdd9-e495deb28071 service swift] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:52.012401 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086b5c5-4f1b-49eb-bdd9-e495deb28071 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:52.015898 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-8086b5c5-4f1b-49eb-bdd9-e495deb28071 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:52.110194 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:52.178299 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8086b5c5-4f1b-49eb-bdd9-e495deb28071 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:52.181508 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8086b5c5-4f1b-49eb-bdd9-e495deb28071 service swift] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:52.198072 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 699/1397] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Sep 8 13:43:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 663 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 13:43:55.396719 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2cd1bd-c6a2-444c-889a-d6081fab246d None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:55.398795 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2cd1bd-c6a2-444c-889a-d6081fab246d None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:55.399268 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2cd1bd-c6a2-444c-889a-d6081fab246d None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:55.405444 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 699/1398] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:43:55 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:43:55.419695 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d2be6-98bc-4ca5-806a-d29c6c8ee6f6 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:55.421037 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d2be6-98bc-4ca5-806a-d29c6c8ee6f6 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:55.421749 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d2be6-98bc-4ca5-806a-d29c6c8ee6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:55.608218 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-1a7d2be6-98bc-4ca5-806a-d29c6c8ee6f6 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:43:55.610734 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-1a7d2be6-98bc-4ca5-806a-d29c6c8ee6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:55.860994 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 700/1399] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:43:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:43:56.405302 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2cd1bd-c6a2-444c-889a-d6081fab246d None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:43:56.408178 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-1d2cd1bd-c6a2-444c-889a-d6081fab246d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:56.815805 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2cd1bd-c6a2-444c-889a-d6081fab246d None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:43:56.822347 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:57.109919 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a22d0-c120-46c2-8927-8ab2ff968fc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:43:57.111931 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a22d0-c120-46c2-8927-8ab2ff968fc6 service nova] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:43:57.112561 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a22d0-c120-46c2-8927-8ab2ff968fc6 service nova] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:43:57.113343 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a22d0-c120-46c2-8927-8ab2ff968fc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:43:57.117747 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-b16a22d0-c120-46c2-8927-8ab2ff968fc6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:43:57.395224 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a22d0-c120-46c2-8927-8ab2ff968fc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:43:57.397804 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a22d0-c120-46c2-8927-8ab2ff968fc6 service nova] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:43:57.439986 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 700/1400] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:43:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 1036 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:44:01.448534 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ce9ae-943a-44cf-abf4-496431cee582 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:01.449503 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ce9ae-943a-44cf-abf4-496431cee582 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:01.449503 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ce9ae-943a-44cf-abf4-496431cee582 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:01.452846 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 701/1401] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:44:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:44:01.462465 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b534e-0008-4d21-88cf-4c9e369ef5fe None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:01.463416 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b534e-0008-4d21-88cf-4c9e369ef5fe None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:01.463416 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b534e-0008-4d21-88cf-4c9e369ef5fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:01.483512 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:01.615214 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-8e9b534e-0008-4d21-88cf-4c9e369ef5fe None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:44:01.618727 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-8e9b534e-0008-4d21-88cf-4c9e369ef5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:01.903426 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 701/1402] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:44:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:44:02.526540 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ce9ae-943a-44cf-abf4-496431cee582 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:02.529408 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-4e7ce9ae-943a-44cf-abf4-496431cee582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:02.660394 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:02.939179 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ce9ae-943a-44cf-abf4-496431cee582 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:03.239229 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb379c03-0a46-48fc-8251-29e83ea09bc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:03.240371 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb379c03-0a46-48fc-8251-29e83ea09bc5 service nova] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:03.249052 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb379c03-0a46-48fc-8251-29e83ea09bc5 service nova] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:03.249052 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb379c03-0a46-48fc-8251-29e83ea09bc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:03.249052 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-cb379c03-0a46-48fc-8251-29e83ea09bc5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:03.251550 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:03.500885 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb379c03-0a46-48fc-8251-29e83ea09bc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:03.503213 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb379c03-0a46-48fc-8251-29e83ea09bc5 service nova] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:03.547965 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 702/1403] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:44:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 1023 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:44:07.507954 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc05d74-8f6c-45e3-8cff-308d72d7b331 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:07.508901 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc05d74-8f6c-45e3-8cff-308d72d7b331 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:07.508901 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc05d74-8f6c-45e3-8cff-308d72d7b331 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:07.511957 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 702/1404] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:44:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:44:07.522369 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0281891-17d0-4488-8439-285a335a3fea None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:07.523726 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0281891-17d0-4488-8439-285a335a3fea None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:07.523726 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0281891-17d0-4488-8439-285a335a3fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:07.722257 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-e0281891-17d0-4488-8439-285a335a3fea None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:44:07.725503 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-e0281891-17d0-4488-8439-285a335a3fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:07.957486 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:08.042902 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 703/1405] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:44:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 518 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:44:08.610783 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc05d74-8f6c-45e3-8cff-308d72d7b331 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:08.614165 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-8cc05d74-8f6c-45e3-8cff-308d72d7b331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:08.852790 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:09.025140 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc05d74-8f6c-45e3-8cff-308d72d7b331 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:09.333310 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b23a11-51f7-448a-8e2c-c01f0e0bcaf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:09.335040 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b23a11-51f7-448a-8e2c-c01f0e0bcaf4 service nova] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:09.335708 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b23a11-51f7-448a-8e2c-c01f0e0bcaf4 service nova] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:09.336425 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b23a11-51f7-448a-8e2c-c01f0e0bcaf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:09.340164 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-20b23a11-51f7-448a-8e2c-c01f0e0bcaf4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:09.466006 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:09.581856 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b23a11-51f7-448a-8e2c-c01f0e0bcaf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:09.589997 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b23a11-51f7-448a-8e2c-c01f0e0bcaf4 service nova] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:09.659120 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 703/1406] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:44:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 1049 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:44:13.769749 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfec8c9-28fa-487f-a888-0bc6bd3f2647 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:13.771543 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfec8c9-28fa-487f-a888-0bc6bd3f2647 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:13.771543 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfec8c9-28fa-487f-a888-0bc6bd3f2647 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:13.774731 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 704/1407] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:44:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:44:13.784618 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0e8ff-6a05-4f0e-8f41-c1cc4fe3d548 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:13.784618 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0e8ff-6a05-4f0e-8f41-c1cc4fe3d548 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:13.784618 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0e8ff-6a05-4f0e-8f41-c1cc4fe3d548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:13.961397 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-acf0e8ff-6a05-4f0e-8f41-c1cc4fe3d548 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:44:13.961397 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-acf0e8ff-6a05-4f0e-8f41-c1cc4fe3d548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:14.243448 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 704/1408] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:44:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:44:14.780769 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfec8c9-28fa-487f-a888-0bc6bd3f2647 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:14.783382 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-dcfec8c9-28fa-487f-a888-0bc6bd3f2647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:15.209660 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfec8c9-28fa-487f-a888-0bc6bd3f2647 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:15.361010 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:15.509316 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f48c2-1611-4cfc-8c7d-e703fdd15290 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:15.510348 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f48c2-1611-4cfc-8c7d-e703fdd15290 service nova] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:15.510812 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f48c2-1611-4cfc-8c7d-e703fdd15290 service nova] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:15.511256 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f48c2-1611-4cfc-8c7d-e703fdd15290 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:15.514364 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-bc3f48c2-1611-4cfc-8c7d-e703fdd15290 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:15.747444 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f48c2-1611-4cfc-8c7d-e703fdd15290 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:15.754016 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f48c2-1611-4cfc-8c7d-e703fdd15290 service nova] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:15.794906 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 705/1409] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:44:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 1015 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:44:24.239359 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=89 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:25.790321 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=71 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:30.524993 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644d303-29f4-42f4-b159-8da382427ff5 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:30.525870 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644d303-29f4-42f4-b159-8da382427ff5 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:30.525870 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644d303-29f4-42f4-b159-8da382427ff5 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:30.527126 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 705/1410] 10.222.0.69 () {54 vars in 918 bytes} [Thu Sep 8 13:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:44:30.536090 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c18d9-ae82-4c24-b306-cbc54019e682 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:30.536954 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c18d9-ae82-4c24-b306-cbc54019e682 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:30.537139 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4c18d9-ae82-4c24-b306-cbc54019e682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:30.697091 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-5d4c18d9-ae82-4c24-b306-cbc54019e682 None None] MFA Rules not processed for user `733797f12a1741e1a55332991e867aab`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:44:30.699267 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-5d4c18d9-ae82-4c24-b306-cbc54019e682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:30.930467 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 706/1411] 10.222.0.69 () {58 vars in 1015 bytes} [Thu Sep 8 13:44:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:44:30.955147 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabbcdc3-3d4c-40ea-a5b9-5e2a6046cccc None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:30.955519 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabbcdc3-3d4c-40ea-a5b9-5e2a6046cccc None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:30.956001 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabbcdc3-3d4c-40ea-a5b9-5e2a6046cccc None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:30.957865 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 706/1412] 10.222.0.69 () {54 vars in 918 bytes} [Thu Sep 8 13:44:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:44:30.966969 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d835e-5e02-47a1-ae7f-35f0740202f8 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:30.967310 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d835e-5e02-47a1-ae7f-35f0740202f8 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:30.967827 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d835e-5e02-47a1-ae7f-35f0740202f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:31.116010 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:31.120988 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-b69d835e-5e02-47a1-ae7f-35f0740202f8 None None] MFA Rules not processed for user `c95448c1b8b1466cae37fda5c713d53f`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:44:31.123604 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-b69d835e-5e02-47a1-ae7f-35f0740202f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:31.383209 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 707/1413] 10.222.0.69 () {58 vars in 1015 bytes} [Thu Sep 8 13:44:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:44:35.426949 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cb83f-d654-4ec5-a23b-13ba7f93fac9 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:35.427618 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cb83f-d654-4ec5-a23b-13ba7f93fac9 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:35.427960 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cb83f-d654-4ec5-a23b-13ba7f93fac9 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:35.430802 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 707/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 13:44:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:44:35.437539 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387c8b4-4b16-48f6-8f84-2b6d4705d8fc None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:35.438275 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387c8b4-4b16-48f6-8f84-2b6d4705d8fc None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:35.438275 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387c8b4-4b16-48f6-8f84-2b6d4705d8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:35.559233 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-e387c8b4-4b16-48f6-8f84-2b6d4705d8fc None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:44:35.561230 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-e387c8b4-4b16-48f6-8f84-2b6d4705d8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:35.668321 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:35.745904 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 708/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 13:44:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:44:36.097494 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25cb83f-d654-4ec5-a23b-13ba7f93fac9 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:36.100341 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-d25cb83f-d654-4ec5-a23b-13ba7f93fac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:36.386442 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25cb83f-d654-4ec5-a23b-13ba7f93fac9 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:36.516876 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:36.589018 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4136fe84-fc3e-4f8e-902e-bfcf1908c1c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:36.589773 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136fe84-fc3e-4f8e-902e-bfcf1908c1c1 service nova] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:36.590053 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136fe84-fc3e-4f8e-902e-bfcf1908c1c1 service nova] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:36.590370 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4136fe84-fc3e-4f8e-902e-bfcf1908c1c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:36.592818 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-4136fe84-fc3e-4f8e-902e-bfcf1908c1c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:36.757240 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4136fe84-fc3e-4f8e-902e-bfcf1908c1c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:36.759124 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4136fe84-fc3e-4f8e-902e-bfcf1908c1c1 service nova] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:36.787591 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 708/1416] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:44:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 691 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:44:38.178766 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103a894-53c7-4530-ae9a-06ea13509e26 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:38.179633 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103a894-53c7-4530-ae9a-06ea13509e26 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:38.179633 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103a894-53c7-4530-ae9a-06ea13509e26 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:38.181307 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 709/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 13:44:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:44:38.189276 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396a813-6181-4407-9271-3df4db88c88b None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:38.189897 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396a813-6181-4407-9271-3df4db88c88b None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:38.189897 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396a813-6181-4407-9271-3df4db88c88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:38.314840 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-4396a813-6181-4407-9271-3df4db88c88b None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:44:38.316599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-4396a813-6181-4407-9271-3df4db88c88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:38.359629 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:38.491248 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 709/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 13:44:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:44:38.720062 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2103a894-53c7-4530-ae9a-06ea13509e26 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:38.721638 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-2103a894-53c7-4530-ae9a-06ea13509e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:38.934882 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2103a894-53c7-4530-ae9a-06ea13509e26 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:38.999169 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:39.126251 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e6d2af-d4d4-4cb1-900a-5d890baa758b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:39.126970 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6d2af-d4d4-4cb1-900a-5d890baa758b service nova] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:39.127330 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6d2af-d4d4-4cb1-900a-5d890baa758b service nova] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:39.127603 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e6d2af-d4d4-4cb1-900a-5d890baa758b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:39.130234 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-79e6d2af-d4d4-4cb1-900a-5d890baa758b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:39.271285 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e6d2af-d4d4-4cb1-900a-5d890baa758b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:39.273085 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e6d2af-d4d4-4cb1-900a-5d890baa758b service nova] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:39.299781 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 710/1419] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:44:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:44:40.733638 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ae6e6-10b7-472c-a685-ba3a4e148527 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:40.734385 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ae6e6-10b7-472c-a685-ba3a4e148527 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:40.734502 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ae6e6-10b7-472c-a685-ba3a4e148527 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:40.737129 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 710/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 13:44:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:44:40.746629 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc7a14-056b-40cf-ab82-a267aeb0c66c None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:40.747331 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc7a14-056b-40cf-ab82-a267aeb0c66c None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:40.747600 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc7a14-056b-40cf-ab82-a267aeb0c66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:40.866011 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:40.901471 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-38cc7a14-056b-40cf-ab82-a267aeb0c66c None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:44:40.902750 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-38cc7a14-056b-40cf-ab82-a267aeb0c66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:41.047468 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 711/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 13:44:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:44:41.233637 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ae6e6-10b7-472c-a685-ba3a4e148527 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:41.236503 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-1c6ae6e6-10b7-472c-a685-ba3a4e148527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:41.485101 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ae6e6-10b7-472c-a685-ba3a4e148527 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:41.501313 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:41.691998 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292e3cd-9601-4d7f-a372-1e4458ac6c62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:41.693029 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292e3cd-9601-4d7f-a372-1e4458ac6c62 service nova] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:41.693520 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292e3cd-9601-4d7f-a372-1e4458ac6c62 service nova] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:41.693961 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292e3cd-9601-4d7f-a372-1e4458ac6c62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:41.696940 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-0292e3cd-9601-4d7f-a372-1e4458ac6c62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:41.860759 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0292e3cd-9601-4d7f-a372-1e4458ac6c62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:41.862997 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0292e3cd-9601-4d7f-a372-1e4458ac6c62 service nova] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:41.898989 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 711/1422] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:44:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 667 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:44:43.424055 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3a994-6ac5-4134-8747-8af252fd15c7 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:43.424866 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3a994-6ac5-4134-8747-8af252fd15c7 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:43.424866 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3a994-6ac5-4134-8747-8af252fd15c7 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:43.426211 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 712/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 13:44:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:44:43.436834 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea86bc4-a6a0-4589-9760-77c8e8fa1185 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:43.437529 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea86bc4-a6a0-4589-9760-77c8e8fa1185 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:43.437529 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea86bc4-a6a0-4589-9760-77c8e8fa1185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:43.462561 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:43.564698 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-5ea86bc4-a6a0-4589-9760-77c8e8fa1185 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:44:43.567002 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-5ea86bc4-a6a0-4589-9760-77c8e8fa1185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:43.752292 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 712/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 13:44:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:44:43.921402 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3a994-6ac5-4134-8747-8af252fd15c7 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:43.923315 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-09c3a994-6ac5-4134-8747-8af252fd15c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:44.123973 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:44.196587 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3a994-6ac5-4134-8747-8af252fd15c7 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:44.391481 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d431e01-f0e8-4e4c-b0d6-b3fa50abd903 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:44.392204 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d431e01-f0e8-4e4c-b0d6-b3fa50abd903 service nova] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:44.392530 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d431e01-f0e8-4e4c-b0d6-b3fa50abd903 service nova] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:44.392922 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d431e01-f0e8-4e4c-b0d6-b3fa50abd903 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:44.396213 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-9d431e01-f0e8-4e4c-b0d6-b3fa50abd903 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:44.557250 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:44.579493 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d431e01-f0e8-4e4c-b0d6-b3fa50abd903 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:44.582002 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d431e01-f0e8-4e4c-b0d6-b3fa50abd903 service nova] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:44.606640 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 713/1425] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:44:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 686 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:44:46.127108 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c3995-59a7-4a9b-8bf0-a95f63324cc1 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:46.127993 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c3995-59a7-4a9b-8bf0-a95f63324cc1 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:46.127993 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c3995-59a7-4a9b-8bf0-a95f63324cc1 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:46.130356 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 713/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 13:44:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:44:46.141077 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e3892-51b2-4ad8-83e5-02d70e7f7efb None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:46.142011 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e3892-51b2-4ad8-83e5-02d70e7f7efb None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:46.142011 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e3892-51b2-4ad8-83e5-02d70e7f7efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:46.274426 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-e17e3892-51b2-4ad8-83e5-02d70e7f7efb None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:44:46.275996 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-e17e3892-51b2-4ad8-83e5-02d70e7f7efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:46.504160 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 714/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 13:44:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:44:46.738649 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c3995-59a7-4a9b-8bf0-a95f63324cc1 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:46.740664 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-fd2c3995-59a7-4a9b-8bf0-a95f63324cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:46.921798 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:47.039702 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c3995-59a7-4a9b-8bf0-a95f63324cc1 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:47.272368 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400dfad5-9d2d-48c7-b5fd-29cbbfed83a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:47.273603 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400dfad5-9d2d-48c7-b5fd-29cbbfed83a6 service nova] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:47.273919 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400dfad5-9d2d-48c7-b5fd-29cbbfed83a6 service nova] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:47.274408 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400dfad5-9d2d-48c7-b5fd-29cbbfed83a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:47.277872 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-400dfad5-9d2d-48c7-b5fd-29cbbfed83a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:47.382818 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:47.457421 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400dfad5-9d2d-48c7-b5fd-29cbbfed83a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:47.459370 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400dfad5-9d2d-48c7-b5fd-29cbbfed83a6 service nova] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:47.494544 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 714/1428] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:44:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 757 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:44:49.240819 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417d285-f80f-43c4-81ba-0d9bf9078046 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:49.242011 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417d285-f80f-43c4-81ba-0d9bf9078046 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:49.242011 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417d285-f80f-43c4-81ba-0d9bf9078046 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:49.243455 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 715/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 13:44:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:44:49.254745 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52593ef7-01d3-47bb-9e3b-4a13a1a8f2fa None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:49.255699 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52593ef7-01d3-47bb-9e3b-4a13a1a8f2fa None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:49.255699 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52593ef7-01d3-47bb-9e3b-4a13a1a8f2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:49.387274 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-52593ef7-01d3-47bb-9e3b-4a13a1a8f2fa None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:44:49.388764 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-52593ef7-01d3-47bb-9e3b-4a13a1a8f2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:49.520041 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 715/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 13:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:44:49.723026 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417d285-f80f-43c4-81ba-0d9bf9078046 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:49.724816 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-8417d285-f80f-43c4-81ba-0d9bf9078046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:49.819809 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:50.054211 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417d285-f80f-43c4-81ba-0d9bf9078046 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:50.252387 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4884b36-f4d8-4c1e-9c1c-e7ecf56534ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:50.253865 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4884b36-f4d8-4c1e-9c1c-e7ecf56534ec service nova] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:50.254369 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4884b36-f4d8-4c1e-9c1c-e7ecf56534ec service nova] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:50.254861 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4884b36-f4d8-4c1e-9c1c-e7ecf56534ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:50.257939 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-a4884b36-f4d8-4c1e-9c1c-e7ecf56534ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:50.271501 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:50.418390 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4884b36-f4d8-4c1e-9c1c-e7ecf56534ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:50.421144 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4884b36-f4d8-4c1e-9c1c-e7ecf56534ec service nova] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:50.457439 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 716/1431] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:44:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 736 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:44:51.847765 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739739b1-6688-4683-97ac-d1759f89ff97 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:51.848688 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739739b1-6688-4683-97ac-d1759f89ff97 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:51.848688 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739739b1-6688-4683-97ac-d1759f89ff97 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:51.850154 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 716/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 13:44:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:44:51.858439 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e9091-b8a2-4fc6-b7af-183bfdc95ef1 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:51.859237 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e9091-b8a2-4fc6-b7af-183bfdc95ef1 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:51.859237 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e9091-b8a2-4fc6-b7af-183bfdc95ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:51.957590 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-607e9091-b8a2-4fc6-b7af-183bfdc95ef1 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:44:51.958856 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-607e9091-b8a2-4fc6-b7af-183bfdc95ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:52.046209 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:52.084974 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 717/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 13:44:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:44:52.252802 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739739b1-6688-4683-97ac-d1759f89ff97 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:52.255248 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-739739b1-6688-4683-97ac-d1759f89ff97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:52.277676 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:52.539005 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739739b1-6688-4683-97ac-d1759f89ff97 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:52.717564 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:52.770327 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30676a1a-ea04-4527-9ba7-4625dcabe72f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:52.771376 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30676a1a-ea04-4527-9ba7-4625dcabe72f service nova] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:52.771855 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30676a1a-ea04-4527-9ba7-4625dcabe72f service nova] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:52.772440 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30676a1a-ea04-4527-9ba7-4625dcabe72f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:52.775960 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-30676a1a-ea04-4527-9ba7-4625dcabe72f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:52.943081 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30676a1a-ea04-4527-9ba7-4625dcabe72f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:52.945182 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30676a1a-ea04-4527-9ba7-4625dcabe72f service nova] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:52.970142 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 717/1434] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:44:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 718 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:44:54.186495 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1198b-0623-426d-b268-cd156e73c51a None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:54.187080 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1198b-0623-426d-b268-cd156e73c51a None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:54.187435 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f1198b-0623-426d-b268-cd156e73c51a None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:54.190126 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 718/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 13:44:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:44:54.198974 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdbd78-450b-4300-ab4d-3a18aa733aa9 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:54.199686 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdbd78-450b-4300-ab4d-3a18aa733aa9 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:54.199934 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdbd78-450b-4300-ab4d-3a18aa733aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:54.361537 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-85fdbd78-450b-4300-ab4d-3a18aa733aa9 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:44:54.364055 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-85fdbd78-450b-4300-ab4d-3a18aa733aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:54.445580 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:54.551067 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 718/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 13:44:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:44:54.788314 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1198b-0623-426d-b268-cd156e73c51a None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:54.790566 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-b0f1198b-0623-426d-b268-cd156e73c51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:55.052839 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f1198b-0623-426d-b268-cd156e73c51a None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:55.158511 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:55.274829 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d22a3a-d4c8-486b-a800-5f5b6ec66378 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:55.275917 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d22a3a-d4c8-486b-a800-5f5b6ec66378 service nova] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:55.276411 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d22a3a-d4c8-486b-a800-5f5b6ec66378 service nova] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:55.276881 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d22a3a-d4c8-486b-a800-5f5b6ec66378 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:55.280172 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-89d22a3a-d4c8-486b-a800-5f5b6ec66378 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:55.463870 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d22a3a-d4c8-486b-a800-5f5b6ec66378 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:55.466338 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d22a3a-d4c8-486b-a800-5f5b6ec66378 service nova] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:55.498922 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 719/1437] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:44:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 712 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:44:56.786119 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6450182-8f8b-4e00-aae3-e6f74999ac1c None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:56.786741 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6450182-8f8b-4e00-aae3-e6f74999ac1c None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:56.787065 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6450182-8f8b-4e00-aae3-e6f74999ac1c None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:56.789744 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 719/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 13:44:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:44:56.801100 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fcd03-2997-4194-a1a1-2d99cf73c5eb None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:56.801773 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fcd03-2997-4194-a1a1-2d99cf73c5eb None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:56.802056 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8fcd03-2997-4194-a1a1-2d99cf73c5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:56.940972 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-ac8fcd03-2997-4194-a1a1-2d99cf73c5eb None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:44:56.942757 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-ac8fcd03-2997-4194-a1a1-2d99cf73c5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:56.946464 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:57.129317 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 720/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 13:44:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:44:57.429919 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6450182-8f8b-4e00-aae3-e6f74999ac1c None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:44:57.432401 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-b6450182-8f8b-4e00-aae3-e6f74999ac1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:57.700431 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6450182-8f8b-4e00-aae3-e6f74999ac1c None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:44:57.737396 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:57.854523 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0eff8-c31b-4569-9e4a-f082381a9478 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:44:57.855560 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0eff8-c31b-4569-9e4a-f082381a9478 service nova] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:44:57.855560 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0eff8-c31b-4569-9e4a-f082381a9478 service nova] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:44:57.855907 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0eff8-c31b-4569-9e4a-f082381a9478 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:44:57.857801 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-97f0eff8-c31b-4569-9e4a-f082381a9478 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:44:57.986487 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f0eff8-c31b-4569-9e4a-f082381a9478 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:44:57.988181 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f0eff8-c31b-4569-9e4a-f082381a9478 service nova] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:44:58.013630 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 720/1440] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:44:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:45:00.651201 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ac5cc-ada1-41de-8b39-022c25279ea4 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:00.652125 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ac5cc-ada1-41de-8b39-022c25279ea4 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:00.652125 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ac5cc-ada1-41de-8b39-022c25279ea4 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:00.653627 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 721/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 13:45:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:45:00.662175 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c7a1a-ba44-4f33-8af2-e417817464be None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:00.662843 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c7a1a-ba44-4f33-8af2-e417817464be None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:00.663139 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c7a1a-ba44-4f33-8af2-e417817464be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:00.744118 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:00.790936 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-7d2c7a1a-ba44-4f33-8af2-e417817464be None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:00.792327 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-7d2c7a1a-ba44-4f33-8af2-e417817464be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:00.959848 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 721/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 13:45:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:45:01.285554 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ac5cc-ada1-41de-8b39-022c25279ea4 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:01.287339 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-533ac5cc-ada1-41de-8b39-022c25279ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:01.458479 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ac5cc-ada1-41de-8b39-022c25279ea4 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:01.526129 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:01.587588 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6b9b3-7f00-43e0-bfe8-1d3c40bd9830 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:01.588085 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6b9b3-7f00-43e0-bfe8-1d3c40bd9830 service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:01.588361 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6b9b3-7f00-43e0-bfe8-1d3c40bd9830 service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:01.588629 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6b9b3-7f00-43e0-bfe8-1d3c40bd9830 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:01.590473 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-4aa6b9b3-7f00-43e0-bfe8-1d3c40bd9830 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:01.764343 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa6b9b3-7f00-43e0-bfe8-1d3c40bd9830 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:01.767237 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa6b9b3-7f00-43e0-bfe8-1d3c40bd9830 service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:01.807594 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 722/1443] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:45:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:45:05.242752 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe06009-9986-4524-8210-50ca8d69b0bd None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:05.243554 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe06009-9986-4524-8210-50ca8d69b0bd None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:05.243554 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe06009-9986-4524-8210-50ca8d69b0bd None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:05.245801 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 722/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 13:45:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:05.252774 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0131eb2-20cc-4933-8a86-beb8bdc66b00 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:05.254550 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0131eb2-20cc-4933-8a86-beb8bdc66b00 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:05.255026 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0131eb2-20cc-4933-8a86-beb8bdc66b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:05.360891 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-c0131eb2-20cc-4933-8a86-beb8bdc66b00 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:05.363204 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-c0131eb2-20cc-4933-8a86-beb8bdc66b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:05.383848 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:05.494112 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 723/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 13:45:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:45:05.795248 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe06009-9986-4524-8210-50ca8d69b0bd None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:05.796803 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-dfe06009-9986-4524-8210-50ca8d69b0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:05.968959 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe06009-9986-4524-8210-50ca8d69b0bd None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:05.993022 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:06.071401 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208adea8-376a-42ee-93f8-e17405f9fd8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:06.072036 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208adea8-376a-42ee-93f8-e17405f9fd8f service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:06.072327 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208adea8-376a-42ee-93f8-e17405f9fd8f service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:06.072712 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208adea8-376a-42ee-93f8-e17405f9fd8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:06.075050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-208adea8-376a-42ee-93f8-e17405f9fd8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:06.219042 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208adea8-376a-42ee-93f8-e17405f9fd8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:06.220494 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208adea8-376a-42ee-93f8-e17405f9fd8f service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:06.244226 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 723/1446] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:45:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:45:09.628523 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07371ca3-15d6-4ceb-a4a4-0c035d5fdbdd None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:09.629431 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07371ca3-15d6-4ceb-a4a4-0c035d5fdbdd None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:09.629431 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07371ca3-15d6-4ceb-a4a4-0c035d5fdbdd None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:09.630985 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 724/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 13:45:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:45:09.638491 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67097df-32b0-4953-80ab-8c22c9832a44 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:09.639099 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67097df-32b0-4953-80ab-8c22c9832a44 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:09.639387 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67097df-32b0-4953-80ab-8c22c9832a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:09.735151 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:09.772668 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-a67097df-32b0-4953-80ab-8c22c9832a44 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:09.774886 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-a67097df-32b0-4953-80ab-8c22c9832a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:09.964117 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 724/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 13:45:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:45:10.303982 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07371ca3-15d6-4ceb-a4a4-0c035d5fdbdd None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:10.305679 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-07371ca3-15d6-4ceb-a4a4-0c035d5fdbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:10.494118 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07371ca3-15d6-4ceb-a4a4-0c035d5fdbdd None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:10.557061 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:10.631349 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e926c6a4-931f-47ea-895e-f8c9377ae37f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:10.632395 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926c6a4-931f-47ea-895e-f8c9377ae37f service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:10.632891 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926c6a4-931f-47ea-895e-f8c9377ae37f service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:10.633544 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926c6a4-931f-47ea-895e-f8c9377ae37f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:10.636659 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-e926c6a4-931f-47ea-895e-f8c9377ae37f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:10.838184 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e926c6a4-931f-47ea-895e-f8c9377ae37f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:10.840824 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e926c6a4-931f-47ea-895e-f8c9377ae37f service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:10.872943 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 725/1449] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:45:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:45:13.905340 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d4102-87ef-429f-8cd8-51b7f7d9aa40 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:13.906187 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d4102-87ef-429f-8cd8-51b7f7d9aa40 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:13.906335 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d4102-87ef-429f-8cd8-51b7f7d9aa40 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:13.910077 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 725/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 13:45:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:13.917250 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e0a37-1d8c-4090-a12c-508b5e0040dd None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:13.918100 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e0a37-1d8c-4090-a12c-508b5e0040dd None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:13.918100 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e0a37-1d8c-4090-a12c-508b5e0040dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:14.055158 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-879e0a37-1d8c-4090-a12c-508b5e0040dd None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:14.057284 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-879e0a37-1d8c-4090-a12c-508b5e0040dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:14.101912 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:14.248140 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 726/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 13:45:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:45:14.802642 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d4102-87ef-429f-8cd8-51b7f7d9aa40 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:14.805730 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-f77d4102-87ef-429f-8cd8-51b7f7d9aa40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:15.003440 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d4102-87ef-429f-8cd8-51b7f7d9aa40 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:15.035329 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:15.144567 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b306a-4a5c-4b2e-a688-7a11c7537160 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:15.145331 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b306a-4a5c-4b2e-a688-7a11c7537160 service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:15.145764 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b306a-4a5c-4b2e-a688-7a11c7537160 service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:15.146138 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b306a-4a5c-4b2e-a688-7a11c7537160 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:15.147977 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-8f1b306a-4a5c-4b2e-a688-7a11c7537160 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:15.331957 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1b306a-4a5c-4b2e-a688-7a11c7537160 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:15.334750 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1b306a-4a5c-4b2e-a688-7a11c7537160 service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:15.372508 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 726/1452] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:45:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:45:17.981954 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc2539-cdec-4dad-9851-1e7063fa58a3 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:17.982542 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc2539-cdec-4dad-9851-1e7063fa58a3 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:17.982806 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc2539-cdec-4dad-9851-1e7063fa58a3 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:17.985343 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 727/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 13:45:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:17.995325 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5394d0f-6924-479c-9cb4-62244650a2cb None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:17.996154 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5394d0f-6924-479c-9cb4-62244650a2cb None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:17.996154 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5394d0f-6924-479c-9cb4-62244650a2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:18.103856 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:18.109131 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-e5394d0f-6924-479c-9cb4-62244650a2cb None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:18.110928 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-e5394d0f-6924-479c-9cb4-62244650a2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:18.245235 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 727/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 13:45:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:45:18.556577 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc2539-cdec-4dad-9851-1e7063fa58a3 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:18.559635 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-c1bc2539-cdec-4dad-9851-1e7063fa58a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:18.754450 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc2539-cdec-4dad-9851-1e7063fa58a3 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:18.858006 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:18.901147 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e3ae3-61cb-4660-ae2a-4c8be1bcf2ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:18.902022 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e3ae3-61cb-4660-ae2a-4c8be1bcf2ed service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:18.902406 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e3ae3-61cb-4660-ae2a-4c8be1bcf2ed service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:18.902887 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e3ae3-61cb-4660-ae2a-4c8be1bcf2ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:18.904751 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-e78e3ae3-61cb-4660-ae2a-4c8be1bcf2ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:19.102896 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e3ae3-61cb-4660-ae2a-4c8be1bcf2ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:19.105729 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e3ae3-61cb-4660-ae2a-4c8be1bcf2ed service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:19.140812 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 728/1455] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:45:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:45:22.930291 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb09f0-b6c7-40f8-b0d8-5c1ea0b967f3 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:22.930951 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb09f0-b6c7-40f8-b0d8-5c1ea0b967f3 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:22.931248 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb09f0-b6c7-40f8-b0d8-5c1ea0b967f3 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:22.933635 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 728/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 13:45:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:22.943648 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77fa74-d694-4ea5-9749-6d15def93ebb None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:22.944276 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77fa74-d694-4ea5-9749-6d15def93ebb None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:22.944772 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d77fa74-d694-4ea5-9749-6d15def93ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:23.074406 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-8d77fa74-d694-4ea5-9749-6d15def93ebb None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:23.076409 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-8d77fa74-d694-4ea5-9749-6d15def93ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:23.132478 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:23.267235 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 729/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 13:45:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:45:23.665096 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb09f0-b6c7-40f8-b0d8-5c1ea0b967f3 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:23.667379 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-9bcb09f0-b6c7-40f8-b0d8-5c1ea0b967f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:23.818822 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb09f0-b6c7-40f8-b0d8-5c1ea0b967f3 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:23.870448 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:23.969711 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3164ba3-7ab2-42fb-9448-f07326446821 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:23.970795 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3164ba3-7ab2-42fb-9448-f07326446821 service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:23.972278 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3164ba3-7ab2-42fb-9448-f07326446821 service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:23.972773 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3164ba3-7ab2-42fb-9448-f07326446821 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:23.976393 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-a3164ba3-7ab2-42fb-9448-f07326446821 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:24.185995 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3164ba3-7ab2-42fb-9448-f07326446821 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:24.187457 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3164ba3-7ab2-42fb-9448-f07326446821 service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:24.211779 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 729/1458] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:45:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:45:26.976440 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82667bc9-8894-47ca-9e29-4ea10260292d None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:26.977307 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82667bc9-8894-47ca-9e29-4ea10260292d None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:26.977529 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82667bc9-8894-47ca-9e29-4ea10260292d None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:26.980437 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 730/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 13:45:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:26.990448 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff0c4c-c570-47a9-9ca5-a2c49a8f6a47 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:26.991137 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff0c4c-c570-47a9-9ca5-a2c49a8f6a47 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:26.991421 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff0c4c-c570-47a9-9ca5-a2c49a8f6a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:27.114215 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-05ff0c4c-c570-47a9-9ca5-a2c49a8f6a47 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:27.116058 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-05ff0c4c-c570-47a9-9ca5-a2c49a8f6a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:27.134358 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:27.314954 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 730/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 13:45:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:45:27.641870 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82667bc9-8894-47ca-9e29-4ea10260292d None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:27.644566 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-82667bc9-8894-47ca-9e29-4ea10260292d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:27.853257 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82667bc9-8894-47ca-9e29-4ea10260292d None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:27.943661 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:27.966496 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f9fe1-bc97-4cd6-ab15-4d0f8d7c7f75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:27.967112 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f9fe1-bc97-4cd6-ab15-4d0f8d7c7f75 service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:27.967398 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f9fe1-bc97-4cd6-ab15-4d0f8d7c7f75 service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:27.967667 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f9fe1-bc97-4cd6-ab15-4d0f8d7c7f75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:27.969413 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-d09f9fe1-bc97-4cd6-ab15-4d0f8d7c7f75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:28.125553 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f9fe1-bc97-4cd6-ab15-4d0f8d7c7f75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:28.127783 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f9fe1-bc97-4cd6-ab15-4d0f8d7c7f75 service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:28.149614 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 731/1461] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:45:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:45:30.761578 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0245f0-e27c-4262-8fd4-f6aa406e8623 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:30.762243 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0245f0-e27c-4262-8fd4-f6aa406e8623 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:30.762243 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0245f0-e27c-4262-8fd4-f6aa406e8623 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:30.763706 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 731/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 13:45:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:45:30.773002 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b48ae-7204-44df-b9e9-abd9cbc01516 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:30.773665 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b48ae-7204-44df-b9e9-abd9cbc01516 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:30.773869 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b48ae-7204-44df-b9e9-abd9cbc01516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:30.862200 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-ed4b48ae-7204-44df-b9e9-abd9cbc01516 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:30.863597 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-ed4b48ae-7204-44df-b9e9-abd9cbc01516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:30.912116 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:31.003251 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 732/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 13:45:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:45:31.348559 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0245f0-e27c-4262-8fd4-f6aa406e8623 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:31.351000 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-6b0245f0-e27c-4262-8fd4-f6aa406e8623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:31.511952 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0245f0-e27c-4262-8fd4-f6aa406e8623 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:31.562186 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:31.632471 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34461e75-91d0-4d94-acd6-0344a815e5c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:31.633868 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34461e75-91d0-4d94-acd6-0344a815e5c6 service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:31.634380 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34461e75-91d0-4d94-acd6-0344a815e5c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:31.634890 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34461e75-91d0-4d94-acd6-0344a815e5c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:31.638312 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-34461e75-91d0-4d94-acd6-0344a815e5c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:31.875808 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34461e75-91d0-4d94-acd6-0344a815e5c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:31.877767 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34461e75-91d0-4d94-acd6-0344a815e5c6 service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:31.906963 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 732/1464] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:45:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:45:34.569672 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531a946-9668-4fe1-a55e-98fefe04bf2c None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:34.570272 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531a946-9668-4fe1-a55e-98fefe04bf2c None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:34.570272 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531a946-9668-4fe1-a55e-98fefe04bf2c None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:34.571819 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 733/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 13:45:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:45:34.578059 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349dfeb7-dab4-4152-b473-92a0be3be052 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:34.578650 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349dfeb7-dab4-4152-b473-92a0be3be052 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:34.578650 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349dfeb7-dab4-4152-b473-92a0be3be052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:34.662269 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-349dfeb7-dab4-4152-b473-92a0be3be052 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:34.663644 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-349dfeb7-dab4-4152-b473-92a0be3be052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:34.692940 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:34.792734 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 733/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 13:45:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:45:35.093282 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531a946-9668-4fe1-a55e-98fefe04bf2c None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:35.095100 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-6531a946-9668-4fe1-a55e-98fefe04bf2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:35.234904 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531a946-9668-4fe1-a55e-98fefe04bf2c None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:35.347121 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:35.360307 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743361bd-c608-47a8-990b-71b89438199e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:35.361841 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743361bd-c608-47a8-990b-71b89438199e service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:35.362320 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743361bd-c608-47a8-990b-71b89438199e service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:35.362802 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743361bd-c608-47a8-990b-71b89438199e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:35.366009 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-743361bd-c608-47a8-990b-71b89438199e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:35.522806 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743361bd-c608-47a8-990b-71b89438199e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:35.524637 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743361bd-c608-47a8-990b-71b89438199e service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:35.547380 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 734/1467] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:45:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:45:38.082891 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eaac5c-ffc8-4adf-b91d-6da2d806a899 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:38.083471 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eaac5c-ffc8-4adf-b91d-6da2d806a899 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:38.083471 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eaac5c-ffc8-4adf-b91d-6da2d806a899 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:38.084834 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 734/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 13:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:45:38.092209 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c215666-b981-4653-8605-93589b359da6 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:38.092981 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c215666-b981-4653-8605-93589b359da6 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:38.092981 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c215666-b981-4653-8605-93589b359da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:38.194648 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-4c215666-b981-4653-8605-93589b359da6 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:45:38.195895 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-4c215666-b981-4653-8605-93589b359da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:38.261267 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:38.334715 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 735/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 13:45:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:45:38.650527 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eaac5c-ffc8-4adf-b91d-6da2d806a899 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:45:38.652205 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-88eaac5c-ffc8-4adf-b91d-6da2d806a899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:38.856132 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eaac5c-ffc8-4adf-b91d-6da2d806a899 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:45:38.936756 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:38.972463 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71bf12e-432b-4d2d-801a-6a3d45089e8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:45:38.973337 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71bf12e-432b-4d2d-801a-6a3d45089e8a service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:45:38.973657 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71bf12e-432b-4d2d-801a-6a3d45089e8a service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:45:38.973930 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71bf12e-432b-4d2d-801a-6a3d45089e8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:45:38.975656 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-c71bf12e-432b-4d2d-801a-6a3d45089e8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:45:39.279894 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71bf12e-432b-4d2d-801a-6a3d45089e8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:45:39.282888 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71bf12e-432b-4d2d-801a-6a3d45089e8a service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:45:39.328731 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 735/1470] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:45:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 679 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:45:48.332781 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=22 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:49.325304 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=66 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:05.205518 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b383a-9cfc-475b-9a71-45f122bf3d49 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:05.206369 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b383a-9cfc-475b-9a71-45f122bf3d49 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:05.206526 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b383a-9cfc-475b-9a71-45f122bf3d49 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:05.209446 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 736/1471] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:46:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:46:05.216335 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3839dee-793b-4051-ab88-ef5b1f342b1a None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:05.217152 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3839dee-793b-4051-ab88-ef5b1f342b1a None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:05.217152 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3839dee-793b-4051-ab88-ef5b1f342b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:05.318543 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-d3839dee-793b-4051-ab88-ef5b1f342b1a None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:05.320664 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-d3839dee-793b-4051-ab88-ef5b1f342b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:05.458403 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 736/1472] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:46:05.788429 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474a899-2866-4ba2-b9a5-cbd209689168 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:05.788777 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474a899-2866-4ba2-b9a5-cbd209689168 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:05.789190 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474a899-2866-4ba2-b9a5-cbd209689168 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:05.790896 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 737/1473] 10.222.0.69 () {54 vars in 961 bytes} [Thu Sep 8 13:46:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:46:05.797778 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb848e3-bc1d-4d01-869c-97c563486ac2 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:05.798352 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb848e3-bc1d-4d01-869c-97c563486ac2 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:05.798893 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb848e3-bc1d-4d01-869c-97c563486ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:05.911713 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-6fb848e3-bc1d-4d01-869c-97c563486ac2 None None] MFA Rules not processed for user `6677b4518c094636bc8ed7b588103390`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:05.913257 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-6fb848e3-bc1d-4d01-869c-97c563486ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:05.939362 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:06.010792 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 737/1474] 10.222.0.69 () {58 vars in 1058 bytes} [Thu Sep 8 13:46:05 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:46:06.020020 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1474a899-2866-4ba2-b9a5-cbd209689168 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:06.022113 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-1474a899-2866-4ba2-b9a5-cbd209689168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:06.217439 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1474a899-2866-4ba2-b9a5-cbd209689168 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:06.362524 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b66c7c-39c6-46c7-b7e6-17e46d6d5e93 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6677b4518c094636bc8ed7b588103390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:06.363604 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b66c7c-39c6-46c7-b7e6-17e46d6d5e93 service glance] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:06.364122 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b66c7c-39c6-46c7-b7e6-17e46d6d5e93 service glance] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:06.364639 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b66c7c-39c6-46c7-b7e6-17e46d6d5e93 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:06.368051 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-91b66c7c-39c6-46c7-b7e6-17e46d6d5e93 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:06.445224 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:06.526528 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b66c7c-39c6-46c7-b7e6-17e46d6d5e93 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:06.527874 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b66c7c-39c6-46c7-b7e6-17e46d6d5e93 service glance] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:06.550576 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 738/1475] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:46:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:46:09.472147 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0ce66-db99-430d-a30d-1a474ccc124a None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:09.472805 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0ce66-db99-430d-a30d-1a474ccc124a None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:09.472805 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0ce66-db99-430d-a30d-1a474ccc124a None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:09.474417 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 738/1476] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:46:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:46:09.482452 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839a6f5-feda-4cc1-9998-ebeb138bd398 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:09.482452 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839a6f5-feda-4cc1-9998-ebeb138bd398 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:09.482452 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839a6f5-feda-4cc1-9998-ebeb138bd398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:09.589707 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-b839a6f5-feda-4cc1-9998-ebeb138bd398 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:09.591049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-b839a6f5-feda-4cc1-9998-ebeb138bd398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:09.764572 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 739/1477] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:46:10.058252 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e0ce66-db99-430d-a30d-1a474ccc124a None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:10.061035 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-c3e0ce66-db99-430d-a30d-1a474ccc124a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:10.234279 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e0ce66-db99-430d-a30d-1a474ccc124a None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:10.311671 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:10.368362 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e818e10-92b3-4675-826e-aa3b2638e788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:10.368977 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e818e10-92b3-4675-826e-aa3b2638e788 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:10.369252 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e818e10-92b3-4675-826e-aa3b2638e788 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:10.369557 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e818e10-92b3-4675-826e-aa3b2638e788 admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:10.370221 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e818e10-92b3-4675-826e-aa3b2638e788 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:10.372041 dv-cinder-856463-2-smb devstack@keystone.service[88208]: WARNING py.warnings [None req-6e818e10-92b3-4675-826e-aa3b2638e788 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 13:46:10.372041 dv-cinder-856463-2-smb devstack@keystone.service[88208]: warnings.warn(msg) Sep 08 13:46:10.372041 dv-cinder-856463-2-smb devstack@keystone.service[88208]: Sep 08 13:46:10.373190 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e818e10-92b3-4675-826e-aa3b2638e788 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:10.399979 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 739/1478] 10.222.0.69 () {56 vars in 1108 bytes} [Thu Sep 8 13:46:10 2022] GET /identity/v3/projects => generated 2553 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:46:12.866564 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966d90e-dbd8-4c32-99d5-81261e21d985 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:12.867205 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966d90e-dbd8-4c32-99d5-81261e21d985 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:12.867322 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966d90e-dbd8-4c32-99d5-81261e21d985 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:12.869123 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 740/1479] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:46:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:46:12.876233 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49267f-1d26-408b-9c8d-6056f8be47b4 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:12.876896 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49267f-1d26-408b-9c8d-6056f8be47b4 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:12.876896 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49267f-1d26-408b-9c8d-6056f8be47b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:12.964713 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-4d49267f-1d26-408b-9c8d-6056f8be47b4 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:12.966181 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-4d49267f-1d26-408b-9c8d-6056f8be47b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:13.105248 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 740/1480] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:46:13.431744 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966d90e-dbd8-4c32-99d5-81261e21d985 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:13.433514 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-3966d90e-dbd8-4c32-99d5-81261e21d985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:13.447855 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:13.653251 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966d90e-dbd8-4c32-99d5-81261e21d985 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:13.799551 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:13.863831 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f815c85-5334-454a-be14-94c9c0afa3d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:13.864835 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f815c85-5334-454a-be14-94c9c0afa3d2 service nova] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:13.865302 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f815c85-5334-454a-be14-94c9c0afa3d2 service nova] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:13.865858 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f815c85-5334-454a-be14-94c9c0afa3d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:13.869090 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-2f815c85-5334-454a-be14-94c9c0afa3d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:14.025221 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f815c85-5334-454a-be14-94c9c0afa3d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:14.027304 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f815c85-5334-454a-be14-94c9c0afa3d2 service nova] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:14.054918 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 741/1481] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:46:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:46:17.017942 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae43253-ad1a-4099-94ff-bd2475b4ab6a None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:17.018630 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae43253-ad1a-4099-94ff-bd2475b4ab6a None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:17.018802 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae43253-ad1a-4099-94ff-bd2475b4ab6a None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:17.020237 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 741/1482] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:46:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:46:17.027709 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab6e51-0395-4971-be9f-5f92f9a610f9 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:17.028493 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab6e51-0395-4971-be9f-5f92f9a610f9 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:17.028493 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab6e51-0395-4971-be9f-5f92f9a610f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:17.127996 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-c2ab6e51-0395-4971-be9f-5f92f9a610f9 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:17.129390 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-c2ab6e51-0395-4971-be9f-5f92f9a610f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:17.216246 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:17.330694 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 742/1483] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:46:17.830202 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae43253-ad1a-4099-94ff-bd2475b4ab6a None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:17.832920 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-aae43253-ad1a-4099-94ff-bd2475b4ab6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:17.872789 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:17.988143 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae43253-ad1a-4099-94ff-bd2475b4ab6a None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:18.118745 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b1889-909c-453a-9534-78759eae19c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:18.119628 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b1889-909c-453a-9534-78759eae19c1 service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:18.120050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b1889-909c-453a-9534-78759eae19c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:18.120450 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b1889-909c-453a-9534-78759eae19c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:18.123164 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-474b1889-909c-453a-9534-78759eae19c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:18.254052 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:18.301710 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b1889-909c-453a-9534-78759eae19c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:18.303553 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b1889-909c-453a-9534-78759eae19c1 service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:18.325211 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 742/1484] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:46:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:46:21.088827 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de066ec8-32e9-4135-8274-61277f08a450 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:21.089756 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de066ec8-32e9-4135-8274-61277f08a450 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:21.089756 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de066ec8-32e9-4135-8274-61277f08a450 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:21.091522 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 743/1485] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:46:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:46:21.098606 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac4788-902c-4074-aa68-605245b2ca0e None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:21.099235 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac4788-902c-4074-aa68-605245b2ca0e None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:21.099235 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac4788-902c-4074-aa68-605245b2ca0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:21.188333 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-ceac4788-902c-4074-aa68-605245b2ca0e None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:21.190172 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-ceac4788-902c-4074-aa68-605245b2ca0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:21.345859 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 743/1486] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:46:21.689726 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de066ec8-32e9-4135-8274-61277f08a450 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:21.691285 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-de066ec8-32e9-4135-8274-61277f08a450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:21.878769 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de066ec8-32e9-4135-8274-61277f08a450 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:21.986799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:21.989171 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070b466e-17c8-4ab0-8bb5-37df53645313 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:21.989951 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b466e-17c8-4ab0-8bb5-37df53645313 service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:21.990295 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b466e-17c8-4ab0-8bb5-37df53645313 service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:21.990627 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b466e-17c8-4ab0-8bb5-37df53645313 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:21.993588 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-070b466e-17c8-4ab0-8bb5-37df53645313 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:22.200102 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b466e-17c8-4ab0-8bb5-37df53645313 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:22.202892 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070b466e-17c8-4ab0-8bb5-37df53645313 service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:22.242465 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 744/1487] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:46:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:46:25.095680 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3aff7-a0fe-439f-af7d-50c4d124417b None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:25.096590 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3aff7-a0fe-439f-af7d-50c4d124417b None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:25.096798 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3aff7-a0fe-439f-af7d-50c4d124417b None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:25.099572 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 744/1488] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:46:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:46:25.106898 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf50926-a4e6-4d6b-8899-f5a31c85931b None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:25.107915 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf50926-a4e6-4d6b-8899-f5a31c85931b None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:25.107915 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf50926-a4e6-4d6b-8899-f5a31c85931b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:25.214222 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-6bf50926-a4e6-4d6b-8899-f5a31c85931b None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:25.215590 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-6bf50926-a4e6-4d6b-8899-f5a31c85931b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:25.315839 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:25.385312 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 745/1489] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:46:25.830210 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c3aff7-a0fe-439f-af7d-50c4d124417b None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:25.832115 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-39c3aff7-a0fe-439f-af7d-50c4d124417b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:25.880697 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:25.986657 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c3aff7-a0fe-439f-af7d-50c4d124417b None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:26.094270 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13291cc-f3d4-4ed0-a315-d872c79ec550 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:26.095201 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13291cc-f3d4-4ed0-a315-d872c79ec550 service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:26.095569 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13291cc-f3d4-4ed0-a315-d872c79ec550 service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:26.095939 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13291cc-f3d4-4ed0-a315-d872c79ec550 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:26.098526 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-e13291cc-f3d4-4ed0-a315-d872c79ec550 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:26.205469 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:26.244525 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13291cc-f3d4-4ed0-a315-d872c79ec550 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:26.246847 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13291cc-f3d4-4ed0-a315-d872c79ec550 service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:26.275144 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 745/1490] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:46:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:46:30.262216 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff57c1-9064-41ad-a0e5-274bec3deec6 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:30.262839 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff57c1-9064-41ad-a0e5-274bec3deec6 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:30.262839 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff57c1-9064-41ad-a0e5-274bec3deec6 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:30.264236 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 746/1491] 10.222.0.69 () {54 vars in 927 bytes} [Thu Sep 8 13:46:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:46:30.271472 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5b6c9-7a33-49b2-af31-5955050fdab4 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:30.272287 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5b6c9-7a33-49b2-af31-5955050fdab4 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:30.272287 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e5b6c9-7a33-49b2-af31-5955050fdab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:30.365165 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-20e5b6c9-7a33-49b2-af31-5955050fdab4 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:46:30.366957 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-20e5b6c9-7a33-49b2-af31-5955050fdab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:30.515485 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 746/1492] 10.222.0.69 () {58 vars in 1024 bytes} [Thu Sep 8 13:46:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:46:30.835777 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff57c1-9064-41ad-a0e5-274bec3deec6 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:46:30.838227 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-25ff57c1-9064-41ad-a0e5-274bec3deec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:31.000675 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff57c1-9064-41ad-a0e5-274bec3deec6 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:46:31.153617 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b1fd6-b184-4408-9775-c227657d5593 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:46:31.154787 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b1fd6-b184-4408-9775-c227657d5593 service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:46:31.155248 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b1fd6-b184-4408-9775-c227657d5593 service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:46:31.155721 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b1fd6-b184-4408-9775-c227657d5593 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:46:31.160175 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-e15b1fd6-b184-4408-9775-c227657d5593 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:46:31.181493 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:31.323557 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15b1fd6-b184-4408-9775-c227657d5593 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:46:31.325966 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15b1fd6-b184-4408-9775-c227657d5593 service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:46:31.360814 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 747/1493] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:46:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:46:40.513795 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=82 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:41.355892 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=50 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:09.142643 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf2ec6-0817-4ff6-981a-818bf0f11332 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:09.143560 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf2ec6-0817-4ff6-981a-818bf0f11332 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:09.143560 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf2ec6-0817-4ff6-981a-818bf0f11332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:09.254292 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-18bf2ec6-0817-4ff6-981a-818bf0f11332 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:48:09.255971 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-18bf2ec6-0817-4ff6-981a-818bf0f11332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:48:09.450690 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 747/1494] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:48:09.470489 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31242cc1-fb7f-4844-848a-1f09fe3fd039 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:09.471465 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31242cc1-fb7f-4844-848a-1f09fe3fd039 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:09.471655 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31242cc1-fb7f-4844-848a-1f09fe3fd039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:09.509546 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-31242cc1-fb7f-4844-848a-1f09fe3fd039 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:48:09.511718 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-31242cc1-fb7f-4844-848a-1f09fe3fd039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:48:09.533625 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 748/1495] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:48:09.540960 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf2ec6-0817-4ff6-981a-818bf0f11332 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:09.562259 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf2ec6-0817-4ff6-981a-818bf0f11332 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:09.571220 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c108c-1826-41fd-b66e-cdaaf64f7778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:09.572212 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c108c-1826-41fd-b66e-cdaaf64f7778 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:09.572595 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c108c-1826-41fd-b66e-cdaaf64f7778 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:09.573001 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c108c-1826-41fd-b66e-cdaaf64f7778 admin admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:09.574499 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c108c-1826-41fd-b66e-cdaaf64f7778 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:48:09.574901 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c108c-1826-41fd-b66e-cdaaf64f7778 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:48:09.576825 dv-cinder-856463-2-smb devstack@keystone.service[88208]: WARNING py.warnings [None req-6d8c108c-1826-41fd-b66e-cdaaf64f7778 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 13:48:09.576825 dv-cinder-856463-2-smb devstack@keystone.service[88208]: warnings.warn(msg) Sep 08 13:48:09.576825 dv-cinder-856463-2-smb devstack@keystone.service[88208]: Sep 08 13:48:09.578488 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c108c-1826-41fd-b66e-cdaaf64f7778 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:48:09.602735 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 748/1496] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 13:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:48:09.616261 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31242cc1-fb7f-4844-848a-1f09fe3fd039 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:09.635638 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31242cc1-fb7f-4844-848a-1f09fe3fd039 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:09.643834 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e6ef6-20da-4c57-a2e7-f889b91f7887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:09.644903 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e6ef6-20da-4c57-a2e7-f889b91f7887 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:09.645451 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e6ef6-20da-4c57-a2e7-f889b91f7887 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:09.645938 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e6ef6-20da-4c57-a2e7-f889b91f7887 admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:09.647153 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e6ef6-20da-4c57-a2e7-f889b91f7887 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:48:09.650411 dv-cinder-856463-2-smb devstack@keystone.service[88207]: WARNING py.warnings [None req-5c8e6ef6-20da-4c57-a2e7-f889b91f7887 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 13:48:09.650411 dv-cinder-856463-2-smb devstack@keystone.service[88207]: warnings.warn(msg) Sep 08 13:48:09.650411 dv-cinder-856463-2-smb devstack@keystone.service[88207]: Sep 08 13:48:09.653273 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e6ef6-20da-4c57-a2e7-f889b91f7887 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:48:09.742276 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 749/1497] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:48:09 2022] POST /identity/v3/projects => generated 379 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:48:09.750565 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c108c-1826-41fd-b66e-cdaaf64f7778 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:09.765736 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c108c-1826-41fd-b66e-cdaaf64f7778 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:09.869147 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:09.889448 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1a9ae-6ece-4c0d-a6cc-82e89d296512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:09.890150 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1a9ae-6ece-4c0d-a6cc-82e89d296512 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:09.890478 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1a9ae-6ece-4c0d-a6cc-82e89d296512 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:09.890801 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1a9ae-6ece-4c0d-a6cc-82e89d296512 admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:09.891512 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c1a9ae-6ece-4c0d-a6cc-82e89d296512 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:48:09.893978 dv-cinder-856463-2-smb devstack@keystone.service[88208]: WARNING py.warnings [None req-f2c1a9ae-6ece-4c0d-a6cc-82e89d296512 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 13:48:09.893978 dv-cinder-856463-2-smb devstack@keystone.service[88208]: warnings.warn(msg) Sep 08 13:48:09.893978 dv-cinder-856463-2-smb devstack@keystone.service[88208]: Sep 08 13:48:09.896084 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c1a9ae-6ece-4c0d-a6cc-82e89d296512 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:48:09.942115 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 749/1498] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:48:09 2022] POST /identity/v3/users => generated 290 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:48:09.947440 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e6ef6-20da-4c57-a2e7-f889b91f7887 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:09.960315 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e6ef6-20da-4c57-a2e7-f889b91f7887 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:09.966879 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f3a4e-ff58-4bdc-b60e-bd28fc7ca8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:09.967797 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f3a4e-ff58-4bdc-b60e-bd28fc7ca8b1 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:09.968271 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f3a4e-ff58-4bdc-b60e-bd28fc7ca8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:09.968721 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f3a4e-ff58-4bdc-b60e-bd28fc7ca8b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:09.970027 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f3a4e-ff58-4bdc-b60e-bd28fc7ca8b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:48:09.971463 dv-cinder-856463-2-smb devstack@keystone.service[88207]: WARNING py.warnings [None req-923f3a4e-ff58-4bdc-b60e-bd28fc7ca8b1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 13:48:09.971463 dv-cinder-856463-2-smb devstack@keystone.service[88207]: warnings.warn(msg) Sep 08 13:48:09.971463 dv-cinder-856463-2-smb devstack@keystone.service[88207]: Sep 08 13:48:09.973311 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f3a4e-ff58-4bdc-b60e-bd28fc7ca8b1 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:48:09.994719 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 750/1499] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:48:10.006934 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1a9ae-6ece-4c0d-a6cc-82e89d296512 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:10.024413 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1a9ae-6ece-4c0d-a6cc-82e89d296512 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:10.032604 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d3589-ed29-418e-9cbc-7bd299a91057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:10.033768 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d3589-ed29-418e-9cbc-7bd299a91057 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:10.034276 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d3589-ed29-418e-9cbc-7bd299a91057 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:10.034734 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d3589-ed29-418e-9cbc-7bd299a91057 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:10.035940 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d3589-ed29-418e-9cbc-7bd299a91057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:48:10.037867 dv-cinder-856463-2-smb devstack@keystone.service[88208]: WARNING py.warnings [None req-563d3589-ed29-418e-9cbc-7bd299a91057 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 13:48:10.037867 dv-cinder-856463-2-smb devstack@keystone.service[88208]: warnings.warn(msg) Sep 08 13:48:10.037867 dv-cinder-856463-2-smb devstack@keystone.service[88208]: Sep 08 13:48:10.039523 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d3589-ed29-418e-9cbc-7bd299a91057 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:48:10.065203 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 750/1500] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:48:10.071950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f3a4e-ff58-4bdc-b60e-bd28fc7ca8b1 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:10.087742 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f3a4e-ff58-4bdc-b60e-bd28fc7ca8b1 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:10.093186 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f38c6-7132-471a-ad8d-6eeb78ef56cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:10.093918 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f38c6-7132-471a-ad8d-6eeb78ef56cf admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:10.094202 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f38c6-7132-471a-ad8d-6eeb78ef56cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:10.094471 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f38c6-7132-471a-ad8d-6eeb78ef56cf admin admin] PATH_INFO: `/v3/projects/49fa0ffa52c24baa8db8e24bd3af4a46/users/94d3746c4bf548378f4b932e497a5eb4/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:10.122678 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f38c6-7132-471a-ad8d-6eeb78ef56cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=49fa0ffa52c24baa8db8e24bd3af4a46, user_id=94d3746c4bf548378f4b932e497a5eb4, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:48:10.123991 dv-cinder-856463-2-smb devstack@keystone.service[88207]: WARNING py.warnings [None req-a96f38c6-7132-471a-ad8d-6eeb78ef56cf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 13:48:10.123991 dv-cinder-856463-2-smb devstack@keystone.service[88207]: warnings.warn(msg) Sep 08 13:48:10.123991 dv-cinder-856463-2-smb devstack@keystone.service[88207]: Sep 08 13:48:10.126263 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f38c6-7132-471a-ad8d-6eeb78ef56cf admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:48:10.145557 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 751/1501] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:48:10 2022] PUT /identity/v3/projects/49fa0ffa52c24baa8db8e24bd3af4a46/users/94d3746c4bf548378f4b932e497a5eb4/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:48:10.162243 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf90e4-8396-44bf-bce9-097d1b8ba4c0 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:10.163106 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf90e4-8396-44bf-bce9-097d1b8ba4c0 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:10.163106 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf90e4-8396-44bf-bce9-097d1b8ba4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:10.203269 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-76cf90e4-8396-44bf-bce9-097d1b8ba4c0 None None] MFA Rules not processed for user `94d3746c4bf548378f4b932e497a5eb4`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:48:10.204648 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-76cf90e4-8396-44bf-bce9-097d1b8ba4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:48:10.319609 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 751/1502] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:48:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:48:10.342328 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33422b4-ae48-4d8c-8cd3-c21b700d7e04 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:10.342673 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33422b4-ae48-4d8c-8cd3-c21b700d7e04 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:10.343058 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33422b4-ae48-4d8c-8cd3-c21b700d7e04 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:10.344859 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 752/1503] 10.222.0.69 () {54 vars in 964 bytes} [Thu Sep 8 13:48:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:48:10.353787 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6588d5-312f-4d48-b476-33d3a9d868e1 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:10.354574 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6588d5-312f-4d48-b476-33d3a9d868e1 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:10.355282 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6588d5-312f-4d48-b476-33d3a9d868e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:10.439370 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-5d6588d5-312f-4d48-b476-33d3a9d868e1 None None] MFA Rules not processed for user `d311099f51484141bd8504184b818ee8`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:48:10.441326 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-5d6588d5-312f-4d48-b476-33d3a9d868e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:48:10.582105 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 752/1504] 10.222.0.69 () {58 vars in 1061 bytes} [Thu Sep 8 13:48:10 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:48:10.597625 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33422b4-ae48-4d8c-8cd3-c21b700d7e04 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:10.617798 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33422b4-ae48-4d8c-8cd3-c21b700d7e04 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:10.623007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff12a0-5151-4f49-9f18-cb6b705d4851 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:10.623863 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff12a0-5151-4f49-9f18-cb6b705d4851 service cinder] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:10.624372 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff12a0-5151-4f49-9f18-cb6b705d4851 service cinder] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:10.624751 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff12a0-5151-4f49-9f18-cb6b705d4851 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:10.640499 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff12a0-5151-4f49-9f18-cb6b705d4851 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:48:10.643136 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff12a0-5151-4f49-9f18-cb6b705d4851 service cinder] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:48:10.658321 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 753/1505] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:48:10 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:48:10.736647 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b7502-8510-46b6-8e9f-18340ee371d5 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:10.737097 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b7502-8510-46b6-8e9f-18340ee371d5 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:10.737866 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b7502-8510-46b6-8e9f-18340ee371d5 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:10.740565 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 753/1506] 10.222.0.69 () {52 vars in 830 bytes} [Thu Sep 8 13:48:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:48:10.747644 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff12a0-5151-4f49-9f18-cb6b705d4851 service cinder] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:10.862364 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff12a0-5151-4f49-9f18-cb6b705d4851 service cinder] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:10.870440 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0d70b5-14e9-4c46-adbc-bc87a0aa0f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:10.871869 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d70b5-14e9-4c46-adbc-bc87a0aa0f11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:10.873101 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d70b5-14e9-4c46-adbc-bc87a0aa0f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:10.873616 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d70b5-14e9-4c46-adbc-bc87a0aa0f11 admin admin] PATH_INFO: `/v3/users/94d3746c4bf548378f4b932e497a5eb4` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:10.875352 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0d70b5-14e9-4c46-adbc-bc87a0aa0f11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94d3746c4bf548378f4b932e497a5eb4)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:48:10.876446 dv-cinder-856463-2-smb devstack@keystone.service[88207]: WARNING py.warnings [None req-5b0d70b5-14e9-4c46-adbc-bc87a0aa0f11 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 13:48:10.876446 dv-cinder-856463-2-smb devstack@keystone.service[88207]: warnings.warn(msg) Sep 08 13:48:10.876446 dv-cinder-856463-2-smb devstack@keystone.service[88207]: Sep 08 13:48:10.877966 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0d70b5-14e9-4c46-adbc-bc87a0aa0f11 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:48:11.025736 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-5b0d70b5-14e9-4c46-adbc-bc87a0aa0f11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94d3746c4bf548378f4b932e497a5eb4'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:48:11.026863 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-5b0d70b5-14e9-4c46-adbc-bc87a0aa0f11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94d3746c4bf548378f4b932e497a5eb4'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:48:11.028806 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-5b0d70b5-14e9-4c46-adbc-bc87a0aa0f11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94d3746c4bf548378f4b932e497a5eb4'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:48:11.056043 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-5b0d70b5-14e9-4c46-adbc-bc87a0aa0f11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94d3746c4bf548378f4b932e497a5eb4'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:48:11.101623 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-5b0d70b5-14e9-4c46-adbc-bc87a0aa0f11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94d3746c4bf548378f4b932e497a5eb4'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:48:11.111089 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:11.131262 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 754/1507] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:48:10 2022] DELETE /identity/v3/users/94d3746c4bf548378f4b932e497a5eb4 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:48:11.136694 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12fe98-006c-4b97-92fb-8ce986ffa1d1 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:11.137711 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12fe98-006c-4b97-92fb-8ce986ffa1d1 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:11.138151 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12fe98-006c-4b97-92fb-8ce986ffa1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:11.168641 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-0b12fe98-006c-4b97-92fb-8ce986ffa1d1 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:48:11.170175 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-0b12fe98-006c-4b97-92fb-8ce986ffa1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:48:11.185003 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:11.284882 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 754/1508] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:48:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:48:11.301075 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0d70b5-14e9-4c46-adbc-bc87a0aa0f11 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:11.303547 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-5b0d70b5-14e9-4c46-adbc-bc87a0aa0f11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:48:11.452546 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0d70b5-14e9-4c46-adbc-bc87a0aa0f11 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:11.457748 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff2dc1-c347-4b8d-a63b-dee0e952e125 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:11.458392 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff2dc1-c347-4b8d-a63b-dee0e952e125 service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:11.458808 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff2dc1-c347-4b8d-a63b-dee0e952e125 service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:11.459089 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff2dc1-c347-4b8d-a63b-dee0e952e125 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:11.472740 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff2dc1-c347-4b8d-a63b-dee0e952e125 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:48:11.476192 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff2dc1-c347-4b8d-a63b-dee0e952e125 service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:48:11.494613 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 755/1509] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:48:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:48:12.195183 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b12fe98-006c-4b97-92fb-8ce986ffa1d1 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:48:12.198034 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-0b12fe98-006c-4b97-92fb-8ce986ffa1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:48:12.218458 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b12fe98-006c-4b97-92fb-8ce986ffa1d1 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:48:12.227034 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420352d4-5029-4cc6-b37f-989a7081205c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:48:12.228034 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420352d4-5029-4cc6-b37f-989a7081205c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:48:12.228500 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420352d4-5029-4cc6-b37f-989a7081205c admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:48:12.229405 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420352d4-5029-4cc6-b37f-989a7081205c admin admin] PATH_INFO: `/v3/projects/49fa0ffa52c24baa8db8e24bd3af4a46` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:48:12.231864 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420352d4-5029-4cc6-b37f-989a7081205c admin admin] RBAC: Authorizing `identity:delete_project(project_id=49fa0ffa52c24baa8db8e24bd3af4a46)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:48:12.233467 dv-cinder-856463-2-smb devstack@keystone.service[88208]: WARNING py.warnings [None req-420352d4-5029-4cc6-b37f-989a7081205c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 13:48:12.233467 dv-cinder-856463-2-smb devstack@keystone.service[88208]: warnings.warn(msg) Sep 08 13:48:12.233467 dv-cinder-856463-2-smb devstack@keystone.service[88208]: Sep 08 13:48:12.235955 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420352d4-5029-4cc6-b37f-989a7081205c admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:48:12.349713 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-420352d4-5029-4cc6-b37f-989a7081205c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49fa0ffa52c24baa8db8e24bd3af4a46', 'request_id': 'req-420352d4-5029-4cc6-b37f-989a7081205c'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:48:12.374050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-420352d4-5029-4cc6-b37f-989a7081205c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49fa0ffa52c24baa8db8e24bd3af4a46', 'request_id': 'req-420352d4-5029-4cc6-b37f-989a7081205c'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:48:12.396084 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-420352d4-5029-4cc6-b37f-989a7081205c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49fa0ffa52c24baa8db8e24bd3af4a46', 'request_id': 'req-420352d4-5029-4cc6-b37f-989a7081205c'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:48:12.424172 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-420352d4-5029-4cc6-b37f-989a7081205c admin admin] The token cache is being invalidate because project 49fa0ffa52c24baa8db8e24bd3af4a46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:48:12.424623 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-420352d4-5029-4cc6-b37f-989a7081205c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:48:12.425717 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-420352d4-5029-4cc6-b37f-989a7081205c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:48:12.427958 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 755/1510] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:48:12 2022] DELETE /identity/v3/projects/49fa0ffa52c24baa8db8e24bd3af4a46 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:48:21.488528 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:DELETE=1,keystone:SELECT=37 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:22.419157 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:49:59.618112 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adda117-a566-4da5-88fa-2dc74f029977 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:49:59.620295 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adda117-a566-4da5-88fa-2dc74f029977 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:49:59.620295 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adda117-a566-4da5-88fa-2dc74f029977 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:49:59.622385 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 756/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 13:49:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:49:59.631331 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66ee4e-6374-4191-98db-10600e93fe74 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:49:59.632245 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66ee4e-6374-4191-98db-10600e93fe74 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:49:59.632575 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c66ee4e-6374-4191-98db-10600e93fe74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:49:59.658501 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-3c66ee4e-6374-4191-98db-10600e93fe74 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:49:59.660685 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-3c66ee4e-6374-4191-98db-10600e93fe74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:49:59.779222 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 756/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 13:49:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:50:00.011717 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adda117-a566-4da5-88fa-2dc74f029977 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:00.014810 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-3adda117-a566-4da5-88fa-2dc74f029977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:50:00.078449 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546f980-1478-47a6-b76b-a2505568f08b None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:00.078801 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546f980-1478-47a6-b76b-a2505568f08b None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:00.079212 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546f980-1478-47a6-b76b-a2505568f08b None None] PATH_INFO: `/v3` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:00.082533 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 757/1513] 10.222.0.112 () {54 vars in 926 bytes} [Thu Sep 8 13:50:00 2022] GET /identity/v3 => generated 255 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:50:00.090435 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942b3f6-4b3c-4a04-a63e-effd271a3ee5 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:00.090769 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942b3f6-4b3c-4a04-a63e-effd271a3ee5 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:00.093202 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942b3f6-4b3c-4a04-a63e-effd271a3ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:00.179410 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-5942b3f6-4b3c-4a04-a63e-effd271a3ee5 None None] MFA Rules not processed for user `733797f12a1741e1a55332991e867aab`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:50:00.181229 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-5942b3f6-4b3c-4a04-a63e-effd271a3ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:50:00.223516 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adda117-a566-4da5-88fa-2dc74f029977 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:00.234073 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525dfd48-7545-49d2-afc4-ed1cfb573e75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:00.235101 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525dfd48-7545-49d2-afc4-ed1cfb573e75 service nova] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:00.235560 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525dfd48-7545-49d2-afc4-ed1cfb573e75 service nova] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:00.236342 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525dfd48-7545-49d2-afc4-ed1cfb573e75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:00.255608 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525dfd48-7545-49d2-afc4-ed1cfb573e75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:00.259365 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525dfd48-7545-49d2-afc4-ed1cfb573e75 service nova] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:00.284040 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 757/1514] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:50:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:50:00.343739 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 758/1515] 10.222.0.112 () {58 vars in 1016 bytes} [Thu Sep 8 13:50:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:50:01.678382 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965e7a1-85ef-408f-9109-7a1171bdf3c9 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:01.678942 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965e7a1-85ef-408f-9109-7a1171bdf3c9 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:01.678942 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965e7a1-85ef-408f-9109-7a1171bdf3c9 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:01.680508 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 758/1516] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 13:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:50:01.689338 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5a0cc-3a1c-4fda-b14f-f3938fd30098 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:01.690216 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5a0cc-3a1c-4fda-b14f-f3938fd30098 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:01.690395 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5a0cc-3a1c-4fda-b14f-f3938fd30098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:01.721195 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-ebc5a0cc-3a1c-4fda-b14f-f3938fd30098 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:50:01.722599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-ebc5a0cc-3a1c-4fda-b14f-f3938fd30098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:50:01.731426 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 759/1517] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 13:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:50:01.910670 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965e7a1-85ef-408f-9109-7a1171bdf3c9 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:01.936316 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965e7a1-85ef-408f-9109-7a1171bdf3c9 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:01.944139 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d393c3-d639-4574-8e85-6223efa1e3dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:01.945175 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d393c3-d639-4574-8e85-6223efa1e3dc service nova] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:01.945708 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d393c3-d639-4574-8e85-6223efa1e3dc service nova] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:01.946617 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d393c3-d639-4574-8e85-6223efa1e3dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:01.961174 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d393c3-d639-4574-8e85-6223efa1e3dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:01.964152 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d393c3-d639-4574-8e85-6223efa1e3dc service nova] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:01.985312 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 759/1518] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:50:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:50:09.817334 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34a411-30b4-4c00-8892-10471bc9fcb5 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:09.817982 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34a411-30b4-4c00-8892-10471bc9fcb5 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:09.818188 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34a411-30b4-4c00-8892-10471bc9fcb5 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:09.820028 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 760/1519] 10.222.0.69 () {54 vars in 961 bytes} [Thu Sep 8 13:50:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:50:09.826979 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b25c3d-3694-403a-9f28-441e3767f80b None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:09.827913 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b25c3d-3694-403a-9f28-441e3767f80b None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:09.827913 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b25c3d-3694-403a-9f28-441e3767f80b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:09.859032 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-83b25c3d-3694-403a-9f28-441e3767f80b None None] MFA Rules not processed for user `733797f12a1741e1a55332991e867aab`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:50:09.861080 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-83b25c3d-3694-403a-9f28-441e3767f80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:50:09.873203 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 760/1520] 10.222.0.69 () {58 vars in 1058 bytes} [Thu Sep 8 13:50:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:50:09.882231 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34a411-30b4-4c00-8892-10471bc9fcb5 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:09.907993 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34a411-30b4-4c00-8892-10471bc9fcb5 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:09.916672 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a90fb2-6efb-43b4-969d-29d34bd27da7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733797f12a1741e1a55332991e867aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:09.917935 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a90fb2-6efb-43b4-969d-29d34bd27da7 service placement] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:09.918396 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a90fb2-6efb-43b4-969d-29d34bd27da7 service placement] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:09.918844 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a90fb2-6efb-43b4-969d-29d34bd27da7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:09.932745 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a90fb2-6efb-43b4-969d-29d34bd27da7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:09.935932 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a90fb2-6efb-43b4-969d-29d34bd27da7 service placement] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:09.949828 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 761/1521] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:50:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:50:14.004949 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d01aee-76b0-40fb-b75e-8a612a59b568 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:14.005714 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d01aee-76b0-40fb-b75e-8a612a59b568 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:14.005714 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d01aee-76b0-40fb-b75e-8a612a59b568 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:14.007430 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 761/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 13:50:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:50:14.017505 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd62404-bf0b-4a68-aaf8-5fe14152aa99 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:14.018385 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd62404-bf0b-4a68-aaf8-5fe14152aa99 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:14.018588 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd62404-bf0b-4a68-aaf8-5fe14152aa99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:14.045348 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-abd62404-bf0b-4a68-aaf8-5fe14152aa99 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:50:14.046866 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-abd62404-bf0b-4a68-aaf8-5fe14152aa99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:50:14.057067 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 762/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 13:50:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:50:14.271284 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d01aee-76b0-40fb-b75e-8a612a59b568 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:14.297020 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d01aee-76b0-40fb-b75e-8a612a59b568 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:14.306610 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a209621-a50e-4ad7-9044-1942473022d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:14.307334 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a209621-a50e-4ad7-9044-1942473022d6 service nova] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:14.307801 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a209621-a50e-4ad7-9044-1942473022d6 service nova] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:14.308244 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a209621-a50e-4ad7-9044-1942473022d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:14.323895 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a209621-a50e-4ad7-9044-1942473022d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:14.326438 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a209621-a50e-4ad7-9044-1942473022d6 service nova] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:14.347443 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 762/1524] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:50:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:50:16.002435 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26bc33-c445-4636-a26f-10b765df8fb4 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:16.003443 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26bc33-c445-4636-a26f-10b765df8fb4 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:16.003443 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26bc33-c445-4636-a26f-10b765df8fb4 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:16.005266 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 763/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 8 13:50:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:50:16.016211 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114c5bf-81bc-4256-9fab-f93114840564 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:16.017099 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114c5bf-81bc-4256-9fab-f93114840564 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:16.017099 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6114c5bf-81bc-4256-9fab-f93114840564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:16.041384 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-6114c5bf-81bc-4256-9fab-f93114840564 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:50:16.042801 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-6114c5bf-81bc-4256-9fab-f93114840564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:50:16.052096 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 763/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 8 13:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:50:16.224733 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26bc33-c445-4636-a26f-10b765df8fb4 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:16.243988 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26bc33-c445-4636-a26f-10b765df8fb4 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:16.254071 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e37ff6-f3e5-4ace-ac85-083950d3bd4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:16.255148 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e37ff6-f3e5-4ace-ac85-083950d3bd4c service nova] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:16.255634 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e37ff6-f3e5-4ace-ac85-083950d3bd4c service nova] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:16.256116 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e37ff6-f3e5-4ace-ac85-083950d3bd4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:16.274594 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e37ff6-f3e5-4ace-ac85-083950d3bd4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:16.277796 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e37ff6-f3e5-4ace-ac85-083950d3bd4c service nova] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:16.297342 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 764/1527] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:50:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:50:20.882287 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1282283-588e-4f52-89f0-6f4ec0e966b0 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:20.882957 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1282283-588e-4f52-89f0-6f4ec0e966b0 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:20.884114 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1282283-588e-4f52-89f0-6f4ec0e966b0 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:20.886561 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 764/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 13:50:20 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:50:20.893393 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47661c-ad12-404c-b15c-9895981803a2 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:20.894016 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47661c-ad12-404c-b15c-9895981803a2 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:20.894016 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47661c-ad12-404c-b15c-9895981803a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:20.917729 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-fc47661c-ad12-404c-b15c-9895981803a2 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:50:20.919000 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-fc47661c-ad12-404c-b15c-9895981803a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:50:20.927621 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 765/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 13:50:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:50:21.231698 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1282283-588e-4f52-89f0-6f4ec0e966b0 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:21.233837 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-e1282283-588e-4f52-89f0-6f4ec0e966b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:50:21.328001 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1282283-588e-4f52-89f0-6f4ec0e966b0 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:21.340034 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049f2be-e4c7-4751-8eb2-bbb88f7c6d88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:21.340742 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049f2be-e4c7-4751-8eb2-bbb88f7c6d88 service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:21.341204 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049f2be-e4c7-4751-8eb2-bbb88f7c6d88 service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:21.341736 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049f2be-e4c7-4751-8eb2-bbb88f7c6d88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:21.356830 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3049f2be-e4c7-4751-8eb2-bbb88f7c6d88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:21.358304 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3049f2be-e4c7-4751-8eb2-bbb88f7c6d88 service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:21.370439 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 765/1530] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:50:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:50:24.377046 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321830d-786c-4119-b197-60724747d761 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:24.377741 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321830d-786c-4119-b197-60724747d761 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:24.377741 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321830d-786c-4119-b197-60724747d761 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:24.379377 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 766/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 13:50:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:50:24.388327 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ac59f-5917-4108-ae80-f19721ffeba2 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:24.389082 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ac59f-5917-4108-ae80-f19721ffeba2 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:24.389082 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ac59f-5917-4108-ae80-f19721ffeba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:24.399915 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=91 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:24.421889 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-7d2ac59f-5917-4108-ae80-f19721ffeba2 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:50:24.424322 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-7d2ac59f-5917-4108-ae80-f19721ffeba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:50:24.437027 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 766/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 13:50:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:50:24.948023 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321830d-786c-4119-b197-60724747d761 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:24.955289 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=93 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:24.965695 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321830d-786c-4119-b197-60724747d761 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:24.972186 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8a1791-5541-4e81-8126-77a6dbfc9c86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:24.973548 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a1791-5541-4e81-8126-77a6dbfc9c86 service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:24.974068 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a1791-5541-4e81-8126-77a6dbfc9c86 service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:24.974553 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a1791-5541-4e81-8126-77a6dbfc9c86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:24.996523 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8a1791-5541-4e81-8126-77a6dbfc9c86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:25.001429 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8a1791-5541-4e81-8126-77a6dbfc9c86 service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:25.020611 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 767/1533] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:50:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:50:30.549654 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad40a8e-68f1-4fce-b395-ca80f23d8c6f None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:30.550431 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad40a8e-68f1-4fce-b395-ca80f23d8c6f None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:30.550431 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad40a8e-68f1-4fce-b395-ca80f23d8c6f None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:30.552860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 767/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 13:50:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:50:30.561689 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd83e5-be12-4ac0-b28f-d1792855b669 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:30.566154 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd83e5-be12-4ac0-b28f-d1792855b669 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:30.566154 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd83e5-be12-4ac0-b28f-d1792855b669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:30.596073 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-d7cd83e5-be12-4ac0-b28f-d1792855b669 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:50:30.598542 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-d7cd83e5-be12-4ac0-b28f-d1792855b669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:50:30.613790 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 768/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 13:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:50:31.117012 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad40a8e-68f1-4fce-b395-ca80f23d8c6f None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:31.119655 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-dad40a8e-68f1-4fce-b395-ca80f23d8c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:50:31.235962 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad40a8e-68f1-4fce-b395-ca80f23d8c6f None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:31.243282 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc9e07b-69f8-4533-b303-0456e45997b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:31.244641 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9e07b-69f8-4533-b303-0456e45997b2 service cinder] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:31.245155 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9e07b-69f8-4533-b303-0456e45997b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:31.245674 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9e07b-69f8-4533-b303-0456e45997b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:31.273744 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc9e07b-69f8-4533-b303-0456e45997b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:31.276601 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc9e07b-69f8-4533-b303-0456e45997b2 service cinder] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:31.297910 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 768/1536] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:50:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:50:34.764770 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e423f-cba8-4bd6-b5b6-4a0393ee0272 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:34.765622 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e423f-cba8-4bd6-b5b6-4a0393ee0272 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:34.765622 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e423f-cba8-4bd6-b5b6-4a0393ee0272 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:34.767044 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 769/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 8 13:50:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:50:34.775725 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3b974-fa6e-49c9-b5f1-849f0e747a38 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:34.776609 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3b974-fa6e-49c9-b5f1-849f0e747a38 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:34.776609 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3b974-fa6e-49c9-b5f1-849f0e747a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:34.809969 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-bbf3b974-fa6e-49c9-b5f1-849f0e747a38 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:50:34.812240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-bbf3b974-fa6e-49c9-b5f1-849f0e747a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:50:34.832281 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 769/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 8 13:50:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:50:35.303181 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e423f-cba8-4bd6-b5b6-4a0393ee0272 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:50:35.306850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-465e423f-cba8-4bd6-b5b6-4a0393ee0272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:50:35.326649 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e423f-cba8-4bd6-b5b6-4a0393ee0272 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:50:35.332791 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb816f-e12e-4081-b03d-43956c05bf7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:50:35.333828 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb816f-e12e-4081-b03d-43956c05bf7e service cinder] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:50:35.334273 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb816f-e12e-4081-b03d-43956c05bf7e service cinder] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:50:35.334736 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb816f-e12e-4081-b03d-43956c05bf7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:50:35.348973 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bb816f-e12e-4081-b03d-43956c05bf7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:50:35.350691 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bb816f-e12e-4081-b03d-43956c05bf7e service cinder] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:50:35.372878 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 770/1539] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:50:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:50:44.801184 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=31 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:45.357968 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=14 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:22.057938 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9a3d8-e8b1-4e8e-b25f-ded4ead140a5 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:22.058843 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9a3d8-e8b1-4e8e-b25f-ded4ead140a5 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:22.058843 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9a3d8-e8b1-4e8e-b25f-ded4ead140a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:22.110870 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-46c9a3d8-e8b1-4e8e-b25f-ded4ead140a5 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:22.112608 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-46c9a3d8-e8b1-4e8e-b25f-ded4ead140a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:22.129431 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 770/1540] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:52:22.141772 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b7467-8600-49e9-910c-19c5598cc553 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:22.142701 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b7467-8600-49e9-910c-19c5598cc553 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:22.142701 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b7467-8600-49e9-910c-19c5598cc553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:22.194041 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-7f8b7467-8600-49e9-910c-19c5598cc553 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:22.196181 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-7f8b7467-8600-49e9-910c-19c5598cc553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:22.200673 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f0922-aff3-4b50-b25c-898b86af3f7a None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:22.201149 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f0922-aff3-4b50-b25c-898b86af3f7a None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:22.201657 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f0922-aff3-4b50-b25c-898b86af3f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:22.223018 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 771/1541] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:52:22.231163 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b7467-8600-49e9-910c-19c5598cc553 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:22.269841 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b7467-8600-49e9-910c-19c5598cc553 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:22.294596 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-a22f0922-aff3-4b50-b25c-898b86af3f7a None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:22.300429 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-a22f0922-aff3-4b50-b25c-898b86af3f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:22.306186 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52696f4-24c2-40ad-9873-591a3679958d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:22.307223 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52696f4-24c2-40ad-9873-591a3679958d admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:22.307719 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52696f4-24c2-40ad-9873-591a3679958d admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:22.309143 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52696f4-24c2-40ad-9873-591a3679958d admin admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:22.310449 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52696f4-24c2-40ad-9873-591a3679958d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:52:22.310990 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52696f4-24c2-40ad-9873-591a3679958d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:22.314145 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52696f4-24c2-40ad-9873-591a3679958d admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:22.353607 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 771/1542] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:52:22.371171 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 772/1543] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 13:52:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:52:22.381944 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8165810-2d8e-41b4-b0f1-9c411e6c0df8 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:22.382403 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8165810-2d8e-41b4-b0f1-9c411e6c0df8 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:22.383136 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8165810-2d8e-41b4-b0f1-9c411e6c0df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:22.385761 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52696f4-24c2-40ad-9873-591a3679958d admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:22.415143 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52696f4-24c2-40ad-9873-591a3679958d admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:22.427218 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b77c70-0ed2-41b3-b2a0-96798680b9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:22.428748 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b77c70-0ed2-41b3-b2a0-96798680b9ee admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:22.429914 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b77c70-0ed2-41b3-b2a0-96798680b9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:22.430751 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b77c70-0ed2-41b3-b2a0-96798680b9ee admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:22.432258 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b77c70-0ed2-41b3-b2a0-96798680b9ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:22.435227 dv-cinder-856463-2-smb devstack@keystone.service[88208]: WARNING py.warnings [None req-61b77c70-0ed2-41b3-b2a0-96798680b9ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 13:52:22.435227 dv-cinder-856463-2-smb devstack@keystone.service[88208]: warnings.warn(msg) Sep 08 13:52:22.435227 dv-cinder-856463-2-smb devstack@keystone.service[88208]: Sep 08 13:52:22.437917 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b77c70-0ed2-41b3-b2a0-96798680b9ee admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:22.439144 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-f8165810-2d8e-41b4-b0f1-9c411e6c0df8 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:22.441172 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-f8165810-2d8e-41b4-b0f1-9c411e6c0df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:22.469410 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 772/1544] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:52:22.475927 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da65a4c-ea70-46ba-9bd7-c4c3204c8601 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:22.476462 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da65a4c-ea70-46ba-9bd7-c4c3204c8601 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:22.476933 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da65a4c-ea70-46ba-9bd7-c4c3204c8601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:22.528436 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 773/1545] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:52:22 2022] POST /identity/v3/projects => generated 383 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:52:22.530984 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b77c70-0ed2-41b3-b2a0-96798680b9ee admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:22.536786 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-0da65a4c-ea70-46ba-9bd7-c4c3204c8601 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:22.539091 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-0da65a4c-ea70-46ba-9bd7-c4c3204c8601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:22.677457 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b77c70-0ed2-41b3-b2a0-96798680b9ee admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:22.684109 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 773/1546] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:52:22.685989 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83a388-deed-436b-82ae-8f6c58df4c23 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:22.686555 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83a388-deed-436b-82ae-8f6c58df4c23 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:22.687446 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83a388-deed-436b-82ae-8f6c58df4c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:22.689410 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0bfcbd-99e9-4091-b332-4f8ae5fb95c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:22.690795 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bfcbd-99e9-4091-b332-4f8ae5fb95c1 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:22.691539 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bfcbd-99e9-4091-b332-4f8ae5fb95c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:22.693746 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0bfcbd-99e9-4091-b332-4f8ae5fb95c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:22.695276 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0bfcbd-99e9-4091-b332-4f8ae5fb95c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:52:22.696098 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0bfcbd-99e9-4091-b332-4f8ae5fb95c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:22.699926 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0bfcbd-99e9-4091-b332-4f8ae5fb95c1 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:22.727997 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-bc83a388-deed-436b-82ae-8f6c58df4c23 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:22.728281 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 774/1547] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 13:52:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:52:22.728281 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0bfcbd-99e9-4091-b332-4f8ae5fb95c1 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:22.728591 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-bc83a388-deed-436b-82ae-8f6c58df4c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:22.744842 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 774/1548] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:52:22.747410 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d99ccf0-e225-4bfe-890d-ea56d20a17b4 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:22.747722 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d99ccf0-e225-4bfe-890d-ea56d20a17b4 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:22.749409 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d99ccf0-e225-4bfe-890d-ea56d20a17b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:22.749690 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0bfcbd-99e9-4091-b332-4f8ae5fb95c1 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:22.758357 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875b6af-bdb5-4abf-8d62-4323d1697832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:22.759584 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875b6af-bdb5-4abf-8d62-4323d1697832 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:22.760194 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875b6af-bdb5-4abf-8d62-4323d1697832 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:22.760810 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875b6af-bdb5-4abf-8d62-4323d1697832 admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:22.762327 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5875b6af-bdb5-4abf-8d62-4323d1697832 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:22.766164 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5875b6af-bdb5-4abf-8d62-4323d1697832 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:22.784087 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-6d99ccf0-e225-4bfe-890d-ea56d20a17b4 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:22.787128 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-6d99ccf0-e225-4bfe-890d-ea56d20a17b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:22.800088 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 775/1549] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:52:22 2022] POST /identity/v3/users => generated 292 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:52:22.801433 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd36e6b-ee10-4d87-bfa9-0f6bdbf7c96d None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:22.802421 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd36e6b-ee10-4d87-bfa9-0f6bdbf7c96d None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:22.802802 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd36e6b-ee10-4d87-bfa9-0f6bdbf7c96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:22.808096 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 775/1550] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:52:22.810141 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d70101-b400-4314-b4e6-5239c1c9d78a None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:22.810586 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d70101-b400-4314-b4e6-5239c1c9d78a None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:22.811000 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d70101-b400-4314-b4e6-5239c1c9d78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:22.832575 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-1dd36e6b-ee10-4d87-bfa9-0f6bdbf7c96d None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:22.834602 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-1dd36e6b-ee10-4d87-bfa9-0f6bdbf7c96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:22.845702 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-b7d70101-b400-4314-b4e6-5239c1c9d78a None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:22.847741 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-b7d70101-b400-4314-b4e6-5239c1c9d78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:22.849344 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 776/1551] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:52:22.850502 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736cf4e-1e98-4f38-a58e-d6d0185cf9f8 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:22.851379 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736cf4e-1e98-4f38-a58e-d6d0185cf9f8 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:22.851863 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736cf4e-1e98-4f38-a58e-d6d0185cf9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:22.866921 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 776/1552] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:52:22.875664 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d70101-b400-4314-b4e6-5239c1c9d78a None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:22.888317 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-3736cf4e-1e98-4f38-a58e-d6d0185cf9f8 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:22.890475 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-3736cf4e-1e98-4f38-a58e-d6d0185cf9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:22.893187 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d70101-b400-4314-b4e6-5239c1c9d78a None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:22.899571 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa1889a-ee2e-4eba-ac0b-f7e9d32b58f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:22.900915 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1889a-ee2e-4eba-ac0b-f7e9d32b58f2 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:22.901426 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1889a-ee2e-4eba-ac0b-f7e9d32b58f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:22.901895 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa1889a-ee2e-4eba-ac0b-f7e9d32b58f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:22.903007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa1889a-ee2e-4eba-ac0b-f7e9d32b58f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:22.905761 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa1889a-ee2e-4eba-ac0b-f7e9d32b58f2 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:22.909197 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 777/1553] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:52:22.911272 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301471b0-0cca-445d-9176-5f891b3d1211 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:22.911765 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301471b0-0cca-445d-9176-5f891b3d1211 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:22.912262 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301471b0-0cca-445d-9176-5f891b3d1211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:22.950255 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-301471b0-0cca-445d-9176-5f891b3d1211 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:22.952442 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-301471b0-0cca-445d-9176-5f891b3d1211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:22.964723 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 777/1554] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:52:22 2022] POST /identity/v3/projects => generated 377 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:52:22.964723 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa1889a-ee2e-4eba-ac0b-f7e9d32b58f2 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:22.971157 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 778/1555] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:52:22.971157 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfeb2a-c4f2-451a-ae71-72b06f05b868 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:22.971157 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfeb2a-c4f2-451a-ae71-72b06f05b868 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:22.971157 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfeb2a-c4f2-451a-ae71-72b06f05b868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:23.001874 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-93cfeb2a-c4f2-451a-ae71-72b06f05b868 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:23.003615 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-93cfeb2a-c4f2-451a-ae71-72b06f05b868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:23.086006 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa1889a-ee2e-4eba-ac0b-f7e9d32b58f2 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:23.096036 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c05253-52ad-4fb3-9e11-b507a1b3fe5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:23.097345 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c05253-52ad-4fb3-9e11-b507a1b3fe5f admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:23.097971 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c05253-52ad-4fb3-9e11-b507a1b3fe5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:23.098376 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c05253-52ad-4fb3-9e11-b507a1b3fe5f admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:23.099937 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c05253-52ad-4fb3-9e11-b507a1b3fe5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:23.102851 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c05253-52ad-4fb3-9e11-b507a1b3fe5f admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:23.123890 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 778/1556] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:52:23.126501 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f960a-0b1d-4031-a43c-b06ef761395d None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:23.127201 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f960a-0b1d-4031-a43c-b06ef761395d None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:23.127741 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f960a-0b1d-4031-a43c-b06ef761395d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:23.139509 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 779/1557] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:52:23.139509 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5d8ea-0acf-47a4-9be8-8fdf8c2a5f72 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:23.139509 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5d8ea-0acf-47a4-9be8-8fdf8c2a5f72 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:23.139509 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5d8ea-0acf-47a4-9be8-8fdf8c2a5f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:23.167544 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-73e5d8ea-0acf-47a4-9be8-8fdf8c2a5f72 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:23.168914 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-73e5d8ea-0acf-47a4-9be8-8fdf8c2a5f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:23.170478 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-961f960a-0b1d-4031-a43c-b06ef761395d None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:23.172555 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-961f960a-0b1d-4031-a43c-b06ef761395d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:23.178910 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 780/1558] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:52:23.181061 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553ab9c-d4ca-4943-b1e4-8485963f4ad8 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:23.181582 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553ab9c-d4ca-4943-b1e4-8485963f4ad8 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:23.182051 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553ab9c-d4ca-4943-b1e4-8485963f4ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:23.197068 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 779/1559] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:52:23.197068 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f960a-0b1d-4031-a43c-b06ef761395d None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:23.209412 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-8553ab9c-d4ca-4943-b1e4-8485963f4ad8 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:23.211428 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-8553ab9c-d4ca-4943-b1e4-8485963f4ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:23.211773 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f960a-0b1d-4031-a43c-b06ef761395d None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:23.219461 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b92c81b-72c4-40ed-a417-ae5a719d4be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:23.220354 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92c81b-72c4-40ed-a417-ae5a719d4be7 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:23.220832 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92c81b-72c4-40ed-a417-ae5a719d4be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:23.221538 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92c81b-72c4-40ed-a417-ae5a719d4be7 admin admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:23.222149 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b92c81b-72c4-40ed-a417-ae5a719d4be7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:52:23.222702 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b92c81b-72c4-40ed-a417-ae5a719d4be7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:23.224653 dv-cinder-856463-2-smb devstack@keystone.service[88207]: WARNING py.warnings [None req-5b92c81b-72c4-40ed-a417-ae5a719d4be7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 08 13:52:23.224653 dv-cinder-856463-2-smb devstack@keystone.service[88207]: warnings.warn(msg) Sep 08 13:52:23.224653 dv-cinder-856463-2-smb devstack@keystone.service[88207]: Sep 08 13:52:23.226284 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b92c81b-72c4-40ed-a417-ae5a719d4be7 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:23.227808 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 781/1560] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:52:23.228510 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8553ab9c-d4ca-4943-b1e4-8485963f4ad8 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:23.237398 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:23.248475 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8553ab9c-d4ca-4943-b1e4-8485963f4ad8 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:23.257509 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff0d9c-f971-4017-944f-12cce8e91d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:23.258244 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 780/1561] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 13:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:52:23.258542 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff0d9c-f971-4017-944f-12cce8e91d40 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:23.259041 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff0d9c-f971-4017-944f-12cce8e91d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:23.259517 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff0d9c-f971-4017-944f-12cce8e91d40 admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:23.259978 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b92c81b-72c4-40ed-a417-ae5a719d4be7 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:23.260746 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff0d9c-f971-4017-944f-12cce8e91d40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:23.264554 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff0d9c-f971-4017-944f-12cce8e91d40 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:23.278425 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b92c81b-72c4-40ed-a417-ae5a719d4be7 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:23.285898 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d714736-0445-458e-b397-d2c3dda270bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:23.287380 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d714736-0445-458e-b397-d2c3dda270bc admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:23.288136 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d714736-0445-458e-b397-d2c3dda270bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:23.288615 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d714736-0445-458e-b397-d2c3dda270bc admin admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:23.289698 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d714736-0445-458e-b397-d2c3dda270bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:52:23.290243 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d714736-0445-458e-b397-d2c3dda270bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:23.293165 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d714736-0445-458e-b397-d2c3dda270bc admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:23.305029 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 782/1562] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:52:23 2022] POST /identity/v3/users => generated 289 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:52:23.306597 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff0d9c-f971-4017-944f-12cce8e91d40 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:23.325194 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 781/1563] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 13:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:52:23.325194 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d714736-0445-458e-b397-d2c3dda270bc admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:23.329848 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:23.335501 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff0d9c-f971-4017-944f-12cce8e91d40 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:23.340616 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d714736-0445-458e-b397-d2c3dda270bc admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:23.344260 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641dfe6-b35b-4b85-8627-ebca71955b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:23.345325 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641dfe6-b35b-4b85-8627-ebca71955b16 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:23.345864 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641dfe6-b35b-4b85-8627-ebca71955b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:23.346350 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641dfe6-b35b-4b85-8627-ebca71955b16 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:23.347539 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b641dfe6-b35b-4b85-8627-ebca71955b16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:23.350233 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6beda91-32e8-4b01-8f17-fe20ca4efd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:23.351223 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6beda91-32e8-4b01-8f17-fe20ca4efd12 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:23.351530 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b641dfe6-b35b-4b85-8627-ebca71955b16 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:23.351721 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6beda91-32e8-4b01-8f17-fe20ca4efd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:23.352208 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6beda91-32e8-4b01-8f17-fe20ca4efd12 admin admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:23.353504 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6beda91-32e8-4b01-8f17-fe20ca4efd12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:52:23.354038 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6beda91-32e8-4b01-8f17-fe20ca4efd12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:23.357144 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6beda91-32e8-4b01-8f17-fe20ca4efd12 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:23.373690 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 783/1564] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:52:23.375196 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641dfe6-b35b-4b85-8627-ebca71955b16 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:23.393457 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 782/1565] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 13:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:52:23.393457 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6beda91-32e8-4b01-8f17-fe20ca4efd12 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:23.393931 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641dfe6-b35b-4b85-8627-ebca71955b16 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:23.399168 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b8252-3518-4304-859d-0cb8fddd59e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:23.400212 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b8252-3518-4304-859d-0cb8fddd59e5 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:23.400679 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b8252-3518-4304-859d-0cb8fddd59e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:23.401158 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b8252-3518-4304-859d-0cb8fddd59e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:23.402336 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b8252-3518-4304-859d-0cb8fddd59e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:52:23.402771 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6beda91-32e8-4b01-8f17-fe20ca4efd12 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:23.403016 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b8252-3518-4304-859d-0cb8fddd59e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:23.405928 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b8252-3518-4304-859d-0cb8fddd59e5 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:23.418957 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3977f-c087-4e4f-978a-4daa8c575fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:23.422133 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3977f-c087-4e4f-978a-4daa8c575fee admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:23.422599 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3977f-c087-4e4f-978a-4daa8c575fee admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:23.423061 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3977f-c087-4e4f-978a-4daa8c575fee admin admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:23.424190 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c3977f-c087-4e4f-978a-4daa8c575fee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:52:23.424686 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c3977f-c087-4e4f-978a-4daa8c575fee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:23.427764 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c3977f-c087-4e4f-978a-4daa8c575fee admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:23.431462 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 784/1566] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 13:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:52:23.442801 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af22347-9783-4a5a-9eb7-bd9bcb99f0b5 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:23.442801 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af22347-9783-4a5a-9eb7-bd9bcb99f0b5 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:23.442801 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af22347-9783-4a5a-9eb7-bd9bcb99f0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:23.455856 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 783/1567] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 13:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:52:23.457431 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3977f-c087-4e4f-978a-4daa8c575fee admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:23.476323 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-2af22347-9783-4a5a-9eb7-bd9bcb99f0b5 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:23.477281 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3977f-c087-4e4f-978a-4daa8c575fee admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:23.478497 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-2af22347-9783-4a5a-9eb7-bd9bcb99f0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:23.484614 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07cecc9-9f84-4033-8f79-e736b1742bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:23.485603 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07cecc9-9f84-4033-8f79-e736b1742bdb admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:23.486014 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07cecc9-9f84-4033-8f79-e736b1742bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:23.486414 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07cecc9-9f84-4033-8f79-e736b1742bdb admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:23.487441 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07cecc9-9f84-4033-8f79-e736b1742bdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:23.490859 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07cecc9-9f84-4033-8f79-e736b1742bdb admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:23.492785 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 785/1568] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:52:23.494267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af22347-9783-4a5a-9eb7-bd9bcb99f0b5 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:23.512874 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af22347-9783-4a5a-9eb7-bd9bcb99f0b5 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:23.523349 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54bba3-8bfe-4ed5-99ed-ad37244283f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:23.524337 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54bba3-8bfe-4ed5-99ed-ad37244283f7 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:23.524807 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54bba3-8bfe-4ed5-99ed-ad37244283f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:23.525630 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54bba3-8bfe-4ed5-99ed-ad37244283f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:23.526570 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c54bba3-8bfe-4ed5-99ed-ad37244283f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:23.529810 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c54bba3-8bfe-4ed5-99ed-ad37244283f7 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:23.552967 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 784/1569] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:52:23 2022] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:52:23.552967 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07cecc9-9f84-4033-8f79-e736b1742bdb admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:23.553662 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 786/1570] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:52:23.553662 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54bba3-8bfe-4ed5-99ed-ad37244283f7 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:23.573714 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54bba3-8bfe-4ed5-99ed-ad37244283f7 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:23.680152 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07cecc9-9f84-4033-8f79-e736b1742bdb admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:23.689251 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee0d9a3-3228-4ad1-b6d6-40f390ea4b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:23.690476 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee0d9a3-3228-4ad1-b6d6-40f390ea4b8b admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:23.690878 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee0d9a3-3228-4ad1-b6d6-40f390ea4b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:23.691376 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee0d9a3-3228-4ad1-b6d6-40f390ea4b8b admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:23.692499 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee0d9a3-3228-4ad1-b6d6-40f390ea4b8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:23.696171 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee0d9a3-3228-4ad1-b6d6-40f390ea4b8b admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:23.697910 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc102040-93ce-4352-9092-d8aa45046997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:23.701154 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc102040-93ce-4352-9092-d8aa45046997 admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:23.701154 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc102040-93ce-4352-9092-d8aa45046997 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:23.701154 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc102040-93ce-4352-9092-d8aa45046997 admin admin] PATH_INFO: `/v3/projects/f5cb5952471f46faa6cc46fcdb01db44/users/8c04792ec08549dd93c8d304392bb334/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:23.730608 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc102040-93ce-4352-9092-d8aa45046997 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5cb5952471f46faa6cc46fcdb01db44, user_id=8c04792ec08549dd93c8d304392bb334, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:23.732370 dv-cinder-856463-2-smb devstack@keystone.service[88208]: WARNING py.warnings [None req-fc102040-93ce-4352-9092-d8aa45046997 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 13:52:23.732370 dv-cinder-856463-2-smb devstack@keystone.service[88208]: warnings.warn(msg) Sep 08 13:52:23.732370 dv-cinder-856463-2-smb devstack@keystone.service[88208]: Sep 08 13:52:23.735815 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc102040-93ce-4352-9092-d8aa45046997 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:23.749897 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 785/1571] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:52:23 2022] POST /identity/v3/projects => generated 387 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:52:23.751416 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee0d9a3-3228-4ad1-b6d6-40f390ea4b8b admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:23.766381 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 787/1572] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:52:23 2022] PUT /identity/v3/projects/f5cb5952471f46faa6cc46fcdb01db44/users/8c04792ec08549dd93c8d304392bb334/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:52:23.768304 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc102040-93ce-4352-9092-d8aa45046997 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:23.885913 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc102040-93ce-4352-9092-d8aa45046997 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:23.894324 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999ebfb-1fb4-4243-8b79-a188410573ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:23.895932 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999ebfb-1fb4-4243-8b79-a188410573ee admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:23.896404 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999ebfb-1fb4-4243-8b79-a188410573ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:23.896881 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999ebfb-1fb4-4243-8b79-a188410573ee admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:23.898096 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8999ebfb-1fb4-4243-8b79-a188410573ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:23.901928 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8999ebfb-1fb4-4243-8b79-a188410573ee admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:23.903405 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee0d9a3-3228-4ad1-b6d6-40f390ea4b8b admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:23.912039 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6bed6-e98e-4e80-9ce2-f68874e668de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:23.913187 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6bed6-e98e-4e80-9ce2-f68874e668de admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:23.913902 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6bed6-e98e-4e80-9ce2-f68874e668de admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:23.914401 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6bed6-e98e-4e80-9ce2-f68874e668de admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:23.915874 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba6bed6-e98e-4e80-9ce2-f68874e668de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:23.919980 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba6bed6-e98e-4e80-9ce2-f68874e668de admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:23.967441 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 788/1573] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:52:23 2022] POST /identity/v3/projects => generated 365 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:52:23.968843 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999ebfb-1fb4-4243-8b79-a188410573ee admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:23.980879 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 786/1574] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:52:23 2022] POST /identity/v3/projects => generated 365 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:52:23.980879 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6bed6-e98e-4e80-9ce2-f68874e668de admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:23.993967 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:24.042123 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:24.091023 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999ebfb-1fb4-4243-8b79-a188410573ee admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:24.100041 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64c8c4-8dfb-4cef-b743-bbfeef949fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:24.101499 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64c8c4-8dfb-4cef-b743-bbfeef949fa3 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:24.101499 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64c8c4-8dfb-4cef-b743-bbfeef949fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:24.101934 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64c8c4-8dfb-4cef-b743-bbfeef949fa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:24.103191 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb64c8c4-8dfb-4cef-b743-bbfeef949fa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:24.105790 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb64c8c4-8dfb-4cef-b743-bbfeef949fa3 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:24.107516 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6bed6-e98e-4e80-9ce2-f68874e668de admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:24.121763 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6d4cf-d6fa-4063-bd44-0918921bc5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:24.123191 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6d4cf-d6fa-4063-bd44-0918921bc5d4 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:24.123772 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6d4cf-d6fa-4063-bd44-0918921bc5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:24.124270 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6d4cf-d6fa-4063-bd44-0918921bc5d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:24.125700 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea6d4cf-d6fa-4063-bd44-0918921bc5d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:52:24.126338 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea6d4cf-d6fa-4063-bd44-0918921bc5d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:24.131726 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea6d4cf-d6fa-4063-bd44-0918921bc5d4 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:24.142414 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 789/1575] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:52:23 2022] POST /identity/v3/projects => generated 391 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:52:24.143292 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64c8c4-8dfb-4cef-b743-bbfeef949fa3 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:24.166625 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 787/1576] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 13:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:52:24.168230 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6d4cf-d6fa-4063-bd44-0918921bc5d4 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:24.187000 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6d4cf-d6fa-4063-bd44-0918921bc5d4 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:24.231182 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64c8c4-8dfb-4cef-b743-bbfeef949fa3 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:24.237165 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df403c5-87c0-4bd6-8530-7963ecb1e94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:24.238130 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df403c5-87c0-4bd6-8530-7963ecb1e94d admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:24.238471 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df403c5-87c0-4bd6-8530-7963ecb1e94d admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:24.238868 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df403c5-87c0-4bd6-8530-7963ecb1e94d admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:24.239741 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df403c5-87c0-4bd6-8530-7963ecb1e94d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:24.241758 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df403c5-87c0-4bd6-8530-7963ecb1e94d admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:24.258455 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 790/1577] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:52:24.259980 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df403c5-87c0-4bd6-8530-7963ecb1e94d admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:24.280272 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df403c5-87c0-4bd6-8530-7963ecb1e94d admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:24.286903 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4216db-d0ac-4c7e-9cf8-b278f06c88c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:24.287532 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4216db-d0ac-4c7e-9cf8-b278f06c88c2 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:24.287813 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4216db-d0ac-4c7e-9cf8-b278f06c88c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:24.288084 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4216db-d0ac-4c7e-9cf8-b278f06c88c2 admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:24.288768 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4216db-d0ac-4c7e-9cf8-b278f06c88c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:24.290851 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4216db-d0ac-4c7e-9cf8-b278f06c88c2 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:24.300383 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2cafdb-5c96-48af-bc5d-f659c9f08135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:24.301690 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2cafdb-5c96-48af-bc5d-f659c9f08135 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:24.303147 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2cafdb-5c96-48af-bc5d-f659c9f08135 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:24.303643 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2cafdb-5c96-48af-bc5d-f659c9f08135 admin admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:24.305013 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2cafdb-5c96-48af-bc5d-f659c9f08135 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:24.307536 dv-cinder-856463-2-smb devstack@keystone.service[88207]: WARNING py.warnings [None req-2d2cafdb-5c96-48af-bc5d-f659c9f08135 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 13:52:24.307536 dv-cinder-856463-2-smb devstack@keystone.service[88207]: warnings.warn(msg) Sep 08 13:52:24.307536 dv-cinder-856463-2-smb devstack@keystone.service[88207]: Sep 08 13:52:24.310532 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2cafdb-5c96-48af-bc5d-f659c9f08135 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:24.323886 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 791/1578] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:52:24 2022] POST /identity/v3/users => generated 294 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:52:24.323886 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16fb69-f9b9-473e-8b68-ed64ff9cd1b1 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:24.323886 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16fb69-f9b9-473e-8b68-ed64ff9cd1b1 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:24.323886 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16fb69-f9b9-473e-8b68-ed64ff9cd1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:24.356530 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 788/1579] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:52:24 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:52:24.356530 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2cafdb-5c96-48af-bc5d-f659c9f08135 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:24.366126 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2cafdb-5c96-48af-bc5d-f659c9f08135 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:24.371281 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941c8d2-9477-4eda-aea4-a5656758e4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:24.371903 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941c8d2-9477-4eda-aea4-a5656758e4c8 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:24.372181 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941c8d2-9477-4eda-aea4-a5656758e4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:24.372700 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941c8d2-9477-4eda-aea4-a5656758e4c8 admin admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:24.373336 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5941c8d2-9477-4eda-aea4-a5656758e4c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:24.376776 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5941c8d2-9477-4eda-aea4-a5656758e4c8 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:24.377053 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-5e16fb69-f9b9-473e-8b68-ed64ff9cd1b1 None None] MFA Rules not processed for user `8c04792ec08549dd93c8d304392bb334`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:24.379316 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-5e16fb69-f9b9-473e-8b68-ed64ff9cd1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:24.415081 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 789/1580] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:52:24 2022] POST /identity/v3/users => generated 283 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:52:24.416689 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941c8d2-9477-4eda-aea4-a5656758e4c8 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:24.436973 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941c8d2-9477-4eda-aea4-a5656758e4c8 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:24.443936 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91685c-b7fe-4974-9fad-4e5cb98f0408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:24.445384 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91685c-b7fe-4974-9fad-4e5cb98f0408 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:24.445603 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91685c-b7fe-4974-9fad-4e5cb98f0408 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:24.445901 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91685c-b7fe-4974-9fad-4e5cb98f0408 admin admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:24.446721 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea91685c-b7fe-4974-9fad-4e5cb98f0408 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:24.449521 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea91685c-b7fe-4974-9fad-4e5cb98f0408 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:24.486127 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 790/1581] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:52:24 2022] POST /identity/v3/users => generated 283 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:52:24.487497 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91685c-b7fe-4974-9fad-4e5cb98f0408 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:24.507060 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91685c-b7fe-4974-9fad-4e5cb98f0408 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:24.515016 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee0988c-e73f-4a65-add1-944fffd96de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:24.516076 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0988c-e73f-4a65-add1-944fffd96de9 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:24.516566 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0988c-e73f-4a65-add1-944fffd96de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:24.517055 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0988c-e73f-4a65-add1-944fffd96de9 admin admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:24.518272 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee0988c-e73f-4a65-add1-944fffd96de9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:24.522389 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee0988c-e73f-4a65-add1-944fffd96de9 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:24.523370 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 792/1582] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:52:24.528173 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16fb69-f9b9-473e-8b68-ed64ff9cd1b1 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:24.546524 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:24.556167 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16fb69-f9b9-473e-8b68-ed64ff9cd1b1 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:24.568337 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f754370-be3b-4a84-9f76-1e3b793ff737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:24.569114 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 791/1583] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:52:24 2022] POST /identity/v3/users => generated 296 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:52:24.570660 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f754370-be3b-4a84-9f76-1e3b793ff737 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:24.571849 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f754370-be3b-4a84-9f76-1e3b793ff737 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:24.572581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f754370-be3b-4a84-9f76-1e3b793ff737 admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:24.574107 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f754370-be3b-4a84-9f76-1e3b793ff737 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:24.575712 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee0988c-e73f-4a65-add1-944fffd96de9 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:24.577595 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f754370-be3b-4a84-9f76-1e3b793ff737 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:24.596405 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee0988c-e73f-4a65-add1-944fffd96de9 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:24.608234 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0f2e8-2560-406b-91b0-a4bfea14284e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:24.609294 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0f2e8-2560-406b-91b0-a4bfea14284e admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:24.609852 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0f2e8-2560-406b-91b0-a4bfea14284e admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:24.610315 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0f2e8-2560-406b-91b0-a4bfea14284e admin admin] PATH_INFO: `/v3/projects/065a5e32a243489a9e199b7c167b5acd/users/8395ea674036465b8a5c62622b4faf92/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:24.629285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 793/1584] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:52:24 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:52:24.631202 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f754370-be3b-4a84-9f76-1e3b793ff737 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:24.644869 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c0f2e8-2560-406b-91b0-a4bfea14284e admin admin] RBAC: Authorizing `identity:create_grant(project_id=065a5e32a243489a9e199b7c167b5acd, user_id=8395ea674036465b8a5c62622b4faf92, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:24.651710 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c0f2e8-2560-406b-91b0-a4bfea14284e admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:24.674804 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 792/1585] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:52:24 2022] PUT /identity/v3/projects/065a5e32a243489a9e199b7c167b5acd/users/8395ea674036465b8a5c62622b4faf92/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:52:24.676427 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0f2e8-2560-406b-91b0-a4bfea14284e admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:24.752132 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f754370-be3b-4a84-9f76-1e3b793ff737 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:24.753103 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:24.814896 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0f2e8-2560-406b-91b0-a4bfea14284e admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:24.824002 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46488351-1e49-4788-8476-54facf25c86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:24.824961 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46488351-1e49-4788-8476-54facf25c86a admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:24.825437 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46488351-1e49-4788-8476-54facf25c86a admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:24.825836 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46488351-1e49-4788-8476-54facf25c86a admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:24.826905 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46488351-1e49-4788-8476-54facf25c86a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:24.829763 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46488351-1e49-4788-8476-54facf25c86a admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:24.848290 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 793/1586] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:52:24.850547 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46488351-1e49-4788-8476-54facf25c86a admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:24.863342 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87d8bb-8c4b-4857-90f8-7af13c9119d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:24.864684 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87d8bb-8c4b-4857-90f8-7af13c9119d8 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:24.865052 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87d8bb-8c4b-4857-90f8-7af13c9119d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:24.865528 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87d8bb-8c4b-4857-90f8-7af13c9119d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:24.866071 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46488351-1e49-4788-8476-54facf25c86a admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:24.866401 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87d8bb-8c4b-4857-90f8-7af13c9119d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:24.868505 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87d8bb-8c4b-4857-90f8-7af13c9119d8 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:24.872352 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9984cab-ec93-46e7-bf26-161cad81f4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:24.872983 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9984cab-ec93-46e7-bf26-161cad81f4c8 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:24.873270 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9984cab-ec93-46e7-bf26-161cad81f4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:24.873651 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9984cab-ec93-46e7-bf26-161cad81f4c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:24.874490 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9984cab-ec93-46e7-bf26-161cad81f4c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:24.877079 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9984cab-ec93-46e7-bf26-161cad81f4c8 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:24.885775 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 794/1587] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:52:24.887073 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87d8bb-8c4b-4857-90f8-7af13c9119d8 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:24.899230 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 794/1588] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:52:24.900632 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54651444-09c7-49fb-9c5b-e153e9c61db9 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:24.900987 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54651444-09c7-49fb-9c5b-e153e9c61db9 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:24.901194 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54651444-09c7-49fb-9c5b-e153e9c61db9 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:24.903160 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 795/1589] 10.222.0.69 () {54 vars in 962 bytes} [Thu Sep 8 13:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:52:24.904127 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54651444-09c7-49fb-9c5b-e153e9c61db9 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:24.904882 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87d8bb-8c4b-4857-90f8-7af13c9119d8 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:24.917902 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a735c3fb-b117-4a7d-bd0f-0754be504fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:24.917902 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735c3fb-b117-4a7d-bd0f-0754be504fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:24.917902 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735c3fb-b117-4a7d-bd0f-0754be504fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:24.918704 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735c3fb-b117-4a7d-bd0f-0754be504fc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:24.919658 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a735c3fb-b117-4a7d-bd0f-0754be504fc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:24.922107 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54651444-09c7-49fb-9c5b-e153e9c61db9 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:24.922891 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a735c3fb-b117-4a7d-bd0f-0754be504fc3 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:24.930769 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28247d56-942f-451e-9dac-acc202504df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:24.931837 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28247d56-942f-451e-9dac-acc202504df8 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:24.932365 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28247d56-942f-451e-9dac-acc202504df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:24.932886 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28247d56-942f-451e-9dac-acc202504df8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:24.934125 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28247d56-942f-451e-9dac-acc202504df8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:24.937075 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28247d56-942f-451e-9dac-acc202504df8 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:24.945437 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 795/1590] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:52:24.951182 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a735c3fb-b117-4a7d-bd0f-0754be504fc3 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:24.958514 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 796/1591] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:52:24.961540 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576a05e-50ca-4378-a189-7a08bdb88815 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:24.961929 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576a05e-50ca-4378-a189-7a08bdb88815 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:24.962392 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576a05e-50ca-4378-a189-7a08bdb88815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:24.967571 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a735c3fb-b117-4a7d-bd0f-0754be504fc3 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:24.976093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb81bd-012f-409e-bf72-34f4461ca291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:24.976776 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb81bd-012f-409e-bf72-34f4461ca291 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:24.977325 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb81bd-012f-409e-bf72-34f4461ca291 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:24.977721 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb81bd-012f-409e-bf72-34f4461ca291 admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:24.978448 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb81bd-012f-409e-bf72-34f4461ca291 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:24.980575 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bb81bd-012f-409e-bf72-34f4461ca291 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:24.995940 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-6576a05e-50ca-4378-a189-7a08bdb88815 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:24.998049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-6576a05e-50ca-4378-a189-7a08bdb88815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:25.011562 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 796/1592] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:52:24 2022] POST /identity/v3/users => generated 288 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:52:25.013416 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 797/1593] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:52:25.015816 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb81bd-012f-409e-bf72-34f4461ca291 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:25.019787 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576a05e-50ca-4378-a189-7a08bdb88815 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:25.036977 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb81bd-012f-409e-bf72-34f4461ca291 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:25.038521 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576a05e-50ca-4378-a189-7a08bdb88815 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:25.044563 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a0210-affa-45d6-acfb-83627a4a4ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:25.045265 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a0210-affa-45d6-acfb-83627a4a4ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:25.046404 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a0210-affa-45d6-acfb-83627a4a4ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:25.046777 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65a0210-affa-45d6-acfb-83627a4a4ad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:25.047673 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65a0210-affa-45d6-acfb-83627a4a4ad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:25.048649 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51624b4-eec1-4a06-a5ec-80c13eae9d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:25.049678 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51624b4-eec1-4a06-a5ec-80c13eae9d9b admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:25.049907 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65a0210-affa-45d6-acfb-83627a4a4ad0 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:25.050146 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51624b4-eec1-4a06-a5ec-80c13eae9d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:25.050655 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51624b4-eec1-4a06-a5ec-80c13eae9d9b admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:25.052338 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51624b4-eec1-4a06-a5ec-80c13eae9d9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:25.055458 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51624b4-eec1-4a06-a5ec-80c13eae9d9b admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:25.064883 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 798/1594] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:52:25.066104 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a0210-affa-45d6-acfb-83627a4a4ad0 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:25.079582 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 797/1595] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:52:25.081288 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25884e7c-73d4-43be-b56e-cf6268133043 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:25.081749 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25884e7c-73d4-43be-b56e-cf6268133043 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:25.082192 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25884e7c-73d4-43be-b56e-cf6268133043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:25.082675 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65a0210-affa-45d6-acfb-83627a4a4ad0 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:25.093401 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5f1dc-4339-4dc3-92ed-5fd48899491c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:25.094701 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5f1dc-4339-4dc3-92ed-5fd48899491c admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:25.095280 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5f1dc-4339-4dc3-92ed-5fd48899491c admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:25.095894 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5f1dc-4339-4dc3-92ed-5fd48899491c admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:25.097193 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5f1dc-4339-4dc3-92ed-5fd48899491c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:25.102485 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5f1dc-4339-4dc3-92ed-5fd48899491c admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:25.123969 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 799/1596] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:52:25.125657 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5f1dc-4339-4dc3-92ed-5fd48899491c admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:25.144142 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5f1dc-4339-4dc3-92ed-5fd48899491c admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:25.148864 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-25884e7c-73d4-43be-b56e-cf6268133043 None None] MFA Rules not processed for user `c95448c1b8b1466cae37fda5c713d53f`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:25.150570 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-25884e7c-73d4-43be-b56e-cf6268133043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:25.154324 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c168e8b-a820-4847-8673-5a9833d5d1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:25.155295 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c168e8b-a820-4847-8673-5a9833d5d1ff admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:25.155797 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c168e8b-a820-4847-8673-5a9833d5d1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:25.156179 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c168e8b-a820-4847-8673-5a9833d5d1ff admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:25.157307 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c168e8b-a820-4847-8673-5a9833d5d1ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:25.160175 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c168e8b-a820-4847-8673-5a9833d5d1ff admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:25.180049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 800/1597] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:52:25.181599 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c168e8b-a820-4847-8673-5a9833d5d1ff admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:25.202035 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c168e8b-a820-4847-8673-5a9833d5d1ff admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:25.212589 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3e666-2a7e-41df-b99e-379aee085121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:25.213788 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3e666-2a7e-41df-b99e-379aee085121 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:25.214319 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3e666-2a7e-41df-b99e-379aee085121 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:25.214880 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3e666-2a7e-41df-b99e-379aee085121 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:25.216227 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f3e666-2a7e-41df-b99e-379aee085121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:25.218144 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:25.219963 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f3e666-2a7e-41df-b99e-379aee085121 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:25.250366 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 801/1598] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:52:25.250366 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3e666-2a7e-41df-b99e-379aee085121 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:25.277281 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3e666-2a7e-41df-b99e-379aee085121 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:25.279623 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455e3ce-915b-4954-9384-22e7628561d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:25.280088 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455e3ce-915b-4954-9384-22e7628561d5 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:25.280619 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455e3ce-915b-4954-9384-22e7628561d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:25.281197 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455e3ce-915b-4954-9384-22e7628561d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:25.282620 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a455e3ce-915b-4954-9384-22e7628561d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:25.286214 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a455e3ce-915b-4954-9384-22e7628561d5 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:25.305465 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 802/1599] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:52:25.306666 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455e3ce-915b-4954-9384-22e7628561d5 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:25.307282 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 798/1600] 10.222.0.69 () {58 vars in 1059 bytes} [Thu Sep 8 13:52:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:52:25.308879 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25884e7c-73d4-43be-b56e-cf6268133043 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:25.311754 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-a455e3ce-915b-4954-9384-22e7628561d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:25.332663 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25884e7c-73d4-43be-b56e-cf6268133043 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:25.342967 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524dff27-14a1-47b8-8d9e-614296bb7156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:25.344100 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dff27-14a1-47b8-8d9e-614296bb7156 admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:25.345327 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dff27-14a1-47b8-8d9e-614296bb7156 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:25.345327 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524dff27-14a1-47b8-8d9e-614296bb7156 admin admin] PATH_INFO: `/v3/projects/93f83ce5a70c436592711252a06c3814/users/c38575a2f7bc408f8b5eb58ad513c078/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:25.382120 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524dff27-14a1-47b8-8d9e-614296bb7156 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93f83ce5a70c436592711252a06c3814, user_id=c38575a2f7bc408f8b5eb58ad513c078, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:25.386155 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524dff27-14a1-47b8-8d9e-614296bb7156 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:25.410260 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 799/1601] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:52:25 2022] PUT /identity/v3/projects/93f83ce5a70c436592711252a06c3814/users/c38575a2f7bc408f8b5eb58ad513c078/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:52:25.411766 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524dff27-14a1-47b8-8d9e-614296bb7156 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:25.433180 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455e3ce-915b-4954-9384-22e7628561d5 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:25.515029 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c760a-642f-4933-8ffd-09576738c3dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:25.515868 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c760a-642f-4933-8ffd-09576738c3dc service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:25.516245 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c760a-642f-4933-8ffd-09576738c3dc service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:25.516623 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c760a-642f-4933-8ffd-09576738c3dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:25.530898 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c760a-642f-4933-8ffd-09576738c3dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:25.532306 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c760a-642f-4933-8ffd-09576738c3dc service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:25.534460 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524dff27-14a1-47b8-8d9e-614296bb7156 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:25.544332 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853bcf41-e758-4d49-b9a2-cd1c9d97be7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:25.545409 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bcf41-e758-4d49-b9a2-cd1c9d97be7b admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:25.545818 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bcf41-e758-4d49-b9a2-cd1c9d97be7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:25.546277 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bcf41-e758-4d49-b9a2-cd1c9d97be7b admin admin] PATH_INFO: `/v3/projects/21d2887cd0cf4e6cb6d689f93a1dfafb/users/75cd9652625a4935a9af31bd4549ccf1/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:25.548113 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 803/1602] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:52:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:52:25.549661 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c760a-642f-4933-8ffd-09576738c3dc service neutron] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:25.555052 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:25.563935 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c760a-642f-4933-8ffd-09576738c3dc service neutron] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:25.573162 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c512d78-98b9-40a5-a11c-1375a6d2c99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:25.574327 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c512d78-98b9-40a5-a11c-1375a6d2c99e admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:25.574823 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c512d78-98b9-40a5-a11c-1375a6d2c99e admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:25.575292 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c512d78-98b9-40a5-a11c-1375a6d2c99e admin admin] PATH_INFO: `/v3/projects/14ee589a88bf4620b1fa909ec7669bbf/users/ab0ba4d47e3b444291b113fd6ca85bd6/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:25.576965 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853bcf41-e758-4d49-b9a2-cd1c9d97be7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=21d2887cd0cf4e6cb6d689f93a1dfafb, user_id=75cd9652625a4935a9af31bd4549ccf1, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:25.582089 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853bcf41-e758-4d49-b9a2-cd1c9d97be7b admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:25.604401 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c512d78-98b9-40a5-a11c-1375a6d2c99e admin admin] RBAC: Authorizing `identity:create_grant(project_id=14ee589a88bf4620b1fa909ec7669bbf, user_id=ab0ba4d47e3b444291b113fd6ca85bd6, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:25.614027 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 800/1603] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:52:25 2022] PUT /identity/v3/projects/21d2887cd0cf4e6cb6d689f93a1dfafb/users/75cd9652625a4935a9af31bd4549ccf1/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:52:25.614424 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c512d78-98b9-40a5-a11c-1375a6d2c99e admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:25.614605 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853bcf41-e758-4d49-b9a2-cd1c9d97be7b admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:25.636260 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 804/1604] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:52:25 2022] PUT /identity/v3/projects/14ee589a88bf4620b1fa909ec7669bbf/users/ab0ba4d47e3b444291b113fd6ca85bd6/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:52:25.637316 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c512d78-98b9-40a5-a11c-1375a6d2c99e admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:25.760966 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853bcf41-e758-4d49-b9a2-cd1c9d97be7b admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:25.768378 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c55c79-c18b-4125-96b8-3fdca9e1cb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:25.769799 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c55c79-c18b-4125-96b8-3fdca9e1cb22 admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:25.770766 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c55c79-c18b-4125-96b8-3fdca9e1cb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:25.771109 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c55c79-c18b-4125-96b8-3fdca9e1cb22 admin admin] PATH_INFO: `/v3/projects/aafc5110197d4fdfa11191dd477d68f1/users/5e3d1b6cc12b44fa937d90f8c9f92034/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:25.775336 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c512d78-98b9-40a5-a11c-1375a6d2c99e admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:25.787149 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d1687-4901-4989-8c0a-12df2b63a70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:25.788503 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d1687-4901-4989-8c0a-12df2b63a70a admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:25.789132 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d1687-4901-4989-8c0a-12df2b63a70a admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:25.789730 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d1687-4901-4989-8c0a-12df2b63a70a admin admin] PATH_INFO: `/v3/projects/735551d6d52b4b8790e5be1b94e4041f/users/5eb6e03e874d4b28aaf21c5b36f7bb98/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:25.797717 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c55c79-c18b-4125-96b8-3fdca9e1cb22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aafc5110197d4fdfa11191dd477d68f1, user_id=5e3d1b6cc12b44fa937d90f8c9f92034, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:25.807615 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c55c79-c18b-4125-96b8-3fdca9e1cb22 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:25.825657 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d1687-4901-4989-8c0a-12df2b63a70a admin admin] RBAC: Authorizing `identity:create_grant(project_id=735551d6d52b4b8790e5be1b94e4041f, user_id=5eb6e03e874d4b28aaf21c5b36f7bb98, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:25.831349 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 801/1605] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:52:25 2022] PUT /identity/v3/projects/aafc5110197d4fdfa11191dd477d68f1/users/5e3d1b6cc12b44fa937d90f8c9f92034/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:52:25.831641 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d1687-4901-4989-8c0a-12df2b63a70a admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:25.832925 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c55c79-c18b-4125-96b8-3fdca9e1cb22 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:25.867004 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:25.871843 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 805/1606] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:52:25 2022] PUT /identity/v3/projects/735551d6d52b4b8790e5be1b94e4041f/users/5eb6e03e874d4b28aaf21c5b36f7bb98/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:52:25.873205 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d1687-4901-4989-8c0a-12df2b63a70a admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:25.986126 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c55c79-c18b-4125-96b8-3fdca9e1cb22 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:26.018365 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d1687-4901-4989-8c0a-12df2b63a70a admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:26.037065 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931223e-bb65-46d6-975c-29ae24d6fc78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:26.038391 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931223e-bb65-46d6-975c-29ae24d6fc78 service nova] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:26.038955 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931223e-bb65-46d6-975c-29ae24d6fc78 service nova] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:26.039531 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931223e-bb65-46d6-975c-29ae24d6fc78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:26.130713 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77baef91-623f-4a12-a986-46e2b0d2e39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:26.131781 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77baef91-623f-4a12-a986-46e2b0d2e39b admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:26.132311 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77baef91-623f-4a12-a986-46e2b0d2e39b admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:26.132750 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77baef91-623f-4a12-a986-46e2b0d2e39b admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:26.134039 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77baef91-623f-4a12-a986-46e2b0d2e39b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:26.137141 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77baef91-623f-4a12-a986-46e2b0d2e39b admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:26.144054 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7931223e-bb65-46d6-975c-29ae24d6fc78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:26.146925 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7931223e-bb65-46d6-975c-29ae24d6fc78 service nova] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:26.153858 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:26.161755 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 802/1607] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:52:26.161755 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935830b-7dd0-42ea-95a9-4f4286419652 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:26.161755 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935830b-7dd0-42ea-95a9-4f4286419652 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:26.161755 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935830b-7dd0-42ea-95a9-4f4286419652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:26.197230 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 806/1608] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:52:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:52:26.200090 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d26d8c-f432-42d5-b98c-10da32a624fa None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:26.200659 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d26d8c-f432-42d5-b98c-10da32a624fa None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:26.201188 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d26d8c-f432-42d5-b98c-10da32a624fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:26.234639 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-f935830b-7dd0-42ea-95a9-4f4286419652 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:26.239167 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-f935830b-7dd0-42ea-95a9-4f4286419652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:26.282312 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 803/1609] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:52:26.284823 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdff4e8-df17-4e0f-983c-d08d95975b06 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:26.286773 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdff4e8-df17-4e0f-983c-d08d95975b06 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:26.287488 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdff4e8-df17-4e0f-983c-d08d95975b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:26.299510 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-36d26d8c-f432-42d5-b98c-10da32a624fa None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:26.311915 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-36d26d8c-f432-42d5-b98c-10da32a624fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:26.340599 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 807/1610] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:52:26.340599 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882e371-dcd5-49d7-9de7-acc8191f156c None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:26.340599 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882e371-dcd5-49d7-9de7-acc8191f156c None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:26.340599 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882e371-dcd5-49d7-9de7-acc8191f156c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:26.404120 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-7cdff4e8-df17-4e0f-983c-d08d95975b06 None None] MFA Rules not processed for user `ab0ba4d47e3b444291b113fd6ca85bd6`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:26.406786 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-7cdff4e8-df17-4e0f-983c-d08d95975b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:26.460971 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-9882e371-dcd5-49d7-9de7-acc8191f156c None None] MFA Rules not processed for user `5e3d1b6cc12b44fa937d90f8c9f92034`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:26.467910 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-9882e371-dcd5-49d7-9de7-acc8191f156c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:26.594823 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 804/1611] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:52:26.598726 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629e448-77ef-4d7f-9747-5acd6b415a47 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:26.599385 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629e448-77ef-4d7f-9747-5acd6b415a47 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:26.599874 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629e448-77ef-4d7f-9747-5acd6b415a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:26.630101 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 808/1612] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:52:26.630101 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9882e371-dcd5-49d7-9de7-acc8191f156c None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:26.641876 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-0629e448-77ef-4d7f-9747-5acd6b415a47 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:26.644206 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-0629e448-77ef-4d7f-9747-5acd6b415a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:26.654577 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9882e371-dcd5-49d7-9de7-acc8191f156c None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:26.665571 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79793329-c4cb-4f7a-8d56-83289954f2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:26.669581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 805/1613] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:52:26.669899 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79793329-c4cb-4f7a-8d56-83289954f2bb admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:26.671963 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79793329-c4cb-4f7a-8d56-83289954f2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:26.672271 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79793329-c4cb-4f7a-8d56-83289954f2bb admin admin] PATH_INFO: `/v3/projects/c546b6e940da4042914f16dcf53977d5/users/2e88a2bf092b45faa9260f9f3f6d00d7/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:26.672867 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629e448-77ef-4d7f-9747-5acd6b415a47 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:26.732268 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79793329-c4cb-4f7a-8d56-83289954f2bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c546b6e940da4042914f16dcf53977d5, user_id=2e88a2bf092b45faa9260f9f3f6d00d7, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:26.737511 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79793329-c4cb-4f7a-8d56-83289954f2bb admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:26.764697 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 809/1614] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:52:26 2022] PUT /identity/v3/projects/c546b6e940da4042914f16dcf53977d5/users/2e88a2bf092b45faa9260f9f3f6d00d7/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:52:26.766601 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79793329-c4cb-4f7a-8d56-83289954f2bb admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:26.774474 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:26.851935 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629e448-77ef-4d7f-9747-5acd6b415a47 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:26.898407 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79793329-c4cb-4f7a-8d56-83289954f2bb admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:26.908071 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae4e58-d8ea-4b16-aead-9c09b410cd69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:26.908702 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae4e58-d8ea-4b16-aead-9c09b410cd69 service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:26.909529 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae4e58-d8ea-4b16-aead-9c09b410cd69 service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:26.910068 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae4e58-d8ea-4b16-aead-9c09b410cd69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:26.968105 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08f928-499d-4664-b203-790af4ee4752 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:26.969723 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08f928-499d-4664-b203-790af4ee4752 service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:26.970162 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08f928-499d-4664-b203-790af4ee4752 service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:26.970599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08f928-499d-4664-b203-790af4ee4752 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:27.078787 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae4e58-d8ea-4b16-aead-9c09b410cd69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:27.082574 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae4e58-d8ea-4b16-aead-9c09b410cd69 service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:27.108252 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 810/1615] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:52:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:52:27.109981 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae4e58-d8ea-4b16-aead-9c09b410cd69 service neutron] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:27.119102 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a08f928-499d-4664-b203-790af4ee4752 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:27.122166 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a08f928-499d-4664-b203-790af4ee4752 service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:27.133258 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae4e58-d8ea-4b16-aead-9c09b410cd69 service neutron] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:27.143740 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a1e26-d463-4185-927b-af90d27234ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:27.144088 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 806/1616] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:52:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:52:27.144985 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a1e26-d463-4185-927b-af90d27234ec admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:27.145939 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a1e26-d463-4185-927b-af90d27234ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:27.146264 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08f928-499d-4664-b203-790af4ee4752 service neutron] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:27.146445 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a1e26-d463-4185-927b-af90d27234ec admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:27.147819 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a1e26-d463-4185-927b-af90d27234ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:27.152413 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a1e26-d463-4185-927b-af90d27234ec admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:27.163057 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:27.170381 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08f928-499d-4664-b203-790af4ee4752 service neutron] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:27.180452 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec396953-8d8d-4f43-adba-0e7800d4d65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:27.180832 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec396953-8d8d-4f43-adba-0e7800d4d65d admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:27.181763 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec396953-8d8d-4f43-adba-0e7800d4d65d admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:27.182259 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec396953-8d8d-4f43-adba-0e7800d4d65d admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:27.183509 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec396953-8d8d-4f43-adba-0e7800d4d65d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:27.187964 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec396953-8d8d-4f43-adba-0e7800d4d65d admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:27.219431 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 811/1617] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:52:27 2022] POST /identity/v3/projects => generated 363 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:52:27.219431 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a1e26-d463-4185-927b-af90d27234ec admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:27.261615 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 807/1618] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:52:27 2022] POST /identity/v3/projects => generated 363 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:52:27.263763 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e0e6f-93e4-4e25-b973-6fc793a54b6a None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:27.264291 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e0e6f-93e4-4e25-b973-6fc793a54b6a None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:27.264922 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e0e6f-93e4-4e25-b973-6fc793a54b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:27.338938 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-da4e0e6f-93e4-4e25-b973-6fc793a54b6a None None] MFA Rules not processed for user `2e88a2bf092b45faa9260f9f3f6d00d7`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:27.341841 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-da4e0e6f-93e4-4e25-b973-6fc793a54b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:27.375161 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a1e26-d463-4185-927b-af90d27234ec admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:27.501415 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:27.502477 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948df04-f297-4950-8dc6-b3739e3903f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:27.504355 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948df04-f297-4950-8dc6-b3739e3903f6 service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:27.506099 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948df04-f297-4950-8dc6-b3739e3903f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:27.506834 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948df04-f297-4950-8dc6-b3739e3903f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:27.521235 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 808/1619] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:52:27.525012 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a3fa7-3079-440a-b86c-b7056c19dc28 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:27.527434 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a3fa7-3079-440a-b86c-b7056c19dc28 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:27.529310 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a3fa7-3079-440a-b86c-b7056c19dc28 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:27.537772 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 809/1620] 10.222.0.69 () {54 vars in 912 bytes} [Thu Sep 8 13:52:27 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:52:27.539875 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a3fa7-3079-440a-b86c-b7056c19dc28 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:27.696292 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9948df04-f297-4950-8dc6-b3739e3903f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:27.699362 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9948df04-f297-4950-8dc6-b3739e3903f6 service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:27.727446 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a3fa7-3079-440a-b86c-b7056c19dc28 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:27.739156 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 812/1621] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:52:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:52:27.740644 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc75969-5fc6-4876-81b2-9913ae20d418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:27.740867 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948df04-f297-4950-8dc6-b3739e3903f6 service neutron] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:27.741278 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc75969-5fc6-4876-81b2-9913ae20d418 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:27.741596 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc75969-5fc6-4876-81b2-9913ae20d418 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:27.741925 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc75969-5fc6-4876-81b2-9913ae20d418 admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:27.742505 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc75969-5fc6-4876-81b2-9913ae20d418 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:27.749138 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc75969-5fc6-4876-81b2-9913ae20d418 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:27.761789 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948df04-f297-4950-8dc6-b3739e3903f6 service neutron] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:27.779323 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3613f4-bb64-46b7-9f8f-edd86e8ec5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:27.783912 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3613f4-bb64-46b7-9f8f-edd86e8ec5d4 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:27.785011 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3613f4-bb64-46b7-9f8f-edd86e8ec5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:27.786401 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3613f4-bb64-46b7-9f8f-edd86e8ec5d4 admin admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:27.792768 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3613f4-bb64-46b7-9f8f-edd86e8ec5d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:27.806783 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3613f4-bb64-46b7-9f8f-edd86e8ec5d4 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:27.830921 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 810/1622] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:52:27 2022] POST /identity/v3/users => generated 288 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:52:27.840553 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1681cd-d8e7-4c45-bfe1-5ab40c9b0a68 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:27.844294 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1681cd-d8e7-4c45-bfe1-5ab40c9b0a68 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:27.846026 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1681cd-d8e7-4c45-bfe1-5ab40c9b0a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:27.892108 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 813/1623] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:52:27 2022] POST /identity/v3/users => generated 288 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:52:27.898916 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a05c10-16d4-4310-8b87-a8d9ebf52ab9 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:27.899517 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a05c10-16d4-4310-8b87-a8d9ebf52ab9 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:27.900149 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a05c10-16d4-4310-8b87-a8d9ebf52ab9 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:27.905000 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 814/1624] 10.222.0.69 () {54 vars in 962 bytes} [Thu Sep 8 13:52:27 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:52:27.905752 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a05c10-16d4-4310-8b87-a8d9ebf52ab9 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:27.949235 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-7f1681cd-d8e7-4c45-bfe1-5ab40c9b0a68 None None] MFA Rules not processed for user `c95448c1b8b1466cae37fda5c713d53f`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:27.951148 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a05c10-16d4-4310-8b87-a8d9ebf52ab9 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:27.951496 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-7f1681cd-d8e7-4c45-bfe1-5ab40c9b0a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:27.961210 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be90a61f-581a-4ebd-a6df-9896336c90c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:27.962367 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90a61f-581a-4ebd-a6df-9896336c90c2 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:27.963967 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90a61f-581a-4ebd-a6df-9896336c90c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:27.964597 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90a61f-581a-4ebd-a6df-9896336c90c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:27.966164 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be90a61f-581a-4ebd-a6df-9896336c90c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:27.969670 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be90a61f-581a-4ebd-a6df-9896336c90c2 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:28.018741 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 815/1625] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:52:28.035073 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be90a61f-581a-4ebd-a6df-9896336c90c2 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:28.088163 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be90a61f-581a-4ebd-a6df-9896336c90c2 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:28.099070 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739bc74-1c59-4859-aac1-81ac5029b9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:28.100353 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739bc74-1c59-4859-aac1-81ac5029b9e1 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:28.100787 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739bc74-1c59-4859-aac1-81ac5029b9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:28.101114 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739bc74-1c59-4859-aac1-81ac5029b9e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:28.103883 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8739bc74-1c59-4859-aac1-81ac5029b9e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:28.107823 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8739bc74-1c59-4859-aac1-81ac5029b9e1 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:28.133627 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 816/1626] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:52:28.138967 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381dac7-5760-4770-853b-846f6b1a663b None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:28.139434 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381dac7-5760-4770-853b-846f6b1a663b None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:28.139892 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381dac7-5760-4770-853b-846f6b1a663b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:28.156823 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 811/1627] 10.222.0.69 () {58 vars in 1009 bytes} [Thu Sep 8 13:52:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:52:28.167088 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1681cd-d8e7-4c45-bfe1-5ab40c9b0a68 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:28.222424 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-a381dac7-5760-4770-853b-846f6b1a663b None None] MFA Rules not processed for user `c95448c1b8b1466cae37fda5c713d53f`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:28.226142 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1681cd-d8e7-4c45-bfe1-5ab40c9b0a68 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:28.229331 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-a381dac7-5760-4770-853b-846f6b1a663b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:28.243925 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c652c-03f1-47e2-8ca6-151d36a5093d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:28.247378 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c652c-03f1-47e2-8ca6-151d36a5093d admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:28.247378 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c652c-03f1-47e2-8ca6-151d36a5093d admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:28.247378 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c652c-03f1-47e2-8ca6-151d36a5093d admin admin] PATH_INFO: `/v3/projects/4274b8134d8947b2af1772b79aa9433e/users/3cd1f5d04f3e46d4b0dd6bab1e5bf919/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:28.265345 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 817/1628] 10.222.0.69 () {58 vars in 1059 bytes} [Thu Sep 8 13:52:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:52:28.267243 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a381dac7-5760-4770-853b-846f6b1a663b None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:28.288334 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:28.295368 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c652c-03f1-47e2-8ca6-151d36a5093d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4274b8134d8947b2af1772b79aa9433e, user_id=3cd1f5d04f3e46d4b0dd6bab1e5bf919, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:28.298637 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a381dac7-5760-4770-853b-846f6b1a663b None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:28.306200 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c652c-03f1-47e2-8ca6-151d36a5093d admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:28.310316 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3297ab6b-6504-412b-b52f-74b3d081a982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:28.311521 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297ab6b-6504-412b-b52f-74b3d081a982 admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:28.312382 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297ab6b-6504-412b-b52f-74b3d081a982 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:28.312784 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3297ab6b-6504-412b-b52f-74b3d081a982 admin admin] PATH_INFO: `/v3/projects/0061be7e8e7b4ff4bff9c518ff9e6ea2/users/060be605ca2d45368705c3afa8d139cd/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:28.356242 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3297ab6b-6504-412b-b52f-74b3d081a982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0061be7e8e7b4ff4bff9c518ff9e6ea2, user_id=060be605ca2d45368705c3afa8d139cd, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:28.358136 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 812/1629] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:52:28 2022] PUT /identity/v3/projects/4274b8134d8947b2af1772b79aa9433e/users/3cd1f5d04f3e46d4b0dd6bab1e5bf919/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:52:28.359501 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c652c-03f1-47e2-8ca6-151d36a5093d admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:28.367823 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3297ab6b-6504-412b-b52f-74b3d081a982 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:28.421466 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 818/1630] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:52:28 2022] PUT /identity/v3/projects/0061be7e8e7b4ff4bff9c518ff9e6ea2/users/060be605ca2d45368705c3afa8d139cd/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:52:28.421466 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3297ab6b-6504-412b-b52f-74b3d081a982 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:28.527328 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c652c-03f1-47e2-8ca6-151d36a5093d admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:28.546056 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:28.658918 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5d468-b435-4307-bcf3-d55294cec880 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:28.660115 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5d468-b435-4307-bcf3-d55294cec880 service cinder] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:28.660698 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5d468-b435-4307-bcf3-d55294cec880 service cinder] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:28.661317 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5d468-b435-4307-bcf3-d55294cec880 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:28.665890 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3297ab6b-6504-412b-b52f-74b3d081a982 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:28.679713 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebecfdf-b02c-425d-bd62-4bc11050adf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:28.681712 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebecfdf-b02c-425d-bd62-4bc11050adf2 service nova] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:28.682376 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebecfdf-b02c-425d-bd62-4bc11050adf2 service nova] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:28.683001 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebecfdf-b02c-425d-bd62-4bc11050adf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:28.683587 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb5d468-b435-4307-bcf3-d55294cec880 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:28.687193 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb5d468-b435-4307-bcf3-d55294cec880 service cinder] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:28.803126 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 813/1631] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:52:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:52:28.803126 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5d468-b435-4307-bcf3-d55294cec880 service cinder] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:28.931428 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebecfdf-b02c-425d-bd62-4bc11050adf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:28.935579 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebecfdf-b02c-425d-bd62-4bc11050adf2 service nova] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:28.954526 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5d468-b435-4307-bcf3-d55294cec880 service cinder] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:28.966634 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2e4be-4efd-4586-b4c8-d0988b90db4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:28.967175 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2e4be-4efd-4586-b4c8-d0988b90db4d admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:28.967627 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2e4be-4efd-4586-b4c8-d0988b90db4d admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:28.968096 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2e4be-4efd-4586-b4c8-d0988b90db4d admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:28.969292 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb2e4be-4efd-4586-b4c8-d0988b90db4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:28.978624 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb2e4be-4efd-4586-b4c8-d0988b90db4d admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:28.994464 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 819/1632] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:52:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:52:29.041057 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebecfdf-b02c-425d-bd62-4bc11050adf2 service nova] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:29.050832 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 814/1633] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:52:29.053511 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2e4be-4efd-4586-b4c8-d0988b90db4d admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:29.061189 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebecfdf-b02c-425d-bd62-4bc11050adf2 service nova] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:29.075058 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c518c-21f4-4ef7-b9c8-b0dee2ab70b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:29.076776 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c518c-21f4-4ef7-b9c8-b0dee2ab70b5 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:29.077524 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c518c-21f4-4ef7-b9c8-b0dee2ab70b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:29.078187 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c518c-21f4-4ef7-b9c8-b0dee2ab70b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:29.081080 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1c518c-21f4-4ef7-b9c8-b0dee2ab70b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:29.086285 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1c518c-21f4-4ef7-b9c8-b0dee2ab70b5 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:29.115787 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 820/1634] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:52:29.117843 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2e4be-4efd-4586-b4c8-d0988b90db4d admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:29.128072 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c518c-21f4-4ef7-b9c8-b0dee2ab70b5 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:29.141309 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa7d06-66d5-492e-b404-49edd2107f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:29.142549 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa7d06-66d5-492e-b404-49edd2107f13 admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:29.143026 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa7d06-66d5-492e-b404-49edd2107f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:29.143528 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa7d06-66d5-492e-b404-49edd2107f13 admin admin] PATH_INFO: `/v3/projects/4274b8134d8947b2af1772b79aa9433e/users/3cd1f5d04f3e46d4b0dd6bab1e5bf919/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:29.149011 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa7d06-66d5-492e-b404-49edd2107f13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4274b8134d8947b2af1772b79aa9433e, user_id=3cd1f5d04f3e46d4b0dd6bab1e5bf919, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:29.155105 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa7d06-66d5-492e-b404-49edd2107f13 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:29.166704 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c518c-21f4-4ef7-b9c8-b0dee2ab70b5 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:29.182427 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 815/1635] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:52:29 2022] PUT /identity/v3/projects/4274b8134d8947b2af1772b79aa9433e/users/3cd1f5d04f3e46d4b0dd6bab1e5bf919/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:52:29.205184 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae9ed0-fb72-42e8-b0eb-14fd21eea705 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:29.205669 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae9ed0-fb72-42e8-b0eb-14fd21eea705 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:29.206197 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ae9ed0-fb72-42e8-b0eb-14fd21eea705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:29.322253 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-e0ae9ed0-fb72-42e8-b0eb-14fd21eea705 None None] MFA Rules not processed for user `3cd1f5d04f3e46d4b0dd6bab1e5bf919`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:29.327449 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-e0ae9ed0-fb72-42e8-b0eb-14fd21eea705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:29.410775 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b933fc83-62e8-471b-9466-0b7d02824591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:29.414932 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b933fc83-62e8-471b-9466-0b7d02824591 admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:29.417295 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b933fc83-62e8-471b-9466-0b7d02824591 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:29.418762 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b933fc83-62e8-471b-9466-0b7d02824591 admin admin] PATH_INFO: `/v3/projects/0061be7e8e7b4ff4bff9c518ff9e6ea2/users/060be605ca2d45368705c3afa8d139cd/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:29.428872 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b933fc83-62e8-471b-9466-0b7d02824591 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0061be7e8e7b4ff4bff9c518ff9e6ea2, user_id=060be605ca2d45368705c3afa8d139cd, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:29.446869 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b933fc83-62e8-471b-9466-0b7d02824591 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:29.478582 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:29.497803 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 821/1636] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:52:29 2022] PUT /identity/v3/projects/0061be7e8e7b4ff4bff9c518ff9e6ea2/users/060be605ca2d45368705c3afa8d139cd/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:52:29.520977 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63391fcb-a532-4710-94de-189f0ff247d1 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:29.522012 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63391fcb-a532-4710-94de-189f0ff247d1 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:29.522012 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63391fcb-a532-4710-94de-189f0ff247d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:29.617220 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 816/1637] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:29 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:52:29.638624 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae9ed0-fb72-42e8-b0eb-14fd21eea705 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:29.642429 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-63391fcb-a532-4710-94de-189f0ff247d1 None None] MFA Rules not processed for user `060be605ca2d45368705c3afa8d139cd`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:29.652406 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-63391fcb-a532-4710-94de-189f0ff247d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:29.773054 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:29.955801 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ae9ed0-fb72-42e8-b0eb-14fd21eea705 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:30.051632 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 822/1638] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:29 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 533 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:52:30.149072 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a0598-caee-42de-a955-2cce2b3e1fa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:30.151008 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a0598-caee-42de-a955-2cce2b3e1fa5 service cinder] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:30.151008 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a0598-caee-42de-a955-2cce2b3e1fa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:30.153207 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a0598-caee-42de-a955-2cce2b3e1fa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:30.315998 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61c681-5cb0-47cf-961b-72df3527d508 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:30.317853 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61c681-5cb0-47cf-961b-72df3527d508 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:30.319377 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61c681-5cb0-47cf-961b-72df3527d508 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:30.322588 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 823/1639] 10.222.0.69 () {54 vars in 912 bytes} [Thu Sep 8 13:52:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:52:30.355139 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21d9ac-8512-4898-b6a4-b1a515396a77 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:30.356220 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21d9ac-8512-4898-b6a4-b1a515396a77 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:30.356968 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21d9ac-8512-4898-b6a4-b1a515396a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:30.465114 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-5c21d9ac-8512-4898-b6a4-b1a515396a77 None None] MFA Rules not processed for user `c95448c1b8b1466cae37fda5c713d53f`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:30.477016 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-5c21d9ac-8512-4898-b6a4-b1a515396a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:30.648741 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a0598-caee-42de-a955-2cce2b3e1fa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:30.654643 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a0598-caee-42de-a955-2cce2b3e1fa5 service cinder] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:30.730393 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 817/1640] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:52:29 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 1095 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:52:30.861758 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 824/1641] 10.222.0.69 () {58 vars in 1009 bytes} [Thu Sep 8 13:52:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 509 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:52:30.901966 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a0598-caee-42de-a955-2cce2b3e1fa5 service cinder] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:30.932818 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a0598-caee-42de-a955-2cce2b3e1fa5 service cinder] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:30.946334 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd17634-cf92-431b-862c-0ad6bd517540 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:30.949032 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd17634-cf92-431b-862c-0ad6bd517540 service cinder] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:30.949032 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd17634-cf92-431b-862c-0ad6bd517540 service cinder] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:30.949490 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd17634-cf92-431b-862c-0ad6bd517540 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:30.978095 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd17634-cf92-431b-862c-0ad6bd517540 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:30.981004 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd17634-cf92-431b-862c-0ad6bd517540 service cinder] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:31.025842 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 818/1642] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:52:30 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:52:31.058109 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21d9ac-8512-4898-b6a4-b1a515396a77 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:31.103783 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21d9ac-8512-4898-b6a4-b1a515396a77 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:31.111945 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881476fc-5bff-4107-8faa-8b2e787cbd8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:31.115070 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881476fc-5bff-4107-8faa-8b2e787cbd8b service cinder] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:31.115783 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881476fc-5bff-4107-8faa-8b2e787cbd8b service cinder] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:31.116381 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881476fc-5bff-4107-8faa-8b2e787cbd8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:31.143202 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881476fc-5bff-4107-8faa-8b2e787cbd8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:31.146749 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881476fc-5bff-4107-8faa-8b2e787cbd8b service cinder] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:31.182235 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 825/1643] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:52:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:52:31.527388 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd17634-cf92-431b-862c-0ad6bd517540 service cinder] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:31.578716 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd17634-cf92-431b-862c-0ad6bd517540 service cinder] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:31.608758 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66507612-cca7-4b3e-8f3c-a08992f60272 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:31.609960 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66507612-cca7-4b3e-8f3c-a08992f60272 service cinder] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:31.610705 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66507612-cca7-4b3e-8f3c-a08992f60272 service cinder] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:31.616454 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66507612-cca7-4b3e-8f3c-a08992f60272 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:31.871360 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66507612-cca7-4b3e-8f3c-a08992f60272 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:31.873826 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66507612-cca7-4b3e-8f3c-a08992f60272 service cinder] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:31.896173 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 819/1644] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:52:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:52:32.137117 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881476fc-5bff-4107-8faa-8b2e787cbd8b service cinder] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:32.322156 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881476fc-5bff-4107-8faa-8b2e787cbd8b service cinder] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:32.331899 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a7572e-14a7-4187-ac09-333e6ef1761e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:32.333443 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7572e-14a7-4187-ac09-333e6ef1761e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:32.333853 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7572e-14a7-4187-ac09-333e6ef1761e admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:32.334311 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7572e-14a7-4187-ac09-333e6ef1761e admin admin] PATH_INFO: `/v3/users/2e88a2bf092b45faa9260f9f3f6d00d7` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:32.335915 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a7572e-14a7-4187-ac09-333e6ef1761e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e88a2bf092b45faa9260f9f3f6d00d7)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:32.339997 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a7572e-14a7-4187-ac09-333e6ef1761e admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:32.350950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:32.482760 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-35a7572e-14a7-4187-ac09-333e6ef1761e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e88a2bf092b45faa9260f9f3f6d00d7'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:32.487846 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-35a7572e-14a7-4187-ac09-333e6ef1761e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e88a2bf092b45faa9260f9f3f6d00d7'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:32.491512 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-35a7572e-14a7-4187-ac09-333e6ef1761e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e88a2bf092b45faa9260f9f3f6d00d7'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:32.541324 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-35a7572e-14a7-4187-ac09-333e6ef1761e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e88a2bf092b45faa9260f9f3f6d00d7'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:32.616954 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-35a7572e-14a7-4187-ac09-333e6ef1761e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e88a2bf092b45faa9260f9f3f6d00d7'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:32.662549 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 826/1645] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:52:32 2022] DELETE /identity/v3/users/2e88a2bf092b45faa9260f9f3f6d00d7 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:52:32.669303 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b56471-8071-47a0-a0b1-d6bd77d909f0 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:32.670045 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b56471-8071-47a0-a0b1-d6bd77d909f0 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:32.670527 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b56471-8071-47a0-a0b1-d6bd77d909f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:32.754512 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-d1b56471-8071-47a0-a0b1-d6bd77d909f0 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:32.760471 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-d1b56471-8071-47a0-a0b1-d6bd77d909f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:32.786716 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:33.079366 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 820/1646] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:52:33.098075 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a7572e-14a7-4187-ac09-333e6ef1761e admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:33.100998 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-35a7572e-14a7-4187-ac09-333e6ef1761e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:33.272393 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b56471-8071-47a0-a0b1-d6bd77d909f0 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:33.275441 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-d1b56471-8071-47a0-a0b1-d6bd77d909f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:33.332313 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b56471-8071-47a0-a0b1-d6bd77d909f0 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:33.356429 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ed78d-02b9-4c0d-806e-322c016fc86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:33.359423 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ed78d-02b9-4c0d-806e-322c016fc86a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:33.362960 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ed78d-02b9-4c0d-806e-322c016fc86a admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:33.366202 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949ed78d-02b9-4c0d-806e-322c016fc86a admin admin] PATH_INFO: `/v3/users/5e3d1b6cc12b44fa937d90f8c9f92034` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:33.371546 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ed78d-02b9-4c0d-806e-322c016fc86a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e3d1b6cc12b44fa937d90f8c9f92034)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:33.374048 dv-cinder-856463-2-smb devstack@keystone.service[88208]: WARNING py.warnings [None req-949ed78d-02b9-4c0d-806e-322c016fc86a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 13:52:33.374048 dv-cinder-856463-2-smb devstack@keystone.service[88208]: warnings.warn(msg) Sep 08 13:52:33.374048 dv-cinder-856463-2-smb devstack@keystone.service[88208]: Sep 08 13:52:33.404645 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a7572e-14a7-4187-ac09-333e6ef1761e admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:33.412329 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949ed78d-02b9-4c0d-806e-322c016fc86a admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:33.418008 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e4adb-b137-4adf-8dcb-2d9b72500078 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:33.419536 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e4adb-b137-4adf-8dcb-2d9b72500078 service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:33.422340 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e4adb-b137-4adf-8dcb-2d9b72500078 service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:33.423135 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e4adb-b137-4adf-8dcb-2d9b72500078 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:33.460089 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2e4adb-b137-4adf-8dcb-2d9b72500078 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:33.463268 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2e4adb-b137-4adf-8dcb-2d9b72500078 service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:33.487938 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 827/1647] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:52:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:52:33.607808 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-949ed78d-02b9-4c0d-806e-322c016fc86a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e3d1b6cc12b44fa937d90f8c9f92034'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:33.608929 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-949ed78d-02b9-4c0d-806e-322c016fc86a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e3d1b6cc12b44fa937d90f8c9f92034'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:33.640192 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-949ed78d-02b9-4c0d-806e-322c016fc86a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e3d1b6cc12b44fa937d90f8c9f92034'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:33.727424 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-949ed78d-02b9-4c0d-806e-322c016fc86a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e3d1b6cc12b44fa937d90f8c9f92034'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:33.728648 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-949ed78d-02b9-4c0d-806e-322c016fc86a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e3d1b6cc12b44fa937d90f8c9f92034'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:33.771109 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 821/1648] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:52:33 2022] DELETE /identity/v3/users/5e3d1b6cc12b44fa937d90f8c9f92034 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:52:33.779629 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2eb4a3-170f-4df4-b672-10406d873dee None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:33.780362 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2eb4a3-170f-4df4-b672-10406d873dee None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:33.781071 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2eb4a3-170f-4df4-b672-10406d873dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:33.872270 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-4a2eb4a3-170f-4df4-b672-10406d873dee None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:33.874874 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-4a2eb4a3-170f-4df4-b672-10406d873dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:34.061689 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 828/1649] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:52:34.223104 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ed78d-02b9-4c0d-806e-322c016fc86a admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:34.227211 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-949ed78d-02b9-4c0d-806e-322c016fc86a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:34.491592 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949ed78d-02b9-4c0d-806e-322c016fc86a admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:34.505438 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d6bd77-781b-4ab2-abf8-1832cc2b3fc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:34.506691 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6bd77-781b-4ab2-abf8-1832cc2b3fc6 service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:34.507188 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6bd77-781b-4ab2-abf8-1832cc2b3fc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:34.507617 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d6bd77-781b-4ab2-abf8-1832cc2b3fc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:34.535041 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6bd77-781b-4ab2-abf8-1832cc2b3fc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:34.539580 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d6bd77-781b-4ab2-abf8-1832cc2b3fc6 service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:34.596884 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 822/1650] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:52:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:52:36.419070 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2eb4a3-170f-4df4-b672-10406d873dee None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:36.419881 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-4a2eb4a3-170f-4df4-b672-10406d873dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:36.492607 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2eb4a3-170f-4df4-b672-10406d873dee None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:36.515238 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96620434-e4cf-4976-916f-68f6128f4de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:36.516090 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96620434-e4cf-4976-916f-68f6128f4de1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:36.516418 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96620434-e4cf-4976-916f-68f6128f4de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:36.517805 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96620434-e4cf-4976-916f-68f6128f4de1 admin admin] PATH_INFO: `/v3/projects/c546b6e940da4042914f16dcf53977d5` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:36.525218 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96620434-e4cf-4976-916f-68f6128f4de1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c546b6e940da4042914f16dcf53977d5)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:36.529243 dv-cinder-856463-2-smb devstack@keystone.service[88207]: WARNING py.warnings [None req-96620434-e4cf-4976-916f-68f6128f4de1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 08 13:52:36.529243 dv-cinder-856463-2-smb devstack@keystone.service[88207]: warnings.warn(msg) Sep 08 13:52:36.529243 dv-cinder-856463-2-smb devstack@keystone.service[88207]: Sep 08 13:52:36.540228 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96620434-e4cf-4976-916f-68f6128f4de1 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:36.668050 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:36.848082 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-96620434-e4cf-4976-916f-68f6128f4de1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c546b6e940da4042914f16dcf53977d5', 'request_id': 'req-96620434-e4cf-4976-916f-68f6128f4de1'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:36.883049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-96620434-e4cf-4976-916f-68f6128f4de1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c546b6e940da4042914f16dcf53977d5', 'request_id': 'req-96620434-e4cf-4976-916f-68f6128f4de1'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:36.949627 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-96620434-e4cf-4976-916f-68f6128f4de1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c546b6e940da4042914f16dcf53977d5', 'request_id': 'req-96620434-e4cf-4976-916f-68f6128f4de1'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:36.993841 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-96620434-e4cf-4976-916f-68f6128f4de1 admin admin] The token cache is being invalidate because project c546b6e940da4042914f16dcf53977d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:52:36.994371 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-96620434-e4cf-4976-916f-68f6128f4de1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:36.999073 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-96620434-e4cf-4976-916f-68f6128f4de1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:37.008115 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 829/1651] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:52:36 2022] DELETE /identity/v3/projects/c546b6e940da4042914f16dcf53977d5 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:52:37.016993 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390636b-6de2-4934-a906-135064bc4581 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:37.017817 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390636b-6de2-4934-a906-135064bc4581 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:37.018025 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390636b-6de2-4934-a906-135064bc4581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:37.107535 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-d390636b-6de2-4934-a906-135064bc4581 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:37.115321 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-d390636b-6de2-4934-a906-135064bc4581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:37.283034 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:37.486701 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 823/1652] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 472 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:52:37.509657 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a75082-f20f-4640-990a-be3e9d5d5a1c None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:37.511735 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a75082-f20f-4640-990a-be3e9d5d5a1c None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:37.512478 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a75082-f20f-4640-990a-be3e9d5d5a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:37.609723 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-11a75082-f20f-4640-990a-be3e9d5d5a1c None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:37.612491 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-11a75082-f20f-4640-990a-be3e9d5d5a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:37.657570 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 830/1653] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:52:37.664079 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390636b-6de2-4934-a906-135064bc4581 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:37.711025 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390636b-6de2-4934-a906-135064bc4581 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:37.736857 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e0b85-b84b-47c4-987e-1960b826507f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:37.737586 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e0b85-b84b-47c4-987e-1960b826507f admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:37.738165 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e0b85-b84b-47c4-987e-1960b826507f admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:37.740897 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e0b85-b84b-47c4-987e-1960b826507f admin admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:37.746290 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e0b85-b84b-47c4-987e-1960b826507f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:52:37.747285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e0b85-b84b-47c4-987e-1960b826507f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:37.755803 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e0b85-b84b-47c4-987e-1960b826507f admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:37.818089 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a75082-f20f-4640-990a-be3e9d5d5a1c None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:37.820894 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-11a75082-f20f-4640-990a-be3e9d5d5a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:37.828537 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 824/1654] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 13:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:52:37.835933 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e0b85-b84b-47c4-987e-1960b826507f admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:37.906610 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a75082-f20f-4640-990a-be3e9d5d5a1c None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:37.915492 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e0b85-b84b-47c4-987e-1960b826507f admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:37.949839 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326afa4-8fa2-4404-b83e-8bdc8c0a4f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:37.954389 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326afa4-8fa2-4404-b83e-8bdc8c0a4f8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:37.954935 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326afa4-8fa2-4404-b83e-8bdc8c0a4f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:37.955379 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326afa4-8fa2-4404-b83e-8bdc8c0a4f8a admin admin] PATH_INFO: `/v3/users/ab0ba4d47e3b444291b113fd6ca85bd6` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:37.962827 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980237c-0e6c-4ee0-b8ef-1fab456ca104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:37.963691 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980237c-0e6c-4ee0-b8ef-1fab456ca104 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:37.964118 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980237c-0e6c-4ee0-b8ef-1fab456ca104 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:37.964467 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980237c-0e6c-4ee0-b8ef-1fab456ca104 admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:37.965333 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980237c-0e6c-4ee0-b8ef-1fab456ca104 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:37.977973 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8326afa4-8fa2-4404-b83e-8bdc8c0a4f8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab0ba4d47e3b444291b113fd6ca85bd6)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:37.988544 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980237c-0e6c-4ee0-b8ef-1fab456ca104 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:37.996959 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8326afa4-8fa2-4404-b83e-8bdc8c0a4f8a admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:38.229353 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 825/1655] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:52:37 2022] POST /identity/v3/projects => generated 405 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:52:38.232064 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980237c-0e6c-4ee0-b8ef-1fab456ca104 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:38.411684 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-8326afa4-8fa2-4404-b83e-8bdc8c0a4f8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab0ba4d47e3b444291b113fd6ca85bd6'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:38.418334 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-8326afa4-8fa2-4404-b83e-8bdc8c0a4f8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab0ba4d47e3b444291b113fd6ca85bd6'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:38.420668 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-8326afa4-8fa2-4404-b83e-8bdc8c0a4f8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab0ba4d47e3b444291b113fd6ca85bd6'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:38.466219 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-8326afa4-8fa2-4404-b83e-8bdc8c0a4f8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab0ba4d47e3b444291b113fd6ca85bd6'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:38.522597 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-8326afa4-8fa2-4404-b83e-8bdc8c0a4f8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab0ba4d47e3b444291b113fd6ca85bd6'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:38.605244 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980237c-0e6c-4ee0-b8ef-1fab456ca104 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:38.626388 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 831/1656] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:52:37 2022] DELETE /identity/v3/users/ab0ba4d47e3b444291b113fd6ca85bd6 => generated 0 bytes in 804 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:52:38.626388 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326afa4-8fa2-4404-b83e-8bdc8c0a4f8a admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:38.633631 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-8326afa4-8fa2-4404-b83e-8bdc8c0a4f8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:38.868459 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff242d-a319-40b4-affe-4a5f6a0a4831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:38.880559 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff242d-a319-40b4-affe-4a5f6a0a4831 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:38.880559 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff242d-a319-40b4-affe-4a5f6a0a4831 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:38.881064 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff242d-a319-40b4-affe-4a5f6a0a4831 admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:38.885858 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff242d-a319-40b4-affe-4a5f6a0a4831 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:38.893688 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff242d-a319-40b4-affe-4a5f6a0a4831 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:38.900849 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326afa4-8fa2-4404-b83e-8bdc8c0a4f8a admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:38.953728 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea24f24-19d1-4aab-a84b-08891f1cdda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:38.956691 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea24f24-19d1-4aab-a84b-08891f1cdda4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:38.958166 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea24f24-19d1-4aab-a84b-08891f1cdda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:38.959180 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea24f24-19d1-4aab-a84b-08891f1cdda4 admin admin] PATH_INFO: `/v3/users/8c04792ec08549dd93c8d304392bb334` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:38.965120 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea24f24-19d1-4aab-a84b-08891f1cdda4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c04792ec08549dd93c8d304392bb334)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:38.985098 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea24f24-19d1-4aab-a84b-08891f1cdda4 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:38.997213 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 826/1657] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:52:38 2022] POST /identity/v3/users => generated 303 bytes in 766 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:52:38.999699 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad0ede-172c-4a97-b4dd-d80c72d0c8ec None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:39.000178 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad0ede-172c-4a97-b4dd-d80c72d0c8ec None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:39.000673 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad0ede-172c-4a97-b4dd-d80c72d0c8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:39.063915 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-ddad0ede-172c-4a97-b4dd-d80c72d0c8ec None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:39.066494 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-ddad0ede-172c-4a97-b4dd-d80c72d0c8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:39.099658 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:39.118942 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 827/1658] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:52:39.120647 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad0ede-172c-4a97-b4dd-d80c72d0c8ec None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:39.123821 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-ddad0ede-172c-4a97-b4dd-d80c72d0c8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:39.182340 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad0ede-172c-4a97-b4dd-d80c72d0c8ec None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:39.195092 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e1efd-8669-4edd-b040-6598b99b67f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:39.196575 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e1efd-8669-4edd-b040-6598b99b67f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:39.197071 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e1efd-8669-4edd-b040-6598b99b67f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:39.197732 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e1efd-8669-4edd-b040-6598b99b67f2 admin admin] PATH_INFO: `/v3/projects/aafc5110197d4fdfa11191dd477d68f1` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:39.201547 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66e1efd-8669-4edd-b040-6598b99b67f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aafc5110197d4fdfa11191dd477d68f1)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:39.205635 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66e1efd-8669-4edd-b040-6598b99b67f2 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:39.270767 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-8ea24f24-19d1-4aab-a84b-08891f1cdda4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c04792ec08549dd93c8d304392bb334'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:39.272593 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-8ea24f24-19d1-4aab-a84b-08891f1cdda4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c04792ec08549dd93c8d304392bb334'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:39.294206 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-8ea24f24-19d1-4aab-a84b-08891f1cdda4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c04792ec08549dd93c8d304392bb334'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:39.316328 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-8ea24f24-19d1-4aab-a84b-08891f1cdda4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c04792ec08549dd93c8d304392bb334'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:39.324753 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:39.369095 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-8ea24f24-19d1-4aab-a84b-08891f1cdda4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c04792ec08549dd93c8d304392bb334'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:39.420806 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 832/1659] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:52:38 2022] DELETE /identity/v3/users/8c04792ec08549dd93c8d304392bb334 => generated 0 bytes in 799 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:52:39.422371 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea24f24-19d1-4aab-a84b-08891f1cdda4 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:39.423297 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-b66e1efd-8669-4edd-b040-6598b99b67f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aafc5110197d4fdfa11191dd477d68f1', 'request_id': 'req-b66e1efd-8669-4edd-b040-6598b99b67f2'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:39.431641 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-8ea24f24-19d1-4aab-a84b-08891f1cdda4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:39.451984 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-b66e1efd-8669-4edd-b040-6598b99b67f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aafc5110197d4fdfa11191dd477d68f1', 'request_id': 'req-b66e1efd-8669-4edd-b040-6598b99b67f2'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:39.490083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-b66e1efd-8669-4edd-b040-6598b99b67f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aafc5110197d4fdfa11191dd477d68f1', 'request_id': 'req-b66e1efd-8669-4edd-b040-6598b99b67f2'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:39.554271 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-b66e1efd-8669-4edd-b040-6598b99b67f2 admin admin] The token cache is being invalidate because project aafc5110197d4fdfa11191dd477d68f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:52:39.555089 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-b66e1efd-8669-4edd-b040-6598b99b67f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:39.561710 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-b66e1efd-8669-4edd-b040-6598b99b67f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:39.572276 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 828/1660] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:52:39 2022] DELETE /identity/v3/projects/aafc5110197d4fdfa11191dd477d68f1 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:52:39.574176 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e1efd-8669-4edd-b040-6598b99b67f2 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:39.585881 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-b66e1efd-8669-4edd-b040-6598b99b67f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:39.675538 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea24f24-19d1-4aab-a84b-08891f1cdda4 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:39.699844 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e6b05-3767-48d2-ba7c-0bfa3781aaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:39.701071 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e6b05-3767-48d2-ba7c-0bfa3781aaba admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:39.701560 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e6b05-3767-48d2-ba7c-0bfa3781aaba admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:39.701884 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e6b05-3767-48d2-ba7c-0bfa3781aaba admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:39.703188 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9e6b05-3767-48d2-ba7c-0bfa3781aaba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:39.717897 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9e6b05-3767-48d2-ba7c-0bfa3781aaba admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:39.768047 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 833/1661] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:52:39.771969 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30552f67-40f0-4b9b-8e3b-584549b09651 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:39.772355 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30552f67-40f0-4b9b-8e3b-584549b09651 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:39.772790 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30552f67-40f0-4b9b-8e3b-584549b09651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:39.855054 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-30552f67-40f0-4b9b-8e3b-584549b09651 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:39.875623 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e1efd-8669-4edd-b040-6598b99b67f2 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:39.879098 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-30552f67-40f0-4b9b-8e3b-584549b09651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:39.917178 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 834/1662] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:52:39.918954 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30552f67-40f0-4b9b-8e3b-584549b09651 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:39.924852 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-30552f67-40f0-4b9b-8e3b-584549b09651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:39.979322 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30552f67-40f0-4b9b-8e3b-584549b09651 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:40.004320 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a53953-bd7d-406c-83e3-daf9c6a15a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:40.007770 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a53953-bd7d-406c-83e3-daf9c6a15a9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:40.008263 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a53953-bd7d-406c-83e3-daf9c6a15a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:40.013430 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a53953-bd7d-406c-83e3-daf9c6a15a9e admin admin] PATH_INFO: `/v3/users/060be605ca2d45368705c3afa8d139cd` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:40.021048 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a53953-bd7d-406c-83e3-daf9c6a15a9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=060be605ca2d45368705c3afa8d139cd)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:40.032638 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a53953-bd7d-406c-83e3-daf9c6a15a9e admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:40.232243 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2d27e-975c-48be-81ed-3a86b70a74db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:40.233523 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2d27e-975c-48be-81ed-3a86b70a74db service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:40.234076 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2d27e-975c-48be-81ed-3a86b70a74db service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:40.239869 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2d27e-975c-48be-81ed-3a86b70a74db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:40.243918 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-94a53953-bd7d-406c-83e3-daf9c6a15a9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '060be605ca2d45368705c3afa8d139cd'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:40.245122 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-94a53953-bd7d-406c-83e3-daf9c6a15a9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '060be605ca2d45368705c3afa8d139cd'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:40.246498 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-94a53953-bd7d-406c-83e3-daf9c6a15a9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '060be605ca2d45368705c3afa8d139cd'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:40.248780 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-c2f2d27e-975c-48be-81ed-3a86b70a74db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:40.275728 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-94a53953-bd7d-406c-83e3-daf9c6a15a9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '060be605ca2d45368705c3afa8d139cd'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:40.340197 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2d27e-975c-48be-81ed-3a86b70a74db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:40.346890 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-94a53953-bd7d-406c-83e3-daf9c6a15a9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '060be605ca2d45368705c3afa8d139cd'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:40.358086 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:40.371347 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2d27e-975c-48be-81ed-3a86b70a74db service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:40.422771 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 835/1663] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:52:39 2022] DELETE /identity/v3/users/060be605ca2d45368705c3afa8d139cd => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:52:40.424577 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a53953-bd7d-406c-83e3-daf9c6a15a9e admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:40.429242 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-94a53953-bd7d-406c-83e3-daf9c6a15a9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:40.532187 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 829/1664] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:52:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 959 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:52:40.533523 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2d27e-975c-48be-81ed-3a86b70a74db service neutron] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:40.555840 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-c2f2d27e-975c-48be-81ed-3a86b70a74db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:40.643316 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2d27e-975c-48be-81ed-3a86b70a74db service neutron] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:40.679463 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a53953-bd7d-406c-83e3-daf9c6a15a9e admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:40.710229 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4307a2-1c47-49c8-913e-7b55d4f75b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:40.711475 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4307a2-1c47-49c8-913e-7b55d4f75b02 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:40.715646 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4307a2-1c47-49c8-913e-7b55d4f75b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:40.719713 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4307a2-1c47-49c8-913e-7b55d4f75b02 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:40.723907 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4307a2-1c47-49c8-913e-7b55d4f75b02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:40.733835 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4307a2-1c47-49c8-913e-7b55d4f75b02 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:40.794129 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 836/1665] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:52:40.803190 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4307a2-1c47-49c8-913e-7b55d4f75b02 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:40.874672 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4307a2-1c47-49c8-913e-7b55d4f75b02 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:40.896352 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41698320-fcee-4262-b7e0-ef331febacea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:40.897920 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41698320-fcee-4262-b7e0-ef331febacea service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:40.903080 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f1a2e-bc73-44e5-9020-96ab5e7e08ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:40.908027 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41698320-fcee-4262-b7e0-ef331febacea service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:40.908872 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41698320-fcee-4262-b7e0-ef331febacea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:40.909589 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f1a2e-bc73-44e5-9020-96ab5e7e08ee admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:40.910230 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f1a2e-bc73-44e5-9020-96ab5e7e08ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:40.911770 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f1a2e-bc73-44e5-9020-96ab5e7e08ee admin admin] PATH_INFO: `/v3/projects/eabe33b675904309a011e1490f3aef35/users/c13fe47bf03e4379840b6f20a47cde3a/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:40.914880 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-41698320-fcee-4262-b7e0-ef331febacea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:41.011296 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41698320-fcee-4262-b7e0-ef331febacea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:41.014632 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41698320-fcee-4262-b7e0-ef331febacea service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:41.041207 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 830/1666] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:52:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:52:41.067976 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7f1a2e-bc73-44e5-9020-96ab5e7e08ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=eabe33b675904309a011e1490f3aef35, user_id=c13fe47bf03e4379840b6f20a47cde3a, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:41.089692 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7f1a2e-bc73-44e5-9020-96ab5e7e08ee admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:41.159317 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 837/1667] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:52:40 2022] PUT /identity/v3/projects/eabe33b675904309a011e1490f3aef35/users/c13fe47bf03e4379840b6f20a47cde3a/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:52:41.185943 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eda3bf-a110-493e-9be1-26c70143cf6e None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:41.186860 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eda3bf-a110-493e-9be1-26c70143cf6e None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:41.187581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eda3bf-a110-493e-9be1-26c70143cf6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:41.351773 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:41.398194 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-19eda3bf-a110-493e-9be1-26c70143cf6e None None] MFA Rules not processed for user `c13fe47bf03e4379840b6f20a47cde3a`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:41.411020 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-19eda3bf-a110-493e-9be1-26c70143cf6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:41.902105 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 831/1668] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:41 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 720 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:52:41.911795 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f1a2e-bc73-44e5-9020-96ab5e7e08ee admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:42.189303 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f1a2e-bc73-44e5-9020-96ab5e7e08ee admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:42.217416 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79da0bd-14fe-4422-8d8e-8edc87637a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:42.221752 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79da0bd-14fe-4422-8d8e-8edc87637a23 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:42.222235 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79da0bd-14fe-4422-8d8e-8edc87637a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:42.222719 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79da0bd-14fe-4422-8d8e-8edc87637a23 admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:42.226864 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79da0bd-14fe-4422-8d8e-8edc87637a23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:42.230884 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79da0bd-14fe-4422-8d8e-8edc87637a23 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:42.340736 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 838/1669] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:52:41 2022] POST /identity/v3/projects => generated 403 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:52:42.350347 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eda3bf-a110-493e-9be1-26c70143cf6e None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:42.387456 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eda3bf-a110-493e-9be1-26c70143cf6e None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:42.686348 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec389b0-aab9-4545-8270-fe45a2cc19e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:42.691834 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec389b0-aab9-4545-8270-fe45a2cc19e3 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:42.692388 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec389b0-aab9-4545-8270-fe45a2cc19e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:42.694180 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec389b0-aab9-4545-8270-fe45a2cc19e3 admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:42.695268 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec389b0-aab9-4545-8270-fe45a2cc19e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:42.706693 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec389b0-aab9-4545-8270-fe45a2cc19e3 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:42.779062 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 832/1670] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:52:42 2022] POST /identity/v3/users => generated 308 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:52:42.786419 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79da0bd-14fe-4422-8d8e-8edc87637a23 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:42.825721 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79da0bd-14fe-4422-8d8e-8edc87637a23 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:42.854978 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13be712-5239-4a75-8815-e527c8bb4610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:42.856254 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13be712-5239-4a75-8815-e527c8bb4610 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:42.857939 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13be712-5239-4a75-8815-e527c8bb4610 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:42.858789 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13be712-5239-4a75-8815-e527c8bb4610 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:42.860321 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13be712-5239-4a75-8815-e527c8bb4610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:42.866144 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13be712-5239-4a75-8815-e527c8bb4610 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:42.902720 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 839/1671] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:52:42.908606 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec389b0-aab9-4545-8270-fe45a2cc19e3 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:42.934730 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec389b0-aab9-4545-8270-fe45a2cc19e3 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:42.958985 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943eaca-ed39-439a-be3e-0f183a690219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:42.960184 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943eaca-ed39-439a-be3e-0f183a690219 admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:42.960622 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943eaca-ed39-439a-be3e-0f183a690219 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:42.961724 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943eaca-ed39-439a-be3e-0f183a690219 admin admin] PATH_INFO: `/v3/projects/b8dc108869c347b3aaee40967202daf7/users/98bcaa3b1f464ab6aab50396aa18ff78/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:43.011073 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0943eaca-ed39-439a-be3e-0f183a690219 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8dc108869c347b3aaee40967202daf7, user_id=98bcaa3b1f464ab6aab50396aa18ff78, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:43.016601 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0943eaca-ed39-439a-be3e-0f183a690219 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:43.067684 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13be712-5239-4a75-8815-e527c8bb4610 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:43.079704 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 833/1672] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:52:42 2022] PUT /identity/v3/projects/b8dc108869c347b3aaee40967202daf7/users/98bcaa3b1f464ab6aab50396aa18ff78/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:52:43.105555 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13be712-5239-4a75-8815-e527c8bb4610 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:43.335972 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:43.413531 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dedcec-c1b3-463f-b647-f553e24dee39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:43.413531 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dedcec-c1b3-463f-b647-f553e24dee39 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:43.414698 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dedcec-c1b3-463f-b647-f553e24dee39 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:43.415484 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dedcec-c1b3-463f-b647-f553e24dee39 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:43.424138 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dedcec-c1b3-463f-b647-f553e24dee39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:43.440292 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dedcec-c1b3-463f-b647-f553e24dee39 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:43.492377 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 840/1673] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 13:52:43.499032 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943eaca-ed39-439a-be3e-0f183a690219 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:43.534247 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943eaca-ed39-439a-be3e-0f183a690219 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:43.554722 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412dd424-a5d5-4732-8b7d-c059804407fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:43.555921 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412dd424-a5d5-4732-8b7d-c059804407fb admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:43.556431 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412dd424-a5d5-4732-8b7d-c059804407fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:43.556925 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412dd424-a5d5-4732-8b7d-c059804407fb admin admin] PATH_INFO: `/v3/projects/b8dc108869c347b3aaee40967202daf7/users/98bcaa3b1f464ab6aab50396aa18ff78/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:43.565345 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412dd424-a5d5-4732-8b7d-c059804407fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8dc108869c347b3aaee40967202daf7, user_id=98bcaa3b1f464ab6aab50396aa18ff78, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:43.580609 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412dd424-a5d5-4732-8b7d-c059804407fb admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:43.638023 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 834/1674] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:52:43 2022] PUT /identity/v3/projects/b8dc108869c347b3aaee40967202daf7/users/98bcaa3b1f464ab6aab50396aa18ff78/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:52:43.650932 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed78a7f-721d-4232-b553-9a6bab82c0d5 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:43.651406 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed78a7f-721d-4232-b553-9a6bab82c0d5 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:43.651896 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed78a7f-721d-4232-b553-9a6bab82c0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:43.760230 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-8ed78a7f-721d-4232-b553-9a6bab82c0d5 None None] MFA Rules not processed for user `98bcaa3b1f464ab6aab50396aa18ff78`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:43.763177 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-8ed78a7f-721d-4232-b553-9a6bab82c0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:44.075133 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 841/1675] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:43 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:52:44.099994 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412dd424-a5d5-4732-8b7d-c059804407fb admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:44.104055 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-412dd424-a5d5-4732-8b7d-c059804407fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:44.413988 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412dd424-a5d5-4732-8b7d-c059804407fb admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:44.437943 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11becdb-93b4-4f32-8fdb-70596f72bf83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:44.441734 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11becdb-93b4-4f32-8fdb-70596f72bf83 service cinder] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:44.442140 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11becdb-93b4-4f32-8fdb-70596f72bf83 service cinder] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:44.442581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11becdb-93b4-4f32-8fdb-70596f72bf83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:44.460810 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:44.470358 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11becdb-93b4-4f32-8fdb-70596f72bf83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:44.493726 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11becdb-93b4-4f32-8fdb-70596f72bf83 service cinder] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:44.553502 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 835/1676] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:52:44 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:52:44.934936 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed78a7f-721d-4232-b553-9a6bab82c0d5 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:44.940153 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-8ed78a7f-721d-4232-b553-9a6bab82c0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:45.037726 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11becdb-93b4-4f32-8fdb-70596f72bf83 service cinder] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:45.313946 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11becdb-93b4-4f32-8fdb-70596f72bf83 service cinder] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:45.327395 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b344c46-c107-4967-bc89-33ea6b12cff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:45.330424 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b344c46-c107-4967-bc89-33ea6b12cff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:45.331170 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b344c46-c107-4967-bc89-33ea6b12cff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:45.331861 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b344c46-c107-4967-bc89-33ea6b12cff2 admin admin] PATH_INFO: `/v3/users/c13fe47bf03e4379840b6f20a47cde3a` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:45.336337 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b344c46-c107-4967-bc89-33ea6b12cff2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c13fe47bf03e4379840b6f20a47cde3a)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:45.341648 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed78a7f-721d-4232-b553-9a6bab82c0d5 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:45.343988 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b344c46-c107-4967-bc89-33ea6b12cff2 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:45.374715 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55264680-1c69-411c-8301-3dd6090ec758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:45.375834 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55264680-1c69-411c-8301-3dd6090ec758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:45.376325 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55264680-1c69-411c-8301-3dd6090ec758 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:45.376691 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55264680-1c69-411c-8301-3dd6090ec758 admin admin] PATH_INFO: `/v3/projects/0061be7e8e7b4ff4bff9c518ff9e6ea2` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:45.386043 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55264680-1c69-411c-8301-3dd6090ec758 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0061be7e8e7b4ff4bff9c518ff9e6ea2)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:45.389577 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55264680-1c69-411c-8301-3dd6090ec758 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:45.586673 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-1b344c46-c107-4967-bc89-33ea6b12cff2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c13fe47bf03e4379840b6f20a47cde3a'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:45.601680 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-55264680-1c69-411c-8301-3dd6090ec758 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0061be7e8e7b4ff4bff9c518ff9e6ea2', 'request_id': 'req-55264680-1c69-411c-8301-3dd6090ec758'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:45.607824 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-1b344c46-c107-4967-bc89-33ea6b12cff2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c13fe47bf03e4379840b6f20a47cde3a'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:45.634536 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-1b344c46-c107-4967-bc89-33ea6b12cff2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c13fe47bf03e4379840b6f20a47cde3a'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:45.636043 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-55264680-1c69-411c-8301-3dd6090ec758 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0061be7e8e7b4ff4bff9c518ff9e6ea2', 'request_id': 'req-55264680-1c69-411c-8301-3dd6090ec758'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:45.666527 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-55264680-1c69-411c-8301-3dd6090ec758 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0061be7e8e7b4ff4bff9c518ff9e6ea2', 'request_id': 'req-55264680-1c69-411c-8301-3dd6090ec758'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:45.670279 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-1b344c46-c107-4967-bc89-33ea6b12cff2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c13fe47bf03e4379840b6f20a47cde3a'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:45.671604 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:45.672935 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-1b344c46-c107-4967-bc89-33ea6b12cff2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c13fe47bf03e4379840b6f20a47cde3a'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:45.708679 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 836/1677] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:52:45 2022] DELETE /identity/v3/users/c13fe47bf03e4379840b6f20a47cde3a => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:52:45.712642 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-55264680-1c69-411c-8301-3dd6090ec758 admin admin] The token cache is being invalidate because project 0061be7e8e7b4ff4bff9c518ff9e6ea2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:52:45.713892 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-55264680-1c69-411c-8301-3dd6090ec758 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:45.714598 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-55264680-1c69-411c-8301-3dd6090ec758 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:45.716910 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c911875-3eba-4c8f-aa24-370440fa72c6 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:45.717650 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c911875-3eba-4c8f-aa24-370440fa72c6 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:45.717844 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 842/1678] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:52:44 2022] DELETE /identity/v3/projects/0061be7e8e7b4ff4bff9c518ff9e6ea2 => generated 0 bytes in 784 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:52:45.718496 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c911875-3eba-4c8f-aa24-370440fa72c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:45.727869 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc9d53-4d49-4f2b-8f68-31be2adafb82 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:45.729503 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc9d53-4d49-4f2b-8f68-31be2adafb82 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:45.730706 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc9d53-4d49-4f2b-8f68-31be2adafb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:45.762872 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-2c911875-3eba-4c8f-aa24-370440fa72c6 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:45.765415 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-2c911875-3eba-4c8f-aa24-370440fa72c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:45.850049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-51bc9d53-4d49-4f2b-8f68-31be2adafb82 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:45.860781 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-51bc9d53-4d49-4f2b-8f68-31be2adafb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:46.159794 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 843/1679] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:52:46.175155 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac1f2a-e211-4f47-aa03-9b7207790f9b None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:46.177477 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac1f2a-e211-4f47-aa03-9b7207790f9b None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:46.178304 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac1f2a-e211-4f47-aa03-9b7207790f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:46.185807 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 837/1680] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 472 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:52:46.257139 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-9cac1f2a-e211-4f47-aa03-9b7207790f9b None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:46.259443 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-9cac1f2a-e211-4f47-aa03-9b7207790f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:46.296515 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 844/1681] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:52:46.304250 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c911875-3eba-4c8f-aa24-370440fa72c6 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:46.337094 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c911875-3eba-4c8f-aa24-370440fa72c6 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:46.350779 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01523f72-dc33-4608-a09a-dd4276c67307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:46.352626 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01523f72-dc33-4608-a09a-dd4276c67307 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:46.353136 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01523f72-dc33-4608-a09a-dd4276c67307 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:46.353651 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01523f72-dc33-4608-a09a-dd4276c67307 admin admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:46.354911 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01523f72-dc33-4608-a09a-dd4276c67307 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:52:46.356220 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01523f72-dc33-4608-a09a-dd4276c67307 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:46.361548 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01523f72-dc33-4608-a09a-dd4276c67307 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:46.398076 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 838/1682] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 13:52:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:52:46.400151 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac1f2a-e211-4f47-aa03-9b7207790f9b None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:46.427786 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac1f2a-e211-4f47-aa03-9b7207790f9b None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:46.467349 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd8e74-df6e-4b41-b840-0b9cca97f6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:46.468940 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd8e74-df6e-4b41-b840-0b9cca97f6b0 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:46.470190 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd8e74-df6e-4b41-b840-0b9cca97f6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:46.471216 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd8e74-df6e-4b41-b840-0b9cca97f6b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:46.472764 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd8e74-df6e-4b41-b840-0b9cca97f6b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:46.480300 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd8e74-df6e-4b41-b840-0b9cca97f6b0 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:46.494365 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3b283-733a-49c8-89d5-e6b377ec0573 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:46.494838 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3b283-733a-49c8-89d5-e6b377ec0573 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:46.495278 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d3b283-733a-49c8-89d5-e6b377ec0573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:46.530713 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:46.625645 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 845/1683] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:52:46 2022] POST /identity/v3/projects => generated 363 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:52:46.628538 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd8e74-df6e-4b41-b840-0b9cca97f6b0 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:46.628715 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-55d3b283-733a-49c8-89d5-e6b377ec0573 None None] MFA Rules not processed for user `8395ea674036465b8a5c62622b4faf92`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:46.631090 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-55d3b283-733a-49c8-89d5-e6b377ec0573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:46.635928 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-90fd8e74-df6e-4b41-b840-0b9cca97f6b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:46.862987 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd8e74-df6e-4b41-b840-0b9cca97f6b0 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:46.879463 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975757cf-54b9-4351-9e6d-9b584237f8ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:46.880525 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975757cf-54b9-4351-9e6d-9b584237f8ad service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:46.880959 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975757cf-54b9-4351-9e6d-9b584237f8ad service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:46.881471 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975757cf-54b9-4351-9e6d-9b584237f8ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:46.905448 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 839/1684] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:52:46.906592 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3b283-733a-49c8-89d5-e6b377ec0573 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:47.099196 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975757cf-54b9-4351-9e6d-9b584237f8ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:47.102877 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975757cf-54b9-4351-9e6d-9b584237f8ad service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:47.155660 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 846/1685] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:52:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:52:47.164118 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becaee4e-79c6-4f39-a5fc-a1b94d9778ae None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:47.164797 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becaee4e-79c6-4f39-a5fc-a1b94d9778ae None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:47.166828 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becaee4e-79c6-4f39-a5fc-a1b94d9778ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:47.179189 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d3b283-733a-49c8-89d5-e6b377ec0573 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:47.209044 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448cae3c-77b6-490d-974a-199686a19fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:47.230640 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cae3c-77b6-490d-974a-199686a19fd7 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:47.237946 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cae3c-77b6-490d-974a-199686a19fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:47.237946 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cae3c-77b6-490d-974a-199686a19fd7 admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:47.238310 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448cae3c-77b6-490d-974a-199686a19fd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:47.252121 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448cae3c-77b6-490d-974a-199686a19fd7 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:47.284588 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-becaee4e-79c6-4f39-a5fc-a1b94d9778ae None None] MFA Rules not processed for user `8395ea674036465b8a5c62622b4faf92`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:47.295127 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-becaee4e-79c6-4f39-a5fc-a1b94d9778ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:47.349028 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 847/1686] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:52:47.368238 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becaee4e-79c6-4f39-a5fc-a1b94d9778ae None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:47.369577 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 840/1687] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:52:46 2022] POST /identity/v3/users => generated 282 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:52:47.375991 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-becaee4e-79c6-4f39-a5fc-a1b94d9778ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:47.384471 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448cae3c-77b6-490d-974a-199686a19fd7 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:47.431252 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:47.449552 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448cae3c-77b6-490d-974a-199686a19fd7 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:47.478008 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8daeb70-6f74-4069-a4ad-21aed00244ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:47.478821 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8daeb70-6f74-4069-a4ad-21aed00244ed admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:47.481615 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8daeb70-6f74-4069-a4ad-21aed00244ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:47.484232 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8daeb70-6f74-4069-a4ad-21aed00244ed admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:47.485598 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8daeb70-6f74-4069-a4ad-21aed00244ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:47.489390 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8daeb70-6f74-4069-a4ad-21aed00244ed admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:47.533308 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 841/1688] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:52:47.539180 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8daeb70-6f74-4069-a4ad-21aed00244ed admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:47.569266 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8daeb70-6f74-4069-a4ad-21aed00244ed admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:47.579986 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab70dc8-ca54-4297-8b9f-67eb4a883043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:47.581119 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab70dc8-ca54-4297-8b9f-67eb4a883043 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:47.581558 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab70dc8-ca54-4297-8b9f-67eb4a883043 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:47.581919 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab70dc8-ca54-4297-8b9f-67eb4a883043 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:47.584048 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab70dc8-ca54-4297-8b9f-67eb4a883043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:47.621133 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab70dc8-ca54-4297-8b9f-67eb4a883043 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:47.679511 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 842/1689] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:52:47.680286 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab70dc8-ca54-4297-8b9f-67eb4a883043 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:47.683026 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-1ab70dc8-ca54-4297-8b9f-67eb4a883043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:47.685449 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becaee4e-79c6-4f39-a5fc-a1b94d9778ae None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:47.711761 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab70dc8-ca54-4297-8b9f-67eb4a883043 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:47.717456 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392c9c7-f6bf-4159-993f-454b06f0ef56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:47.718573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392c9c7-f6bf-4159-993f-454b06f0ef56 service nova] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:47.719080 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392c9c7-f6bf-4159-993f-454b06f0ef56 service nova] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:47.720462 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96134cd-6b0a-4eaa-9edc-ddaab3b7db7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:47.724175 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392c9c7-f6bf-4159-993f-454b06f0ef56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:47.727541 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96134cd-6b0a-4eaa-9edc-ddaab3b7db7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:47.730185 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96134cd-6b0a-4eaa-9edc-ddaab3b7db7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:47.732639 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96134cd-6b0a-4eaa-9edc-ddaab3b7db7a admin admin] PATH_INFO: `/v3/projects/14ee589a88bf4620b1fa909ec7669bbf` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:47.744848 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96134cd-6b0a-4eaa-9edc-ddaab3b7db7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=14ee589a88bf4620b1fa909ec7669bbf)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:47.757856 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96134cd-6b0a-4eaa-9edc-ddaab3b7db7a admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:47.778281 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8392c9c7-f6bf-4159-993f-454b06f0ef56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:47.786647 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8392c9c7-f6bf-4159-993f-454b06f0ef56 service nova] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:47.833850 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 848/1690] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:52:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:52:47.836894 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392c9c7-f6bf-4159-993f-454b06f0ef56 service nova] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:47.842980 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-8392c9c7-f6bf-4159-993f-454b06f0ef56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:47.914876 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392c9c7-f6bf-4159-993f-454b06f0ef56 service nova] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:47.946531 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6a0e1-4f92-4f7f-b8d0-ffada7a17b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:47.948889 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6a0e1-4f92-4f7f-b8d0-ffada7a17b1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:47.950338 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6a0e1-4f92-4f7f-b8d0-ffada7a17b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:47.952553 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6a0e1-4f92-4f7f-b8d0-ffada7a17b1f admin admin] PATH_INFO: `/v3/projects/f5cb5952471f46faa6cc46fcdb01db44` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:47.958146 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d6a0e1-4f92-4f7f-b8d0-ffada7a17b1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5cb5952471f46faa6cc46fcdb01db44)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:47.970303 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d6a0e1-4f92-4f7f-b8d0-ffada7a17b1f admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:48.052800 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-e96134cd-6b0a-4eaa-9edc-ddaab3b7db7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14ee589a88bf4620b1fa909ec7669bbf', 'request_id': 'req-e96134cd-6b0a-4eaa-9edc-ddaab3b7db7a'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:48.099200 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-e96134cd-6b0a-4eaa-9edc-ddaab3b7db7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14ee589a88bf4620b1fa909ec7669bbf', 'request_id': 'req-e96134cd-6b0a-4eaa-9edc-ddaab3b7db7a'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:48.104370 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:48.145135 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-e96134cd-6b0a-4eaa-9edc-ddaab3b7db7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14ee589a88bf4620b1fa909ec7669bbf', 'request_id': 'req-e96134cd-6b0a-4eaa-9edc-ddaab3b7db7a'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:48.203469 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-e96134cd-6b0a-4eaa-9edc-ddaab3b7db7a admin admin] The token cache is being invalidate because project 14ee589a88bf4620b1fa909ec7669bbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:52:48.204033 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-e96134cd-6b0a-4eaa-9edc-ddaab3b7db7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:48.207759 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-e96134cd-6b0a-4eaa-9edc-ddaab3b7db7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:48.224473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 843/1691] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:52:47 2022] DELETE /identity/v3/projects/14ee589a88bf4620b1fa909ec7669bbf => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:52:48.240641 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96134cd-6b0a-4eaa-9edc-ddaab3b7db7a admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:48.243920 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-e96134cd-6b0a-4eaa-9edc-ddaab3b7db7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:48.281151 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-36d6a0e1-4f92-4f7f-b8d0-ffada7a17b1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5cb5952471f46faa6cc46fcdb01db44', 'request_id': 'req-36d6a0e1-4f92-4f7f-b8d0-ffada7a17b1f'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:48.324894 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-36d6a0e1-4f92-4f7f-b8d0-ffada7a17b1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5cb5952471f46faa6cc46fcdb01db44', 'request_id': 'req-36d6a0e1-4f92-4f7f-b8d0-ffada7a17b1f'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:48.343965 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-36d6a0e1-4f92-4f7f-b8d0-ffada7a17b1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5cb5952471f46faa6cc46fcdb01db44', 'request_id': 'req-36d6a0e1-4f92-4f7f-b8d0-ffada7a17b1f'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:48.410135 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-36d6a0e1-4f92-4f7f-b8d0-ffada7a17b1f admin admin] The token cache is being invalidate because project f5cb5952471f46faa6cc46fcdb01db44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:52:48.410710 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-36d6a0e1-4f92-4f7f-b8d0-ffada7a17b1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:48.412980 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-36d6a0e1-4f92-4f7f-b8d0-ffada7a17b1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:48.445512 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 849/1692] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:52:47 2022] DELETE /identity/v3/projects/f5cb5952471f46faa6cc46fcdb01db44 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:52:48.449337 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6a0e1-4f92-4f7f-b8d0-ffada7a17b1f admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:48.455593 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-36d6a0e1-4f92-4f7f-b8d0-ffada7a17b1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:48.552712 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96134cd-6b0a-4eaa-9edc-ddaab3b7db7a admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:48.778407 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05e391c-7ef9-4b0c-ac52-899edcc3263a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:48.779282 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e391c-7ef9-4b0c-ac52-899edcc3263a admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:48.779409 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e391c-7ef9-4b0c-ac52-899edcc3263a admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:48.779633 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e391c-7ef9-4b0c-ac52-899edcc3263a admin admin] PATH_INFO: `/v3/projects/729ac0bcfdb14a97bc21ef3a7a4c267b/users/642ac7310790423aa425eccce07043d9/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:48.808994 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6a0e1-4f92-4f7f-b8d0-ffada7a17b1f admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:48.815255 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05e391c-7ef9-4b0c-ac52-899edcc3263a admin admin] RBAC: Authorizing `identity:create_grant(project_id=729ac0bcfdb14a97bc21ef3a7a4c267b, user_id=642ac7310790423aa425eccce07043d9, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:48.823456 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05e391c-7ef9-4b0c-ac52-899edcc3263a admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:48.837947 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bdc29a-f0ba-44d4-a65f-b9e1bbc5f473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:48.840652 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bdc29a-f0ba-44d4-a65f-b9e1bbc5f473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:48.843640 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bdc29a-f0ba-44d4-a65f-b9e1bbc5f473 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:48.846179 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bdc29a-f0ba-44d4-a65f-b9e1bbc5f473 admin admin] PATH_INFO: `/v3/users/3cd1f5d04f3e46d4b0dd6bab1e5bf919` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:48.853829 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bdc29a-f0ba-44d4-a65f-b9e1bbc5f473 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cd1f5d04f3e46d4b0dd6bab1e5bf919)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:48.854833 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 844/1693] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:52:48 2022] PUT /identity/v3/projects/729ac0bcfdb14a97bc21ef3a7a4c267b/users/642ac7310790423aa425eccce07043d9/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:52:48.856182 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342611a-85dc-4148-8bbb-7f9d173d99b4 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:48.856465 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342611a-85dc-4148-8bbb-7f9d173d99b4 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:48.856736 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342611a-85dc-4148-8bbb-7f9d173d99b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:48.869205 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bdc29a-f0ba-44d4-a65f-b9e1bbc5f473 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:48.902256 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-f342611a-85dc-4148-8bbb-7f9d173d99b4 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:48.907342 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-f342611a-85dc-4148-8bbb-7f9d173d99b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:48.947054 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:49.047291 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-45bdc29a-f0ba-44d4-a65f-b9e1bbc5f473 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cd1f5d04f3e46d4b0dd6bab1e5bf919'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:49.048685 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-45bdc29a-f0ba-44d4-a65f-b9e1bbc5f473 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cd1f5d04f3e46d4b0dd6bab1e5bf919'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:49.054961 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-45bdc29a-f0ba-44d4-a65f-b9e1bbc5f473 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cd1f5d04f3e46d4b0dd6bab1e5bf919'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:49.084311 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-45bdc29a-f0ba-44d4-a65f-b9e1bbc5f473 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cd1f5d04f3e46d4b0dd6bab1e5bf919'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:49.143846 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-45bdc29a-f0ba-44d4-a65f-b9e1bbc5f473 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cd1f5d04f3e46d4b0dd6bab1e5bf919'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:49.154939 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 845/1694] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:52:49.157923 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49413d2e-bfe9-46d7-b205-ebc01b1e5dcd None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:49.158431 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49413d2e-bfe9-46d7-b205-ebc01b1e5dcd None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:49.158900 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49413d2e-bfe9-46d7-b205-ebc01b1e5dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:49.191640 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 850/1695] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:52:48 2022] DELETE /identity/v3/users/3cd1f5d04f3e46d4b0dd6bab1e5bf919 => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:52:49.200064 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc11a3d-9805-483e-9b3b-359e88f26dd9 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:49.201121 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc11a3d-9805-483e-9b3b-359e88f26dd9 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:49.214088 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc11a3d-9805-483e-9b3b-359e88f26dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:49.225893 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:49.249421 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-49413d2e-bfe9-46d7-b205-ebc01b1e5dcd None None] MFA Rules not processed for user `642ac7310790423aa425eccce07043d9`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:49.249421 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-49413d2e-bfe9-46d7-b205-ebc01b1e5dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:49.293086 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-acc11a3d-9805-483e-9b3b-359e88f26dd9 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:49.295534 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-acc11a3d-9805-483e-9b3b-359e88f26dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:49.509168 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 846/1696] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:52:49.513832 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49413d2e-bfe9-46d7-b205-ebc01b1e5dcd None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:49.516893 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-49413d2e-bfe9-46d7-b205-ebc01b1e5dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:49.557867 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 851/1697] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:52:49.564162 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc11a3d-9805-483e-9b3b-359e88f26dd9 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:49.602606 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc11a3d-9805-483e-9b3b-359e88f26dd9 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:49.621333 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac2033-2475-4fd6-b5fe-534fcc25d99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:49.622351 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac2033-2475-4fd6-b5fe-534fcc25d99b admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:49.622975 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac2033-2475-4fd6-b5fe-534fcc25d99b admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:49.623595 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac2033-2475-4fd6-b5fe-534fcc25d99b admin admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:49.624947 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac2033-2475-4fd6-b5fe-534fcc25d99b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:52:49.625735 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac2033-2475-4fd6-b5fe-534fcc25d99b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:49.628472 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac2033-2475-4fd6-b5fe-534fcc25d99b admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:49.670948 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 852/1698] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 13:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:52:49.677992 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac2033-2475-4fd6-b5fe-534fcc25d99b admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:49.717343 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac2033-2475-4fd6-b5fe-534fcc25d99b admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:49.737452 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a3720-8414-4ae9-b4f3-6c85bc728220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:49.739813 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a3720-8414-4ae9-b4f3-6c85bc728220 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:49.740294 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a3720-8414-4ae9-b4f3-6c85bc728220 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:49.741752 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0a3720-8414-4ae9-b4f3-6c85bc728220 admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:49.742975 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a3720-8414-4ae9-b4f3-6c85bc728220 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:49.748267 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0a3720-8414-4ae9-b4f3-6c85bc728220 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:49.862887 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 853/1699] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:52:49 2022] POST /identity/v3/projects => generated 403 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:52:49.865839 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a3720-8414-4ae9-b4f3-6c85bc728220 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:49.927569 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49413d2e-bfe9-46d7-b205-ebc01b1e5dcd None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:50.094198 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0a3720-8414-4ae9-b4f3-6c85bc728220 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:50.108374 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb1286-aaa4-468e-9c8b-8f9faed5fe80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:50.111180 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb1286-aaa4-468e-9c8b-8f9faed5fe80 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:50.111622 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb1286-aaa4-468e-9c8b-8f9faed5fe80 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:50.112122 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb1286-aaa4-468e-9c8b-8f9faed5fe80 admin admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:50.114971 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb1286-aaa4-468e-9c8b-8f9faed5fe80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:50.120646 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb1286-aaa4-468e-9c8b-8f9faed5fe80 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:50.146005 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:50.160356 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae721a9-bfc1-4e99-981a-35685a69598e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:50.161356 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae721a9-bfc1-4e99-981a-35685a69598e admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:50.161955 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae721a9-bfc1-4e99-981a-35685a69598e admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:50.162422 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae721a9-bfc1-4e99-981a-35685a69598e admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:50.163572 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae721a9-bfc1-4e99-981a-35685a69598e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:50.177592 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae721a9-bfc1-4e99-981a-35685a69598e admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:50.185551 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 854/1700] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:52:49 2022] POST /identity/v3/users => generated 302 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:52:50.190027 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb1286-aaa4-468e-9c8b-8f9faed5fe80 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:50.218872 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb1286-aaa4-468e-9c8b-8f9faed5fe80 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:50.228681 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c20461-795a-40d9-9470-6fd4580d1d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:50.230889 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c20461-795a-40d9-9470-6fd4580d1d5b admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:50.231579 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c20461-795a-40d9-9470-6fd4580d1d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:50.234020 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c20461-795a-40d9-9470-6fd4580d1d5b admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:50.235806 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c20461-795a-40d9-9470-6fd4580d1d5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:50.242327 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c20461-795a-40d9-9470-6fd4580d1d5b admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:50.271491 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 855/1701] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:52:50.274645 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c20461-795a-40d9-9470-6fd4580d1d5b admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:50.294863 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 847/1702] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:52:49 2022] POST /identity/v3/projects => generated 365 bytes in 776 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:52:50.294863 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae721a9-bfc1-4e99-981a-35685a69598e admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:50.306130 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c20461-795a-40d9-9470-6fd4580d1d5b admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:50.449790 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:50.470036 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580886f8-bd09-497d-91dd-a082edd324e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:50.473838 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580886f8-bd09-497d-91dd-a082edd324e8 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:50.481928 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580886f8-bd09-497d-91dd-a082edd324e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:50.482712 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580886f8-bd09-497d-91dd-a082edd324e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:50.484129 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580886f8-bd09-497d-91dd-a082edd324e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:50.492297 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580886f8-bd09-497d-91dd-a082edd324e8 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:50.544543 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 856/1703] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:52:50 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:52:50.554160 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51b9af-126f-4a5b-8791-6fa3b0af8886 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:50.554591 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51b9af-126f-4a5b-8791-6fa3b0af8886 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:50.554860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51b9af-126f-4a5b-8791-6fa3b0af8886 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:50.560986 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae721a9-bfc1-4e99-981a-35685a69598e admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:50.570666 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 857/1704] 10.222.0.69 () {54 vars in 912 bytes} [Thu Sep 8 13:52:50 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:52:50.571900 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51b9af-126f-4a5b-8791-6fa3b0af8886 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:50.587687 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb0d477-d569-41fc-8ae6-21f9a537ede9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:50.591470 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0d477-d569-41fc-8ae6-21f9a537ede9 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:50.594702 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0d477-d569-41fc-8ae6-21f9a537ede9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:50.595228 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0d477-d569-41fc-8ae6-21f9a537ede9 admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:50.601032 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb0d477-d569-41fc-8ae6-21f9a537ede9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:50.635724 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb0d477-d569-41fc-8ae6-21f9a537ede9 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:50.679653 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51b9af-126f-4a5b-8791-6fa3b0af8886 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:50.690476 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb9d22c-641e-4794-8352-d14e4d89ca2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:50.693282 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9d22c-641e-4794-8352-d14e4d89ca2c admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:50.694093 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9d22c-641e-4794-8352-d14e4d89ca2c admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:50.694818 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9d22c-641e-4794-8352-d14e4d89ca2c admin admin] PATH_INFO: `/v3/projects/a1225cea60e9463c85c6c89ca1eeeb0e/users/75833fc0653b47109404543767abd3f2/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:50.774461 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb9d22c-641e-4794-8352-d14e4d89ca2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1225cea60e9463c85c6c89ca1eeeb0e, user_id=75833fc0653b47109404543767abd3f2, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:50.782745 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb9d22c-641e-4794-8352-d14e4d89ca2c admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:50.811327 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 848/1705] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:52:50 2022] POST /identity/v3/users => generated 289 bytes in 517 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:52:50.819337 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395becd-fa88-47f2-9b3d-83fc326b5938 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:50.819839 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395becd-fa88-47f2-9b3d-83fc326b5938 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:50.820317 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395becd-fa88-47f2-9b3d-83fc326b5938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:50.851907 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 858/1706] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:52:50 2022] PUT /identity/v3/projects/a1225cea60e9463c85c6c89ca1eeeb0e/users/75833fc0653b47109404543767abd3f2/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:52:50.854663 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb9d22c-641e-4794-8352-d14e4d89ca2c admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:50.864861 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-beb9d22c-641e-4794-8352-d14e4d89ca2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:50.999378 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-d395becd-fa88-47f2-9b3d-83fc326b5938 None None] MFA Rules not processed for user `db898158553743d3a28f3d6237e91a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:51.005848 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-d395becd-fa88-47f2-9b3d-83fc326b5938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:51.150216 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb9d22c-641e-4794-8352-d14e4d89ca2c admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:51.183741 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f131211-479a-40bf-a831-54197d7daeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:51.185577 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f131211-479a-40bf-a831-54197d7daeba admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:51.187499 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f131211-479a-40bf-a831-54197d7daeba admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:51.188313 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f131211-479a-40bf-a831-54197d7daeba admin admin] PATH_INFO: `/v3/projects/eabe33b675904309a011e1490f3aef35` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:51.192203 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f131211-479a-40bf-a831-54197d7daeba admin admin] RBAC: Authorizing `identity:delete_project(project_id=eabe33b675904309a011e1490f3aef35)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:51.199273 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f131211-479a-40bf-a831-54197d7daeba admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:51.210320 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 849/1707] 10.222.0.69 () {58 vars in 1009 bytes} [Thu Sep 8 13:52:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:52:51.211862 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395becd-fa88-47f2-9b3d-83fc326b5938 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:51.261895 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395becd-fa88-47f2-9b3d-83fc326b5938 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:51.282287 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f6223-fea9-429a-a452-5d37fc102059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:51.283363 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f6223-fea9-429a-a452-5d37fc102059 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:51.283874 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f6223-fea9-429a-a452-5d37fc102059 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:51.284352 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f6223-fea9-429a-a452-5d37fc102059 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:51.289599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744f6223-fea9-429a-a452-5d37fc102059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:51.298254 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744f6223-fea9-429a-a452-5d37fc102059 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:51.360295 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 850/1708] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:52:51.364817 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7122aa5-b089-468d-a4a3-e0b8f1e06117 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:51.365294 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7122aa5-b089-468d-a4a3-e0b8f1e06117 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:51.365842 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7122aa5-b089-468d-a4a3-e0b8f1e06117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:51.419920 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-9f131211-479a-40bf-a831-54197d7daeba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eabe33b675904309a011e1490f3aef35', 'request_id': 'req-9f131211-479a-40bf-a831-54197d7daeba'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:51.439148 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:INSERT=3,keystone:SELECT=92,keystone:DELETE=5 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:51.446683 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-9f131211-479a-40bf-a831-54197d7daeba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eabe33b675904309a011e1490f3aef35', 'request_id': 'req-9f131211-479a-40bf-a831-54197d7daeba'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:51.493145 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-e7122aa5-b089-468d-a4a3-e0b8f1e06117 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:51.493606 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-9f131211-479a-40bf-a831-54197d7daeba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eabe33b675904309a011e1490f3aef35', 'request_id': 'req-9f131211-479a-40bf-a831-54197d7daeba'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:51.497118 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-e7122aa5-b089-468d-a4a3-e0b8f1e06117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:51.553861 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-9f131211-479a-40bf-a831-54197d7daeba admin admin] The token cache is being invalidate because project eabe33b675904309a011e1490f3aef35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:52:51.554305 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-9f131211-479a-40bf-a831-54197d7daeba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:51.557122 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-9f131211-479a-40bf-a831-54197d7daeba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:51.571728 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 859/1709] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:52:50 2022] DELETE /identity/v3/projects/eabe33b675904309a011e1490f3aef35 => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:52:51.573088 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f131211-479a-40bf-a831-54197d7daeba admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:51.593155 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-9f131211-479a-40bf-a831-54197d7daeba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:51.776685 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 851/1710] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:52:51.778921 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7122aa5-b089-468d-a4a3-e0b8f1e06117 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:51.781594 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-e7122aa5-b089-468d-a4a3-e0b8f1e06117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:51.820317 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7122aa5-b089-468d-a4a3-e0b8f1e06117 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:51.850524 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cc5011-5734-4c7e-a0fb-8a130c18e26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:51.851975 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc5011-5734-4c7e-a0fb-8a130c18e26f admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:51.852276 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc5011-5734-4c7e-a0fb-8a130c18e26f admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:51.852760 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cc5011-5734-4c7e-a0fb-8a130c18e26f admin admin] PATH_INFO: `/v3/projects/f83812ac80134e8bb5b4574e7487f693/users/4f348121b6054fdc803f03bd309df40c/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:51.905755 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f131211-479a-40bf-a831-54197d7daeba admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:51.933013 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65603fe6-a6bd-4529-bcd6-6a0f99f07349 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:51.937180 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65603fe6-a6bd-4529-bcd6-6a0f99f07349 service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:51.937987 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65603fe6-a6bd-4529-bcd6-6a0f99f07349 service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:51.938628 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65603fe6-a6bd-4529-bcd6-6a0f99f07349 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:51.939288 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cc5011-5734-4c7e-a0fb-8a130c18e26f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f83812ac80134e8bb5b4574e7487f693, user_id=4f348121b6054fdc803f03bd309df40c, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:51.946869 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-65603fe6-a6bd-4529-bcd6-6a0f99f07349 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:51.961354 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cc5011-5734-4c7e-a0fb-8a130c18e26f admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:51.997789 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65603fe6-a6bd-4529-bcd6-6a0f99f07349 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:52.003196 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65603fe6-a6bd-4529-bcd6-6a0f99f07349 service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:52.013560 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 852/1711] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:52:51 2022] PUT /identity/v3/projects/f83812ac80134e8bb5b4574e7487f693/users/4f348121b6054fdc803f03bd309df40c/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:52:52.015512 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cc5011-5734-4c7e-a0fb-8a130c18e26f admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:52.019155 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-03cc5011-5734-4c7e-a0fb-8a130c18e26f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:52.045870 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 860/1712] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:52:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:52:52.052842 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65603fe6-a6bd-4529-bcd6-6a0f99f07349 service neutron] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:52.067502 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-65603fe6-a6bd-4529-bcd6-6a0f99f07349 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:52.104171 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65603fe6-a6bd-4529-bcd6-6a0f99f07349 service neutron] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:52.200902 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:52.347265 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b938b-043b-4c6e-9e57-e75b210f17a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:52.349637 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b938b-043b-4c6e-9e57-e75b210f17a9 service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:52.351245 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b938b-043b-4c6e-9e57-e75b210f17a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:52.351880 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b938b-043b-4c6e-9e57-e75b210f17a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:52.426459 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cc5011-5734-4c7e-a0fb-8a130c18e26f admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:52.438194 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a492928-3125-4f96-8887-279dd52d5472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:52.440552 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a492928-3125-4f96-8887-279dd52d5472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:52.444016 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a492928-3125-4f96-8887-279dd52d5472 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:52.444418 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a492928-3125-4f96-8887-279dd52d5472 admin admin] PATH_INFO: `/v3/users/98bcaa3b1f464ab6aab50396aa18ff78` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:52.449891 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a492928-3125-4f96-8887-279dd52d5472 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98bcaa3b1f464ab6aab50396aa18ff78)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:52.456725 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a492928-3125-4f96-8887-279dd52d5472 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:52.541619 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1b938b-043b-4c6e-9e57-e75b210f17a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:52.545711 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1b938b-043b-4c6e-9e57-e75b210f17a9 service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:52.568470 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 861/1713] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:52:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:52:52.571584 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b938b-043b-4c6e-9e57-e75b210f17a9 service neutron] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:52.592967 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-5a492928-3125-4f96-8887-279dd52d5472 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98bcaa3b1f464ab6aab50396aa18ff78'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:52.595162 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-5a492928-3125-4f96-8887-279dd52d5472 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98bcaa3b1f464ab6aab50396aa18ff78'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:52.603009 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b938b-043b-4c6e-9e57-e75b210f17a9 service neutron] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:52.612419 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-5a492928-3125-4f96-8887-279dd52d5472 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98bcaa3b1f464ab6aab50396aa18ff78'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:52.633939 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c8370-7ffd-4dac-be61-29adff1def35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:52.636173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c8370-7ffd-4dac-be61-29adff1def35 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:52.636887 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c8370-7ffd-4dac-be61-29adff1def35 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:52.637575 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c8370-7ffd-4dac-be61-29adff1def35 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:52.641329 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-5a492928-3125-4f96-8887-279dd52d5472 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98bcaa3b1f464ab6aab50396aa18ff78'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:52.642489 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-5a492928-3125-4f96-8887-279dd52d5472 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98bcaa3b1f464ab6aab50396aa18ff78'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:52.642662 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c8370-7ffd-4dac-be61-29adff1def35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:52.651057 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c8370-7ffd-4dac-be61-29adff1def35 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:52.688667 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 853/1714] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:52:52 2022] DELETE /identity/v3/users/98bcaa3b1f464ab6aab50396aa18ff78 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:52:52.702115 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 862/1715] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:52:52.710001 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a492928-3125-4f96-8887-279dd52d5472 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:52.712475 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-5a492928-3125-4f96-8887-279dd52d5472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:52.991235 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a492928-3125-4f96-8887-279dd52d5472 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:53.019032 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92aae97-1762-490c-b23e-8a0ad8ec17fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:53.021089 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92aae97-1762-490c-b23e-8a0ad8ec17fb admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:53.021638 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92aae97-1762-490c-b23e-8a0ad8ec17fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:53.023617 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92aae97-1762-490c-b23e-8a0ad8ec17fb admin admin] PATH_INFO: `/v3/projects/f83812ac80134e8bb5b4574e7487f693/users/4f348121b6054fdc803f03bd309df40c/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:53.034094 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92aae97-1762-490c-b23e-8a0ad8ec17fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f83812ac80134e8bb5b4574e7487f693, user_id=4f348121b6054fdc803f03bd309df40c, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:53.045177 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92aae97-1762-490c-b23e-8a0ad8ec17fb admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:53.094125 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 854/1716] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:52:52 2022] PUT /identity/v3/projects/f83812ac80134e8bb5b4574e7487f693/users/4f348121b6054fdc803f03bd309df40c/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:52:53.111480 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82dfb0-0abb-4f23-ae4a-20bd57681a97 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:53.111979 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82dfb0-0abb-4f23-ae4a-20bd57681a97 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:53.112471 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82dfb0-0abb-4f23-ae4a-20bd57681a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:53.219935 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-da82dfb0-0abb-4f23-ae4a-20bd57681a97 None None] MFA Rules not processed for user `4f348121b6054fdc803f03bd309df40c`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:53.221907 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-da82dfb0-0abb-4f23-ae4a-20bd57681a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:53.279252 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:53.369253 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92aae97-1762-490c-b23e-8a0ad8ec17fb admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:53.375825 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-e92aae97-1762-490c-b23e-8a0ad8ec17fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:53.563045 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:53.592667 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 863/1717] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:53 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 482 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:52:53.637235 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82dfb0-0abb-4f23-ae4a-20bd57681a97 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:53.640590 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-da82dfb0-0abb-4f23-ae4a-20bd57681a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:53.684016 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92aae97-1762-490c-b23e-8a0ad8ec17fb admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:53.722451 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb7d6e5-5556-4f89-a55f-326519c6ce17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:53.723961 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7d6e5-5556-4f89-a55f-326519c6ce17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:53.724357 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7d6e5-5556-4f89-a55f-326519c6ce17 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:53.724829 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7d6e5-5556-4f89-a55f-326519c6ce17 admin admin] PATH_INFO: `/v3/projects/4274b8134d8947b2af1772b79aa9433e` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:53.746249 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb7d6e5-5556-4f89-a55f-326519c6ce17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4274b8134d8947b2af1772b79aa9433e)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:53.761724 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb7d6e5-5556-4f89-a55f-326519c6ce17 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:53.896886 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82dfb0-0abb-4f23-ae4a-20bd57681a97 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:53.914241 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ae0d3-0890-4302-a8ba-b38fc6b4278e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:53.915931 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ae0d3-0890-4302-a8ba-b38fc6b4278e service cinder] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:53.916557 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ae0d3-0890-4302-a8ba-b38fc6b4278e service cinder] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:53.919530 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ae0d3-0890-4302-a8ba-b38fc6b4278e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:53.975606 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ae0d3-0890-4302-a8ba-b38fc6b4278e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:53.987778 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63ae0d3-0890-4302-a8ba-b38fc6b4278e service cinder] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:54.038768 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-2fb7d6e5-5556-4f89-a55f-326519c6ce17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4274b8134d8947b2af1772b79aa9433e', 'request_id': 'req-2fb7d6e5-5556-4f89-a55f-326519c6ce17'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:54.060447 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 864/1718] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:52:53 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:52:54.076813 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-2fb7d6e5-5556-4f89-a55f-326519c6ce17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4274b8134d8947b2af1772b79aa9433e', 'request_id': 'req-2fb7d6e5-5556-4f89-a55f-326519c6ce17'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:54.115106 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-2fb7d6e5-5556-4f89-a55f-326519c6ce17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4274b8134d8947b2af1772b79aa9433e', 'request_id': 'req-2fb7d6e5-5556-4f89-a55f-326519c6ce17'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:54.212279 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-2fb7d6e5-5556-4f89-a55f-326519c6ce17 admin admin] The token cache is being invalidate because project 4274b8134d8947b2af1772b79aa9433e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:52:54.212937 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-2fb7d6e5-5556-4f89-a55f-326519c6ce17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:54.226343 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-2fb7d6e5-5556-4f89-a55f-326519c6ce17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:54.236040 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 855/1719] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:52:53 2022] DELETE /identity/v3/projects/4274b8134d8947b2af1772b79aa9433e => generated 0 bytes in 869 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:52:54.242851 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53a138-b41a-4cf8-adfc-534489c5829a None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:54.243528 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53a138-b41a-4cf8-adfc-534489c5829a None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:54.244031 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53a138-b41a-4cf8-adfc-534489c5829a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:54.362282 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-7f53a138-b41a-4cf8-adfc-534489c5829a None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:54.371117 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-7f53a138-b41a-4cf8-adfc-534489c5829a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:54.423690 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb7d6e5-5556-4f89-a55f-326519c6ce17 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:54.429728 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-2fb7d6e5-5556-4f89-a55f-326519c6ce17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:54.804401 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 865/1720] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 563 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:52:54.821863 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20198f4f-b1a2-4e36-b155-b2e02852c5d1 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:54.822791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20198f4f-b1a2-4e36-b155-b2e02852c5d1 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:54.823963 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20198f4f-b1a2-4e36-b155-b2e02852c5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:54.855803 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb7d6e5-5556-4f89-a55f-326519c6ce17 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:54.872517 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef715dd-0908-481a-83f2-ecbb5e36964c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:54.882028 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef715dd-0908-481a-83f2-ecbb5e36964c service cinder] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:54.882631 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef715dd-0908-481a-83f2-ecbb5e36964c service cinder] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:54.883141 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef715dd-0908-481a-83f2-ecbb5e36964c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:54.888633 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-9ef715dd-0908-481a-83f2-ecbb5e36964c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:54.911605 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-20198f4f-b1a2-4e36-b155-b2e02852c5d1 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:54.920471 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-20198f4f-b1a2-4e36-b155-b2e02852c5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:54.975226 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 866/1721] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:52:54.979450 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20198f4f-b1a2-4e36-b155-b2e02852c5d1 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:55.041344 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20198f4f-b1a2-4e36-b155-b2e02852c5d1 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:55.070327 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a606cce-0c39-41e8-9168-4ba9b1d08009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:55.073075 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a606cce-0c39-41e8-9168-4ba9b1d08009 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:55.074397 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a606cce-0c39-41e8-9168-4ba9b1d08009 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:55.075880 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a606cce-0c39-41e8-9168-4ba9b1d08009 admin admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:55.078626 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a606cce-0c39-41e8-9168-4ba9b1d08009 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:52:55.081410 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a606cce-0c39-41e8-9168-4ba9b1d08009 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:55.090475 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a606cce-0c39-41e8-9168-4ba9b1d08009 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:55.163174 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 867/1722] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 13:52:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:52:55.192879 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef715dd-0908-481a-83f2-ecbb5e36964c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:55.196939 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef715dd-0908-481a-83f2-ecbb5e36964c service cinder] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:55.198513 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a606cce-0c39-41e8-9168-4ba9b1d08009 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:55.243138 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a606cce-0c39-41e8-9168-4ba9b1d08009 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:55.257025 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 856/1723] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:52:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 834 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:52:55.295079 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280ad1c-2e51-4ef2-ac2f-43e0156fbdab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:55.296337 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280ad1c-2e51-4ef2-ac2f-43e0156fbdab admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:55.301039 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280ad1c-2e51-4ef2-ac2f-43e0156fbdab admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:55.301702 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280ad1c-2e51-4ef2-ac2f-43e0156fbdab admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:55.305961 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a280ad1c-2e51-4ef2-ac2f-43e0156fbdab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:55.311742 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a280ad1c-2e51-4ef2-ac2f-43e0156fbdab admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:55.370692 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c77e3f-ae21-494b-a257-191b7e3a8b5d None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:55.371181 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c77e3f-ae21-494b-a257-191b7e3a8b5d None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:55.371655 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c77e3f-ae21-494b-a257-191b7e3a8b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:55.507509 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 868/1724] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:52:55 2022] POST /identity/v3/projects => generated 387 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:52:55.511747 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280ad1c-2e51-4ef2-ac2f-43e0156fbdab admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:55.543526 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-80c77e3f-ae21-494b-a257-191b7e3a8b5d None None] MFA Rules not processed for user `5eb6e03e874d4b28aaf21c5b36f7bb98`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:55.548254 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-80c77e3f-ae21-494b-a257-191b7e3a8b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:55.589896 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:55.607887 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:55.897086 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 857/1725] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:55 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 531 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:52:55.901887 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c77e3f-ae21-494b-a257-191b7e3a8b5d None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:55.909906 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-80c77e3f-ae21-494b-a257-191b7e3a8b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:55.955368 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280ad1c-2e51-4ef2-ac2f-43e0156fbdab admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:55.978953 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e178a2-4274-421c-a0ad-e83704eb4b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:55.980000 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e178a2-4274-421c-a0ad-e83704eb4b65 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:55.980583 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e178a2-4274-421c-a0ad-e83704eb4b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:55.981206 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e178a2-4274-421c-a0ad-e83704eb4b65 admin admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:55.985589 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e178a2-4274-421c-a0ad-e83704eb4b65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:55.996367 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e178a2-4274-421c-a0ad-e83704eb4b65 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:56.119263 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 869/1726] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:52:55 2022] POST /identity/v3/users => generated 294 bytes in 609 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:52:56.131433 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a73f2-6e21-4669-adc0-47469d84be39 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:56.131433 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a73f2-6e21-4669-adc0-47469d84be39 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:56.131433 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a73f2-6e21-4669-adc0-47469d84be39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:56.192196 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-b97a73f2-6e21-4669-adc0-47469d84be39 None None] MFA Rules not processed for user `5eb6e03e874d4b28aaf21c5b36f7bb98`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:56.199608 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-b97a73f2-6e21-4669-adc0-47469d84be39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:56.229254 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 870/1727] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:56 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:52:56.231252 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a73f2-6e21-4669-adc0-47469d84be39 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:56.299489 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a73f2-6e21-4669-adc0-47469d84be39 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:56.322861 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a262be-9743-4a87-8704-7341a05ff784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:56.324333 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a262be-9743-4a87-8704-7341a05ff784 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:56.324940 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a262be-9743-4a87-8704-7341a05ff784 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:56.329939 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a262be-9743-4a87-8704-7341a05ff784 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:56.331868 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a262be-9743-4a87-8704-7341a05ff784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:56.335697 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a262be-9743-4a87-8704-7341a05ff784 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:56.359374 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c77e3f-ae21-494b-a257-191b7e3a8b5d None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:56.382774 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 871/1728] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:52:56 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:52:56.383860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a262be-9743-4a87-8704-7341a05ff784 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:56.388106 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-22a262be-9743-4a87-8704-7341a05ff784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:56.407800 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d187d-70b9-4d73-b12b-97e3492799a0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733797f12a1741e1a55332991e867aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:56.409152 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d187d-70b9-4d73-b12b-97e3492799a0 service placement] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:56.411045 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d187d-70b9-4d73-b12b-97e3492799a0 service placement] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:56.411550 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d187d-70b9-4d73-b12b-97e3492799a0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:56.433577 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-c28d187d-70b9-4d73-b12b-97e3492799a0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:56.500127 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28d187d-70b9-4d73-b12b-97e3492799a0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:56.505744 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28d187d-70b9-4d73-b12b-97e3492799a0 service placement] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:56.551412 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 858/1729] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:52:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 653 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:52:56.554770 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d187d-70b9-4d73-b12b-97e3492799a0 service placement] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:56.558894 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-c28d187d-70b9-4d73-b12b-97e3492799a0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:56.616210 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d187d-70b9-4d73-b12b-97e3492799a0 service placement] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:56.637155 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935c968-551e-411d-97cf-dc5135cd87f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:56.638737 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935c968-551e-411d-97cf-dc5135cd87f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:56.639258 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935c968-551e-411d-97cf-dc5135cd87f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:56.639766 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935c968-551e-411d-97cf-dc5135cd87f6 admin admin] PATH_INFO: `/v3/projects/b8dc108869c347b3aaee40967202daf7` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:56.643962 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9935c968-551e-411d-97cf-dc5135cd87f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8dc108869c347b3aaee40967202daf7)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:56.652577 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9935c968-551e-411d-97cf-dc5135cd87f6 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:56.677595 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a262be-9743-4a87-8704-7341a05ff784 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:56.696860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901249fd-aa63-4251-b288-d40a440c3f1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:56.700181 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901249fd-aa63-4251-b288-d40a440c3f1f service nova] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:56.700681 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901249fd-aa63-4251-b288-d40a440c3f1f service nova] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:56.706641 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901249fd-aa63-4251-b288-d40a440c3f1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:56.744485 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901249fd-aa63-4251-b288-d40a440c3f1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:56.747786 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901249fd-aa63-4251-b288-d40a440c3f1f service nova] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:56.811036 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 872/1730] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:52:56 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:52:56.823112 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901249fd-aa63-4251-b288-d40a440c3f1f service nova] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:56.882226 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901249fd-aa63-4251-b288-d40a440c3f1f service nova] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:56.904234 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-9935c968-551e-411d-97cf-dc5135cd87f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8dc108869c347b3aaee40967202daf7', 'request_id': 'req-9935c968-551e-411d-97cf-dc5135cd87f6'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:56.927417 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-9935c968-551e-411d-97cf-dc5135cd87f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8dc108869c347b3aaee40967202daf7', 'request_id': 'req-9935c968-551e-411d-97cf-dc5135cd87f6'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:56.958709 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-9935c968-551e-411d-97cf-dc5135cd87f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8dc108869c347b3aaee40967202daf7', 'request_id': 'req-9935c968-551e-411d-97cf-dc5135cd87f6'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:57.003134 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-9935c968-551e-411d-97cf-dc5135cd87f6 admin admin] The token cache is being invalidate because project b8dc108869c347b3aaee40967202daf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:52:57.003518 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-9935c968-551e-411d-97cf-dc5135cd87f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:57.008906 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-9935c968-551e-411d-97cf-dc5135cd87f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:52:57.014353 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 859/1731] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:52:56 2022] DELETE /identity/v3/projects/b8dc108869c347b3aaee40967202daf7 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:52:57.022835 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40df5a-0030-4356-b1d9-6945a32df416 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:57.023305 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40df5a-0030-4356-b1d9-6945a32df416 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:57.023777 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40df5a-0030-4356-b1d9-6945a32df416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:57.118983 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-ab40df5a-0030-4356-b1d9-6945a32df416 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:57.135941 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-ab40df5a-0030-4356-b1d9-6945a32df416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:57.173877 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc5107-545b-425a-9a85-cb94dd1af739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:57.185583 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc5107-545b-425a-9a85-cb94dd1af739 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:57.186599 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc5107-545b-425a-9a85-cb94dd1af739 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:57.187459 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc5107-545b-425a-9a85-cb94dd1af739 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:57.188956 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cc5107-545b-425a-9a85-cb94dd1af739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:57.193783 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cc5107-545b-425a-9a85-cb94dd1af739 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:57.230751 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 873/1732] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:52:56 2022] GET /identity/v3/roles => generated 1420 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:52:57.241755 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc5107-545b-425a-9a85-cb94dd1af739 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:57.248521 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-13cc5107-545b-425a-9a85-cb94dd1af739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:57.275436 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:57.303185 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc5107-545b-425a-9a85-cb94dd1af739 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:57.324536 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:57.330202 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87838be-5ad7-44b6-8b25-7f3153a30670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:57.331246 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87838be-5ad7-44b6-8b25-7f3153a30670 admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:57.335232 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87838be-5ad7-44b6-8b25-7f3153a30670 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:57.338124 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87838be-5ad7-44b6-8b25-7f3153a30670 admin admin] PATH_INFO: `/v3/projects/4ece43cb7aa640e7b4104d725efcb572/users/2f596cab25dd4ae98f6acdd6337e8415/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:57.395617 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87838be-5ad7-44b6-8b25-7f3153a30670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ece43cb7aa640e7b4104d725efcb572, user_id=2f596cab25dd4ae98f6acdd6337e8415, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:57.402022 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87838be-5ad7-44b6-8b25-7f3153a30670 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:57.455602 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 874/1733] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:52:57 2022] PUT /identity/v3/projects/4ece43cb7aa640e7b4104d725efcb572/users/2f596cab25dd4ae98f6acdd6337e8415/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:52:57.468148 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677b6be-013b-4cf8-8532-9a7380bb1e6c None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:57.468148 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677b6be-013b-4cf8-8532-9a7380bb1e6c None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:57.468753 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677b6be-013b-4cf8-8532-9a7380bb1e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:57.542557 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 860/1734] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 522 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:52:57.556374 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f23fa-2f9b-4e23-a2e4-d3c0d1a3e1e2 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:57.557129 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f23fa-2f9b-4e23-a2e4-d3c0d1a3e1e2 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:57.557846 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f23fa-2f9b-4e23-a2e4-d3c0d1a3e1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:57.609027 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-e677b6be-013b-4cf8-8532-9a7380bb1e6c None None] MFA Rules not processed for user `2f596cab25dd4ae98f6acdd6337e8415`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:57.614826 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-e677b6be-013b-4cf8-8532-9a7380bb1e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:57.632373 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-605f23fa-2f9b-4e23-a2e4-d3c0d1a3e1e2 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:52:57.634617 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-605f23fa-2f9b-4e23-a2e4-d3c0d1a3e1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:52:57.886992 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 875/1735] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:52:57.888812 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 861/1736] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:52:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:52:57.889079 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e677b6be-013b-4cf8-8532-9a7380bb1e6c None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:57.896189 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f23fa-2f9b-4e23-a2e4-d3c0d1a3e1e2 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:57.930610 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e677b6be-013b-4cf8-8532-9a7380bb1e6c None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:57.940176 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f23fa-2f9b-4e23-a2e4-d3c0d1a3e1e2 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:57.947643 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e718d5e-85d3-4d45-9f5e-246efe5fadc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:57.949264 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e718d5e-85d3-4d45-9f5e-246efe5fadc5 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:57.952106 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e718d5e-85d3-4d45-9f5e-246efe5fadc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:57.956894 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1365ce-e29b-42fb-9c05-0a568ed99049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:57.958751 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e718d5e-85d3-4d45-9f5e-246efe5fadc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:57.960177 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1365ce-e29b-42fb-9c05-0a568ed99049 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:57.962544 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1365ce-e29b-42fb-9c05-0a568ed99049 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:57.962956 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1365ce-e29b-42fb-9c05-0a568ed99049 admin admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:57.963758 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e718d5e-85d3-4d45-9f5e-246efe5fadc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:57.964275 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1365ce-e29b-42fb-9c05-0a568ed99049 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:52:57.965152 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1365ce-e29b-42fb-9c05-0a568ed99049 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:57.978972 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1365ce-e29b-42fb-9c05-0a568ed99049 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:57.980471 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e718d5e-85d3-4d45-9f5e-246efe5fadc5 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:58.046693 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 862/1737] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 13:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:52:58.059431 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1365ce-e29b-42fb-9c05-0a568ed99049 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:58.125108 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1365ce-e29b-42fb-9c05-0a568ed99049 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:58.131183 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 876/1738] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:52:57 2022] POST /identity/v3/projects => generated 385 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:52:58.176605 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e718d5e-85d3-4d45-9f5e-246efe5fadc5 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:58.671480 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e0d60f-51b5-4c4a-a371-f2f09e4d3cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:58.672535 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0d60f-51b5-4c4a-a371-f2f09e4d3cc8 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:58.673051 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0d60f-51b5-4c4a-a371-f2f09e4d3cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:58.675648 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0d60f-51b5-4c4a-a371-f2f09e4d3cc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:58.675648 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e0d60f-51b5-4c4a-a371-f2f09e4d3cc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:58.689014 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e0d60f-51b5-4c4a-a371-f2f09e4d3cc8 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:58.713239 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e718d5e-85d3-4d45-9f5e-246efe5fadc5 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:58.758718 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f89f3-0c19-4f73-9041-9f6ca271ddd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:58.762115 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f89f3-0c19-4f73-9041-9f6ca271ddd6 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:58.762918 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f89f3-0c19-4f73-9041-9f6ca271ddd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:58.763419 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f89f3-0c19-4f73-9041-9f6ca271ddd6 admin admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:58.764602 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f89f3-0c19-4f73-9041-9f6ca271ddd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:58.782983 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f89f3-0c19-4f73-9041-9f6ca271ddd6 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:58.891064 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 877/1739] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:52:58 2022] POST /identity/v3/users => generated 299 bytes in 716 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:52:58.893212 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f89f3-0c19-4f73-9041-9f6ca271ddd6 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:58.907017 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 863/1740] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:52:58 2022] POST /identity/v3/projects => generated 355 bytes in 851 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:52:58.919983 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e0d60f-51b5-4c4a-a371-f2f09e4d3cc8 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:58.961693 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f89f3-0c19-4f73-9041-9f6ca271ddd6 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:59.200468 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:59.230537 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:59.354353 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e0d60f-51b5-4c4a-a371-f2f09e4d3cc8 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:59.385588 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f327b9-c152-47b8-8f69-0a91df25ae7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:59.387273 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f327b9-c152-47b8-8f69-0a91df25ae7e admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:59.388135 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f327b9-c152-47b8-8f69-0a91df25ae7e admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:59.389725 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f327b9-c152-47b8-8f69-0a91df25ae7e admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:59.391384 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f327b9-c152-47b8-8f69-0a91df25ae7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:59.402276 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55deb07-d7bc-4029-971f-3ae897b95055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:59.403709 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55deb07-d7bc-4029-971f-3ae897b95055 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:59.404015 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55deb07-d7bc-4029-971f-3ae897b95055 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:59.404296 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55deb07-d7bc-4029-971f-3ae897b95055 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:59.405040 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55deb07-d7bc-4029-971f-3ae897b95055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:59.406776 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55deb07-d7bc-4029-971f-3ae897b95055 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:59.407743 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f327b9-c152-47b8-8f69-0a91df25ae7e admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:59.499133 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 878/1741] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 607 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:52:59.504608 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55deb07-d7bc-4029-971f-3ae897b95055 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:59.533592 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 864/1742] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:52:58 2022] POST /identity/v3/users => generated 278 bytes in 620 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:52:59.545218 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f327b9-c152-47b8-8f69-0a91df25ae7e admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:59.582787 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55deb07-d7bc-4029-971f-3ae897b95055 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:59.607771 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f327b9-c152-47b8-8f69-0a91df25ae7e admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:59.618623 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b6f6a-f6b8-461c-8de7-31ce63bb8a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:59.620103 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b6f6a-f6b8-461c-8de7-31ce63bb8a84 admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:59.620822 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b6f6a-f6b8-461c-8de7-31ce63bb8a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:59.622002 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b6f6a-f6b8-461c-8de7-31ce63bb8a84 admin admin] PATH_INFO: `/v3/projects/35089db72b9143d4bccd29b598f8b282/users/95fdf8829376443884965cb709e594a5/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:59.641835 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79fb832-b703-45c2-abbb-aad068f9761e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:59.644218 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fb832-b703-45c2-abbb-aad068f9761e admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:59.648948 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fb832-b703-45c2-abbb-aad068f9761e admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:59.650177 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fb832-b703-45c2-abbb-aad068f9761e admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:59.652452 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79fb832-b703-45c2-abbb-aad068f9761e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:59.656523 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79fb832-b703-45c2-abbb-aad068f9761e admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:59.719414 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 865/1743] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:52:59.727015 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79fb832-b703-45c2-abbb-aad068f9761e admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:59.728284 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30b6f6a-f6b8-461c-8de7-31ce63bb8a84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35089db72b9143d4bccd29b598f8b282, user_id=95fdf8829376443884965cb709e594a5, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:59.742072 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30b6f6a-f6b8-461c-8de7-31ce63bb8a84 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:59.750691 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79fb832-b703-45c2-abbb-aad068f9761e admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:52:59.762722 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ef24d-c7aa-48cb-a954-b0c5ec6b9550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:52:59.764416 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ef24d-c7aa-48cb-a954-b0c5ec6b9550 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:52:59.766356 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ef24d-c7aa-48cb-a954-b0c5ec6b9550 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:52:59.767630 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496ef24d-c7aa-48cb-a954-b0c5ec6b9550 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:52:59.770696 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ef24d-c7aa-48cb-a954-b0c5ec6b9550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:52:59.775843 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496ef24d-c7aa-48cb-a954-b0c5ec6b9550 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:52:59.817983 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 879/1744] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:52:59 2022] PUT /identity/v3/projects/35089db72b9143d4bccd29b598f8b282/users/95fdf8829376443884965cb709e594a5/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:52:59.819659 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b6f6a-f6b8-461c-8de7-31ce63bb8a84 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:59.828114 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 866/1745] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:52:59.858649 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ef24d-c7aa-48cb-a954-b0c5ec6b9550 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:52:59.895851 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496ef24d-c7aa-48cb-a954-b0c5ec6b9550 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:00.227536 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b6f6a-f6b8-461c-8de7-31ce63bb8a84 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:00.246962 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a8cbc-ea09-4d3e-b4c6-1a2f8730a613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:00.250161 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a8cbc-ea09-4d3e-b4c6-1a2f8730a613 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:00.250880 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a8cbc-ea09-4d3e-b4c6-1a2f8730a613 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:00.251533 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a8cbc-ea09-4d3e-b4c6-1a2f8730a613 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:00.253102 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a8cbc-ea09-4d3e-b4c6-1a2f8730a613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:00.260304 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a8cbc-ea09-4d3e-b4c6-1a2f8730a613 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:00.297791 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a7e9c-3fda-49f0-97c7-3195b9c4e0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:00.305358 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a7e9c-3fda-49f0-97c7-3195b9c4e0f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:00.308647 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 880/1746] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 490 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:53:00.309726 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a7e9c-3fda-49f0-97c7-3195b9c4e0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:00.310442 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a7e9c-3fda-49f0-97c7-3195b9c4e0f3 admin admin] PATH_INFO: `/v3/projects/660a1e0fa97c49d3be46e55561456ffc/users/1f8a7e2d3f384f7a96f9a01c4e711ec3/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:00.325506 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a8cbc-ea09-4d3e-b4c6-1a2f8730a613 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:00.365874 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a8cbc-ea09-4d3e-b4c6-1a2f8730a613 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:00.388518 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cdf999-6de8-42d0-97de-e40d44ecf6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:00.390464 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdf999-6de8-42d0-97de-e40d44ecf6f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:00.391374 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdf999-6de8-42d0-97de-e40d44ecf6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:00.392425 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cdf999-6de8-42d0-97de-e40d44ecf6f4 admin admin] PATH_INFO: `/v3/projects/35089db72b9143d4bccd29b598f8b282/users/95fdf8829376443884965cb709e594a5/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:00.398076 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cdf999-6de8-42d0-97de-e40d44ecf6f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35089db72b9143d4bccd29b598f8b282, user_id=95fdf8829376443884965cb709e594a5, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:00.403840 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cdf999-6de8-42d0-97de-e40d44ecf6f4 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:00.413111 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a7e9c-3fda-49f0-97c7-3195b9c4e0f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=660a1e0fa97c49d3be46e55561456ffc, user_id=1f8a7e2d3f384f7a96f9a01c4e711ec3, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:00.424451 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a7e9c-3fda-49f0-97c7-3195b9c4e0f3 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:00.456187 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 881/1747] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:53:00 2022] PUT /identity/v3/projects/35089db72b9143d4bccd29b598f8b282/users/95fdf8829376443884965cb709e594a5/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:53:00.481021 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d907770-f4ed-49ab-acac-616d35b9e409 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:00.482249 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d907770-f4ed-49ab-acac-616d35b9e409 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:00.484369 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d907770-f4ed-49ab-acac-616d35b9e409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:00.506054 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 867/1748] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:52:59 2022] PUT /identity/v3/projects/660a1e0fa97c49d3be46e55561456ffc/users/1f8a7e2d3f384f7a96f9a01c4e711ec3/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:53:00.535762 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0014fe4-02bb-4994-8db8-96d5365e43f5 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:00.536387 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0014fe4-02bb-4994-8db8-96d5365e43f5 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:00.537854 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0014fe4-02bb-4994-8db8-96d5365e43f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:00.693667 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-5d907770-f4ed-49ab-acac-616d35b9e409 None None] MFA Rules not processed for user `95fdf8829376443884965cb709e594a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:00.695951 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-5d907770-f4ed-49ab-acac-616d35b9e409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:00.747110 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-b0014fe4-02bb-4994-8db8-96d5365e43f5 None None] MFA Rules not processed for user `1f8a7e2d3f384f7a96f9a01c4e711ec3`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:00.749551 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-b0014fe4-02bb-4994-8db8-96d5365e43f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:01.329916 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 868/1749] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:53:00 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 798 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:53:01.338337 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0014fe4-02bb-4994-8db8-96d5365e43f5 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:01.467098 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 882/1750] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:53:00 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 991 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:53:01.501178 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7143a-f58d-4713-9546-f6badc17c239 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:01.501351 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7143a-f58d-4713-9546-f6badc17c239 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:01.501767 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7143a-f58d-4713-9546-f6badc17c239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:01.509310 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:01.606433 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-e4e7143a-f58d-4713-9546-f6badc17c239 None None] MFA Rules not processed for user `75833fc0653b47109404543767abd3f2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:01.608787 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-e4e7143a-f58d-4713-9546-f6badc17c239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:01.647455 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:01.860926 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0014fe4-02bb-4994-8db8-96d5365e43f5 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:01.882797 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26bd59b-c1b4-489a-8244-078b38d1efc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:01.884011 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26bd59b-c1b4-489a-8244-078b38d1efc1 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:01.884521 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26bd59b-c1b4-489a-8244-078b38d1efc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:01.885269 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26bd59b-c1b4-489a-8244-078b38d1efc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:01.888268 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26bd59b-c1b4-489a-8244-078b38d1efc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:01.892930 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26bd59b-c1b4-489a-8244-078b38d1efc1 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:02.044870 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 869/1751] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:53:01 2022] POST /identity/v3/projects => generated 355 bytes in 703 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:53:02.045124 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 883/1752] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:53:01 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 542 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:53:02.045270 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26bd59b-c1b4-489a-8244-078b38d1efc1 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:02.065886 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44e547-884a-436a-8302-59dd0b786b66 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:02.067821 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-e26bd59b-c1b4-489a-8244-078b38d1efc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:02.068154 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44e547-884a-436a-8302-59dd0b786b66 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:02.068154 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44e547-884a-436a-8302-59dd0b786b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:02.229733 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-4e44e547-884a-436a-8302-59dd0b786b66 None None] MFA Rules not processed for user `c38575a2f7bc408f8b5eb58ad513c078`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:02.242470 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-4e44e547-884a-436a-8302-59dd0b786b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:02.485721 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26bd59b-c1b4-489a-8244-078b38d1efc1 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:02.507701 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a78b71-1c80-411e-8033-bc5de2acfa23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:02.513201 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a78b71-1c80-411e-8033-bc5de2acfa23 service cinder] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:02.513830 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a78b71-1c80-411e-8033-bc5de2acfa23 service cinder] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:02.514134 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a78b71-1c80-411e-8033-bc5de2acfa23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:02.688624 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 884/1753] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:53:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 646 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:53:02.690185 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44e547-884a-436a-8302-59dd0b786b66 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:02.866045 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a78b71-1c80-411e-8033-bc5de2acfa23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:02.879406 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a78b71-1c80-411e-8033-bc5de2acfa23 service cinder] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:02.945557 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 870/1754] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:53:02 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 904 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:53:02.949988 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a78b71-1c80-411e-8033-bc5de2acfa23 service cinder] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:02.956104 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-63a78b71-1c80-411e-8033-bc5de2acfa23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:03.023056 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44e547-884a-436a-8302-59dd0b786b66 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:03.045346 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a35bf-7457-47ba-be83-1973c420b9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:03.046179 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a35bf-7457-47ba-be83-1973c420b9f6 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:03.046613 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a35bf-7457-47ba-be83-1973c420b9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:03.047018 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a35bf-7457-47ba-be83-1973c420b9f6 admin admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:03.048217 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3a35bf-7457-47ba-be83-1973c420b9f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:03.052704 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3a35bf-7457-47ba-be83-1973c420b9f6 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:03.144571 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 885/1755] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:53:02 2022] POST /identity/v3/users => generated 284 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:53:03.146983 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea01a2-de70-474f-a516-4af23a6660c3 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:03.147421 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea01a2-de70-474f-a516-4af23a6660c3 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:03.147920 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea01a2-de70-474f-a516-4af23a6660c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:03.243294 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:03.274040 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-5fea01a2-de70-474f-a516-4af23a6660c3 None None] MFA Rules not processed for user `75cd9652625a4935a9af31bd4549ccf1`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:03.276355 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-5fea01a2-de70-474f-a516-4af23a6660c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:03.297615 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a78b71-1c80-411e-8033-bc5de2acfa23 service cinder] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:03.317760 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6876a10a-a608-440d-8581-2ba7fb29bf1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:03.319004 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876a10a-a608-440d-8581-2ba7fb29bf1a admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:03.320046 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876a10a-a608-440d-8581-2ba7fb29bf1a admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:03.320566 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876a10a-a608-440d-8581-2ba7fb29bf1a admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:03.321867 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6876a10a-a608-440d-8581-2ba7fb29bf1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:03.334294 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:03.349000 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6876a10a-a608-440d-8581-2ba7fb29bf1a admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:03.470990 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 871/1756] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:53:02 2022] POST /identity/v3/projects => generated 405 bytes in 525 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:53:03.491102 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eaf8d6-cf49-4e46-9c62-7ab872e3a7f4 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:03.494266 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eaf8d6-cf49-4e46-9c62-7ab872e3a7f4 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:03.495361 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eaf8d6-cf49-4e46-9c62-7ab872e3a7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:03.570266 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-33eaf8d6-cf49-4e46-9c62-7ab872e3a7f4 None None] MFA Rules not processed for user `5eb6e03e874d4b28aaf21c5b36f7bb98`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:03.574851 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-33eaf8d6-cf49-4e46-9c62-7ab872e3a7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:03.594323 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 886/1757] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:53:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 449 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:53:03.600332 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea01a2-de70-474f-a516-4af23a6660c3 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:03.623324 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-5fea01a2-de70-474f-a516-4af23a6660c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:03.871441 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 872/1758] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:53:03 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:53:03.874486 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eaf8d6-cf49-4e46-9c62-7ab872e3a7f4 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:03.972876 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea01a2-de70-474f-a516-4af23a6660c3 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:04.249238 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eaf8d6-cf49-4e46-9c62-7ab872e3a7f4 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:04.285003 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7aac0-5c01-4337-bdf4-398161a1f4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:04.287883 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7aac0-5c01-4337-bdf4-398161a1f4d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:04.288680 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7aac0-5c01-4337-bdf4-398161a1f4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:04.289408 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7aac0-5c01-4337-bdf4-398161a1f4d7 admin admin] PATH_INFO: `/v3/users/2f596cab25dd4ae98f6acdd6337e8415` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:04.295183 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7aac0-5c01-4337-bdf4-398161a1f4d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f596cab25dd4ae98f6acdd6337e8415)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:04.302147 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7aac0-5c01-4337-bdf4-398161a1f4d7 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:04.354860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82026064-b71f-4587-954c-f84e8d8f3099 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:04.360422 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82026064-b71f-4587-954c-f84e8d8f3099 service nova] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:04.361121 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82026064-b71f-4587-954c-f84e8d8f3099 service nova] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:04.367013 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82026064-b71f-4587-954c-f84e8d8f3099 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:04.471367 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-4db7aac0-5c01-4337-bdf4-398161a1f4d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f596cab25dd4ae98f6acdd6337e8415'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:04.474875 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-4db7aac0-5c01-4337-bdf4-398161a1f4d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f596cab25dd4ae98f6acdd6337e8415'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:04.509542 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-4db7aac0-5c01-4337-bdf4-398161a1f4d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f596cab25dd4ae98f6acdd6337e8415'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:04.586341 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-4db7aac0-5c01-4337-bdf4-398161a1f4d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f596cab25dd4ae98f6acdd6337e8415'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:04.587950 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-4db7aac0-5c01-4337-bdf4-398161a1f4d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f596cab25dd4ae98f6acdd6337e8415'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:04.603771 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:04.637615 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82026064-b71f-4587-954c-f84e8d8f3099 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:04.646538 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82026064-b71f-4587-954c-f84e8d8f3099 service nova] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:04.685346 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 887/1759] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:53:03 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 1090 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:53:04.686858 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82026064-b71f-4587-954c-f84e8d8f3099 service nova] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:04.713581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 873/1760] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:53:03 2022] DELETE /identity/v3/users/2f596cab25dd4ae98f6acdd6337e8415 => generated 0 bytes in 841 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:53:04.715245 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7aac0-5c01-4337-bdf4-398161a1f4d7 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:04.725131 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-4db7aac0-5c01-4337-bdf4-398161a1f4d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:04.783436 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82026064-b71f-4587-954c-f84e8d8f3099 service nova] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:04.793637 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:05.044252 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d741e-3725-40dd-8f4b-f7386797c669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:05.051246 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d741e-3725-40dd-8f4b-f7386797c669 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:05.052151 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d741e-3725-40dd-8f4b-f7386797c669 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:05.054583 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d741e-3725-40dd-8f4b-f7386797c669 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:05.058027 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d741e-3725-40dd-8f4b-f7386797c669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:05.063159 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d741e-3725-40dd-8f4b-f7386797c669 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:05.109051 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 888/1761] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:53:04 2022] GET /identity/v3/roles => generated 1420 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:53:05.110665 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d741e-3725-40dd-8f4b-f7386797c669 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:05.114600 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-b53d741e-3725-40dd-8f4b-f7386797c669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:05.296331 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d741e-3725-40dd-8f4b-f7386797c669 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:05.325243 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7aac0-5c01-4337-bdf4-398161a1f4d7 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:05.332569 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99506d3e-85fa-40ed-931a-72590e7e45eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:05.333228 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99506d3e-85fa-40ed-931a-72590e7e45eb service nova] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:05.333647 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99506d3e-85fa-40ed-931a-72590e7e45eb service nova] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:05.333997 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99506d3e-85fa-40ed-931a-72590e7e45eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:05.336716 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-99506d3e-85fa-40ed-931a-72590e7e45eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:05.372007 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be00595-1fd6-4e80-b1b8-496bdd8a1808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:05.377812 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be00595-1fd6-4e80-b1b8-496bdd8a1808 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:05.382343 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be00595-1fd6-4e80-b1b8-496bdd8a1808 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:05.396020 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be00595-1fd6-4e80-b1b8-496bdd8a1808 admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:05.401162 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be00595-1fd6-4e80-b1b8-496bdd8a1808 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:05.415087 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be00595-1fd6-4e80-b1b8-496bdd8a1808 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:05.480187 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99506d3e-85fa-40ed-931a-72590e7e45eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:05.483625 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99506d3e-85fa-40ed-931a-72590e7e45eb service nova] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:05.514729 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 889/1762] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:53:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:53:05.522155 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc050d25-eea0-4bb5-a160-3b0cf4a27de3 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:05.523164 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc050d25-eea0-4bb5-a160-3b0cf4a27de3 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:05.525266 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc050d25-eea0-4bb5-a160-3b0cf4a27de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:05.555169 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 874/1763] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:53:04 2022] POST /identity/v3/users => generated 309 bytes in 841 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:53:05.567787 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be00595-1fd6-4e80-b1b8-496bdd8a1808 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:05.576321 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-1be00595-1fd6-4e80-b1b8-496bdd8a1808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:05.608685 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-dc050d25-eea0-4bb5-a160-3b0cf4a27de3 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:05.615276 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-dc050d25-eea0-4bb5-a160-3b0cf4a27de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:05.641571 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 890/1764] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:53:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:53:05.645816 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8a9d1-ef36-4f69-9ea9-da1e3e8bcd54 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:05.650319 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be00595-1fd6-4e80-b1b8-496bdd8a1808 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:05.675188 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8a9d1-ef36-4f69-9ea9-da1e3e8bcd54 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:05.675872 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8a9d1-ef36-4f69-9ea9-da1e3e8bcd54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:05.676362 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd2f7e-dd77-444e-874c-4b02176a218b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:05.680052 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd2f7e-dd77-444e-874c-4b02176a218b admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:05.688100 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd2f7e-dd77-444e-874c-4b02176a218b admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:05.689438 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd2f7e-dd77-444e-874c-4b02176a218b admin admin] PATH_INFO: `/v3/projects/3934c55d49fb470c828c64a502c85560/users/205d09be91df4e5088a5d84b0855951c/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:05.775794 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fd2f7e-dd77-444e-874c-4b02176a218b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3934c55d49fb470c828c64a502c85560, user_id=205d09be91df4e5088a5d84b0855951c, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:05.776846 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:05.788866 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fd2f7e-dd77-444e-874c-4b02176a218b admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:05.847073 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 875/1765] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:53:05 2022] PUT /identity/v3/projects/3934c55d49fb470c828c64a502c85560/users/205d09be91df4e5088a5d84b0855951c/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:53:05.857913 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-01e8a9d1-ef36-4f69-9ea9-da1e3e8bcd54 None None] MFA Rules not processed for user `6d2dd101d1a14e5ab95f272ab1bbeb94`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:05.859985 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-01e8a9d1-ef36-4f69-9ea9-da1e3e8bcd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:05.865108 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd2f7e-dd77-444e-874c-4b02176a218b admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:06.229843 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd2f7e-dd77-444e-874c-4b02176a218b admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:06.294185 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af74830-f215-4a64-a398-c188f20684ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:06.295312 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af74830-f215-4a64-a398-c188f20684ac admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:06.295812 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af74830-f215-4a64-a398-c188f20684ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:06.296320 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af74830-f215-4a64-a398-c188f20684ac admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:06.297659 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af74830-f215-4a64-a398-c188f20684ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:06.321583 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af74830-f215-4a64-a398-c188f20684ac admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:06.339480 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 891/1766] 10.222.0.69 () {58 vars in 1009 bytes} [Thu Sep 8 13:53:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 697 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:53:06.340867 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e8a9d1-ef36-4f69-9ea9-da1e3e8bcd54 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:06.352247 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-01e8a9d1-ef36-4f69-9ea9-da1e3e8bcd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:06.393180 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 876/1767] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:53:05 2022] GET /identity/v3/roles => generated 1420 bytes in 545 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:53:06.400461 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af74830-f215-4a64-a398-c188f20684ac admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:06.475798 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af74830-f215-4a64-a398-c188f20684ac admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:06.504000 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d3f1c9-b608-47b4-881a-b87cf2f9f9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:06.506945 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3f1c9-b608-47b4-881a-b87cf2f9f9c9 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:06.507540 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3f1c9-b608-47b4-881a-b87cf2f9f9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:06.507951 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3f1c9-b608-47b4-881a-b87cf2f9f9c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:06.514332 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d3f1c9-b608-47b4-881a-b87cf2f9f9c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:06.527341 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d3f1c9-b608-47b4-881a-b87cf2f9f9c9 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:06.586522 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 877/1768] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:53:06.588453 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d3f1c9-b608-47b4-881a-b87cf2f9f9c9 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:06.638376 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d3f1c9-b608-47b4-881a-b87cf2f9f9c9 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:06.670368 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f524bc2-30bd-496d-a037-89f00afbc8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:06.671613 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f524bc2-30bd-496d-a037-89f00afbc8ea admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:06.672149 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f524bc2-30bd-496d-a037-89f00afbc8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:06.681601 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f524bc2-30bd-496d-a037-89f00afbc8ea admin admin] PATH_INFO: `/v3/projects/92e60ea013bd4e4e9e3dd4dd84ce0187/users/d2c7a213a3304503943f053a3238d426/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:06.707521 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e8a9d1-ef36-4f69-9ea9-da1e3e8bcd54 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:06.724492 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5ab33-aa1b-41ff-95f7-dad6465edaee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:06.728988 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5ab33-aa1b-41ff-95f7-dad6465edaee service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:06.732621 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5ab33-aa1b-41ff-95f7-dad6465edaee service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:06.733355 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5ab33-aa1b-41ff-95f7-dad6465edaee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:06.762592 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f524bc2-30bd-496d-a037-89f00afbc8ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=92e60ea013bd4e4e9e3dd4dd84ce0187, user_id=d2c7a213a3304503943f053a3238d426, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:06.777961 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f524bc2-30bd-496d-a037-89f00afbc8ea admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:06.781999 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a5ab33-aa1b-41ff-95f7-dad6465edaee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:06.785327 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a5ab33-aa1b-41ff-95f7-dad6465edaee service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:06.809601 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 892/1769] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:53:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:53:06.811133 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5ab33-aa1b-41ff-95f7-dad6465edaee service neutron] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:06.825084 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 878/1770] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:53:06 2022] PUT /identity/v3/projects/92e60ea013bd4e4e9e3dd4dd84ce0187/users/d2c7a213a3304503943f053a3238d426/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:53:06.827091 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5ab33-aa1b-41ff-95f7-dad6465edaee service neutron] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:06.830941 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f524bc2-30bd-496d-a037-89f00afbc8ea admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:06.840084 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-7f524bc2-30bd-496d-a037-89f00afbc8ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:06.994733 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:07.091934 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5942205-1489-4eaf-acfa-2db5d2503b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:07.094525 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5942205-1489-4eaf-acfa-2db5d2503b50 admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:07.096417 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5942205-1489-4eaf-acfa-2db5d2503b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:07.100056 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5942205-1489-4eaf-acfa-2db5d2503b50 admin admin] PATH_INFO: `/v3/projects/3934c55d49fb470c828c64a502c85560/users/205d09be91df4e5088a5d84b0855951c/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:07.112223 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5942205-1489-4eaf-acfa-2db5d2503b50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3934c55d49fb470c828c64a502c85560, user_id=205d09be91df4e5088a5d84b0855951c, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:07.135663 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5942205-1489-4eaf-acfa-2db5d2503b50 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:07.204034 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 893/1771] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:53:06 2022] PUT /identity/v3/projects/3934c55d49fb470c828c64a502c85560/users/205d09be91df4e5088a5d84b0855951c/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:53:07.231139 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5942205-1489-4eaf-acfa-2db5d2503b50 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:07.392158 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f524bc2-30bd-496d-a037-89f00afbc8ea admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:07.439045 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:07.650663 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5942205-1489-4eaf-acfa-2db5d2503b50 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:07.673884 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a1973e-4377-4c7b-b0c5-21f275182158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:07.676127 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1973e-4377-4c7b-b0c5-21f275182158 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:07.678817 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1973e-4377-4c7b-b0c5-21f275182158 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:07.679724 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a1973e-4377-4c7b-b0c5-21f275182158 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:07.682304 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a1973e-4377-4c7b-b0c5-21f275182158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:07.690448 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a1973e-4377-4c7b-b0c5-21f275182158 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:07.695065 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51a1a0-1730-4b62-acfb-9631f2bbef04 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9b97592a6840c3865d7dcf886221e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:07.695065 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51a1a0-1730-4b62-acfb-9631f2bbef04 service swift] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:07.695804 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51a1a0-1730-4b62-acfb-9631f2bbef04 service swift] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:07.696076 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51a1a0-1730-4b62-acfb-9631f2bbef04 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:07.747552 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 894/1772] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 543 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:53:07.756091 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93803943-0820-4e7b-a83b-1093c86a553c None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:07.757905 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93803943-0820-4e7b-a83b-1093c86a553c None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:07.758601 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93803943-0820-4e7b-a83b-1093c86a553c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:07.835004 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea51a1a0-1730-4b62-acfb-9631f2bbef04 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:07.839869 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea51a1a0-1730-4b62-acfb-9631f2bbef04 service swift] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:07.870430 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-93803943-0820-4e7b-a83b-1093c86a553c None None] MFA Rules not processed for user `205d09be91df4e5088a5d84b0855951c`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:07.872555 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-93803943-0820-4e7b-a83b-1093c86a553c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:07.877029 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 879/1773] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Sep 8 13:53:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 1051 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 13:53:07.878752 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51a1a0-1730-4b62-acfb-9631f2bbef04 service swift] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:07.893740 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-ea51a1a0-1730-4b62-acfb-9631f2bbef04 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:08.046724 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51a1a0-1730-4b62-acfb-9631f2bbef04 service swift] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:08.077891 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e7301-47c0-4a3b-9886-970e4d656a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:08.084075 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e7301-47c0-4a3b-9886-970e4d656a1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:08.086013 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e7301-47c0-4a3b-9886-970e4d656a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:08.089175 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e7301-47c0-4a3b-9886-970e4d656a1d admin admin] PATH_INFO: `/v3/users/642ac7310790423aa425eccce07043d9` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:08.096723 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e7301-47c0-4a3b-9886-970e4d656a1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=642ac7310790423aa425eccce07043d9)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:08.107962 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303e7301-47c0-4a3b-9886-970e4d656a1d admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:08.377753 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 895/1774] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:53:07 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 629 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:53:08.381959 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e7d7a-ede2-4be1-adf8-6e39738317ac None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:08.386437 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e7d7a-ede2-4be1-adf8-6e39738317ac None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:08.387483 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e7d7a-ede2-4be1-adf8-6e39738317ac None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:08.399254 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 896/1775] 10.222.0.69 () {54 vars in 912 bytes} [Thu Sep 8 13:53:08 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:53:08.401351 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e7d7a-ede2-4be1-adf8-6e39738317ac None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:08.433078 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e7d7a-ede2-4be1-adf8-6e39738317ac None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:08.457303 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-303e7301-47c0-4a3b-9886-970e4d656a1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '642ac7310790423aa425eccce07043d9'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:08.458922 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8e0bd-7324-4582-815b-febb19fa26c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:08.460961 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8e0bd-7324-4582-815b-febb19fa26c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:08.466113 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8e0bd-7324-4582-815b-febb19fa26c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:08.468215 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-303e7301-47c0-4a3b-9886-970e4d656a1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '642ac7310790423aa425eccce07043d9'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:08.469222 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8e0bd-7324-4582-815b-febb19fa26c3 admin admin] PATH_INFO: `/v3/projects/92e60ea013bd4e4e9e3dd4dd84ce0187/users/d2c7a213a3304503943f053a3238d426/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:08.480789 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be8e0bd-7324-4582-815b-febb19fa26c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92e60ea013bd4e4e9e3dd4dd84ce0187, user_id=d2c7a213a3304503943f053a3238d426, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:08.491502 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:08.492321 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be8e0bd-7324-4582-815b-febb19fa26c3 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:08.551308 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-303e7301-47c0-4a3b-9886-970e4d656a1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '642ac7310790423aa425eccce07043d9'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:08.560761 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 897/1776] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:53:08 2022] PUT /identity/v3/projects/92e60ea013bd4e4e9e3dd4dd84ce0187/users/d2c7a213a3304503943f053a3238d426/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:53:08.560761 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4e9f5-5a07-4a6e-b7dc-ad70cc5cabde None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:08.560761 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4e9f5-5a07-4a6e-b7dc-ad70cc5cabde None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:08.560761 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4e9f5-5a07-4a6e-b7dc-ad70cc5cabde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:08.655389 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-e6e4e9f5-5a07-4a6e-b7dc-ad70cc5cabde None None] MFA Rules not processed for user `db898158553743d3a28f3d6237e91a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:08.655389 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-e6e4e9f5-5a07-4a6e-b7dc-ad70cc5cabde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:08.666106 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-303e7301-47c0-4a3b-9886-970e4d656a1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '642ac7310790423aa425eccce07043d9'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:08.676013 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-303e7301-47c0-4a3b-9886-970e4d656a1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '642ac7310790423aa425eccce07043d9'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:08.793603 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 880/1777] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:53:07 2022] DELETE /identity/v3/users/642ac7310790423aa425eccce07043d9 => generated 0 bytes in 916 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:53:08.799332 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e7301-47c0-4a3b-9886-970e4d656a1d admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:08.811125 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-303e7301-47c0-4a3b-9886-970e4d656a1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:08.869401 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 898/1778] 10.222.0.69 () {58 vars in 1009 bytes} [Thu Sep 8 13:53:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:53:08.871635 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27e4a7-d164-40e9-9f99-742ba2ce027b None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:08.871992 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27e4a7-d164-40e9-9f99-742ba2ce027b None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:08.872441 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27e4a7-d164-40e9-9f99-742ba2ce027b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:08.991679 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-7a27e4a7-d164-40e9-9f99-742ba2ce027b None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:08.993961 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-7a27e4a7-d164-40e9-9f99-742ba2ce027b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:09.174929 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e7301-47c0-4a3b-9886-970e4d656a1d admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:09.212002 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5bafdb-38a0-410b-a31c-d619630ece5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:09.213062 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5bafdb-38a0-410b-a31c-d619630ece5b service cinder] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:09.213546 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5bafdb-38a0-410b-a31c-d619630ece5b service cinder] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:09.214017 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5bafdb-38a0-410b-a31c-d619630ece5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:09.227153 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-6a5bafdb-38a0-410b-a31c-d619630ece5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:09.333096 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:09.450460 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 899/1779] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:53:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 580 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:53:09.460030 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27e4a7-d164-40e9-9f99-742ba2ce027b None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:09.467461 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-7a27e4a7-d164-40e9-9f99-742ba2ce027b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:09.632234 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5bafdb-38a0-410b-a31c-d619630ece5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:09.635734 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5bafdb-38a0-410b-a31c-d619630ece5b service cinder] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:09.677795 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 881/1780] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:53:08 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 884 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:53:09.679276 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5bafdb-38a0-410b-a31c-d619630ece5b service cinder] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:09.707645 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-6a5bafdb-38a0-410b-a31c-d619630ece5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:09.798638 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27e4a7-d164-40e9-9f99-742ba2ce027b None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:09.838938 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a55f3-4fa8-449d-8e10-50ebe2bbfc27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:09.842568 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a55f3-4fa8-449d-8e10-50ebe2bbfc27 service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:09.843120 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a55f3-4fa8-449d-8e10-50ebe2bbfc27 service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:09.843676 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a55f3-4fa8-449d-8e10-50ebe2bbfc27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:09.902815 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6a55f3-4fa8-449d-8e10-50ebe2bbfc27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:09.917073 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6a55f3-4fa8-449d-8e10-50ebe2bbfc27 service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:09.986205 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 900/1781] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:53:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:53:09.988118 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a55f3-4fa8-449d-8e10-50ebe2bbfc27 service neutron] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:10.030614 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a55f3-4fa8-449d-8e10-50ebe2bbfc27 service neutron] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:10.049875 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8bdd4b-3982-4094-bde4-a3f0bed3eab9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:10.052924 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bdd4b-3982-4094-bde4-a3f0bed3eab9 service cinder] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:10.065815 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bdd4b-3982-4094-bde4-a3f0bed3eab9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:10.076644 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8bdd4b-3982-4094-bde4-a3f0bed3eab9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:10.078728 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5bafdb-38a0-410b-a31c-d619630ece5b service cinder] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:10.089227 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-bd8bdd4b-3982-4094-bde4-a3f0bed3eab9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:10.127217 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab364ee-4ac5-4236-a130-71681690b0cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:10.128440 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab364ee-4ac5-4236-a130-71681690b0cd service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:10.134186 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab364ee-4ac5-4236-a130-71681690b0cd service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:10.134675 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab364ee-4ac5-4236-a130-71681690b0cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:10.179865 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab364ee-4ac5-4236-a130-71681690b0cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:10.184722 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab364ee-4ac5-4236-a130-71681690b0cd service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:10.230741 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 882/1782] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:53:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:53:10.514278 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8bdd4b-3982-4094-bde4-a3f0bed3eab9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:10.519203 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8bdd4b-3982-4094-bde4-a3f0bed3eab9 service cinder] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:10.582617 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 901/1783] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:53:09 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:53:12.345704 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f376e-19e2-4541-93a4-3c26b4f525ed None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:12.346477 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f376e-19e2-4541-93a4-3c26b4f525ed None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:12.346824 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f376e-19e2-4541-93a4-3c26b4f525ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:12.529010 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-e22f376e-19e2-4541-93a4-3c26b4f525ed None None] MFA Rules not processed for user `db898158553743d3a28f3d6237e91a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:12.543090 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-e22f376e-19e2-4541-93a4-3c26b4f525ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:12.647162 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 883/1784] 10.222.0.112 () {58 vars in 1016 bytes} [Thu Sep 8 13:53:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:53:12.952010 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8bdd4b-3982-4094-bde4-a3f0bed3eab9 service cinder] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:13.015777 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8bdd4b-3982-4094-bde4-a3f0bed3eab9 service cinder] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:13.048614 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0bd74-73ea-47ff-b990-553d1dbf989b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:13.051889 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0bd74-73ea-47ff-b990-553d1dbf989b service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:13.054045 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0bd74-73ea-47ff-b990-553d1dbf989b service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:13.054648 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0bd74-73ea-47ff-b990-553d1dbf989b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:13.121460 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf0bd74-73ea-47ff-b990-553d1dbf989b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:13.132357 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf0bd74-73ea-47ff-b990-553d1dbf989b service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:13.207457 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 902/1785] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:53:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:53:13.682782 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f376e-19e2-4541-93a4-3c26b4f525ed None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:13.685055 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-e22f376e-19e2-4541-93a4-3c26b4f525ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:13.755386 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f376e-19e2-4541-93a4-3c26b4f525ed None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:13.796206 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe14534-e5f9-47ea-a1c2-ee34a17bb479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:13.798978 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe14534-e5f9-47ea-a1c2-ee34a17bb479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:13.804860 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe14534-e5f9-47ea-a1c2-ee34a17bb479 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:13.805838 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe14534-e5f9-47ea-a1c2-ee34a17bb479 admin admin] PATH_INFO: `/v3/projects/4ece43cb7aa640e7b4104d725efcb572` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:13.812744 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe14534-e5f9-47ea-a1c2-ee34a17bb479 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ece43cb7aa640e7b4104d725efcb572)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:13.819231 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe14534-e5f9-47ea-a1c2-ee34a17bb479 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:13.873280 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:14.129046 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-7fe14534-e5f9-47ea-a1c2-ee34a17bb479 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ece43cb7aa640e7b4104d725efcb572', 'request_id': 'req-7fe14534-e5f9-47ea-a1c2-ee34a17bb479'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:14.167625 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-7fe14534-e5f9-47ea-a1c2-ee34a17bb479 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ece43cb7aa640e7b4104d725efcb572', 'request_id': 'req-7fe14534-e5f9-47ea-a1c2-ee34a17bb479'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:14.214084 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-7fe14534-e5f9-47ea-a1c2-ee34a17bb479 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ece43cb7aa640e7b4104d725efcb572', 'request_id': 'req-7fe14534-e5f9-47ea-a1c2-ee34a17bb479'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:14.257791 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-7fe14534-e5f9-47ea-a1c2-ee34a17bb479 admin admin] The token cache is being invalidate because project 4ece43cb7aa640e7b4104d725efcb572 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:53:14.258768 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-7fe14534-e5f9-47ea-a1c2-ee34a17bb479 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:14.261891 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-7fe14534-e5f9-47ea-a1c2-ee34a17bb479 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:14.270240 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 884/1786] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:53:13 2022] DELETE /identity/v3/projects/4ece43cb7aa640e7b4104d725efcb572 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:53:14.273756 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0bd74-73ea-47ff-b990-553d1dbf989b service neutron] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:14.310957 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0bd74-73ea-47ff-b990-553d1dbf989b service neutron] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:14.568694 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589afeca-7d63-4655-91e5-65a550bafe83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:14.570277 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589afeca-7d63-4655-91e5-65a550bafe83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:14.571292 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589afeca-7d63-4655-91e5-65a550bafe83 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:14.571980 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589afeca-7d63-4655-91e5-65a550bafe83 admin admin] PATH_INFO: `/v3/users/95fdf8829376443884965cb709e594a5` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:14.575546 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589afeca-7d63-4655-91e5-65a550bafe83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95fdf8829376443884965cb709e594a5)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:14.583129 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589afeca-7d63-4655-91e5-65a550bafe83 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:14.631509 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:14.769784 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-589afeca-7d63-4655-91e5-65a550bafe83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95fdf8829376443884965cb709e594a5'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:14.786698 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-589afeca-7d63-4655-91e5-65a550bafe83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95fdf8829376443884965cb709e594a5'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:14.803671 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-589afeca-7d63-4655-91e5-65a550bafe83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95fdf8829376443884965cb709e594a5'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:14.857106 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-589afeca-7d63-4655-91e5-65a550bafe83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95fdf8829376443884965cb709e594a5'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:14.920965 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-589afeca-7d63-4655-91e5-65a550bafe83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95fdf8829376443884965cb709e594a5'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:14.970214 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 903/1787] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:53:14 2022] DELETE /identity/v3/users/95fdf8829376443884965cb709e594a5 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:53:18.418518 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe14534-e5f9-47ea-a1c2-ee34a17bb479 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:18.422128 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-7fe14534-e5f9-47ea-a1c2-ee34a17bb479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:18.533357 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe14534-e5f9-47ea-a1c2-ee34a17bb479 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:18.950029 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea1651-4818-47c8-9e88-2297d62b05cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:18.953664 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea1651-4818-47c8-9e88-2297d62b05cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:18.955953 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea1651-4818-47c8-9e88-2297d62b05cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:18.958717 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea1651-4818-47c8-9e88-2297d62b05cd admin admin] PATH_INFO: `/v3/projects/729ac0bcfdb14a97bc21ef3a7a4c267b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:18.961788 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea1651-4818-47c8-9e88-2297d62b05cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=729ac0bcfdb14a97bc21ef3a7a4c267b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:18.967309 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ea1651-4818-47c8-9e88-2297d62b05cd admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:19.271707 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-e2ea1651-4818-47c8-9e88-2297d62b05cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '729ac0bcfdb14a97bc21ef3a7a4c267b', 'request_id': 'req-e2ea1651-4818-47c8-9e88-2297d62b05cd'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:19.336172 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-e2ea1651-4818-47c8-9e88-2297d62b05cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '729ac0bcfdb14a97bc21ef3a7a4c267b', 'request_id': 'req-e2ea1651-4818-47c8-9e88-2297d62b05cd'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:19.367124 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-e2ea1651-4818-47c8-9e88-2297d62b05cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '729ac0bcfdb14a97bc21ef3a7a4c267b', 'request_id': 'req-e2ea1651-4818-47c8-9e88-2297d62b05cd'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:19.421122 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-e2ea1651-4818-47c8-9e88-2297d62b05cd admin admin] The token cache is being invalidate because project 729ac0bcfdb14a97bc21ef3a7a4c267b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:53:19.425776 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-e2ea1651-4818-47c8-9e88-2297d62b05cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:19.430379 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-e2ea1651-4818-47c8-9e88-2297d62b05cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:19.454684 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 885/1788] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:53:18 2022] DELETE /identity/v3/projects/729ac0bcfdb14a97bc21ef3a7a4c267b => generated 0 bytes in 1037 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:53:19.471024 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589afeca-7d63-4655-91e5-65a550bafe83 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:19.474360 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-589afeca-7d63-4655-91e5-65a550bafe83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:19.563329 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589afeca-7d63-4655-91e5-65a550bafe83 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:20.068829 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a067f641-a8e9-4e8b-abd7-44d7bac74e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:20.071644 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067f641-a8e9-4e8b-abd7-44d7bac74e5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:20.075704 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067f641-a8e9-4e8b-abd7-44d7bac74e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:20.075704 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067f641-a8e9-4e8b-abd7-44d7bac74e5d admin admin] PATH_INFO: `/v3/users/4f348121b6054fdc803f03bd309df40c` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:20.080312 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a067f641-a8e9-4e8b-abd7-44d7bac74e5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f348121b6054fdc803f03bd309df40c)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:20.089192 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a067f641-a8e9-4e8b-abd7-44d7bac74e5d admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:20.274941 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-a067f641-a8e9-4e8b-abd7-44d7bac74e5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f348121b6054fdc803f03bd309df40c'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:20.279811 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-a067f641-a8e9-4e8b-abd7-44d7bac74e5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f348121b6054fdc803f03bd309df40c'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:20.280930 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-a067f641-a8e9-4e8b-abd7-44d7bac74e5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f348121b6054fdc803f03bd309df40c'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:20.314304 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-a067f641-a8e9-4e8b-abd7-44d7bac74e5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f348121b6054fdc803f03bd309df40c'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:20.377849 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-a067f641-a8e9-4e8b-abd7-44d7bac74e5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f348121b6054fdc803f03bd309df40c'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:20.464602 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 904/1789] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:53:19 2022] DELETE /identity/v3/users/4f348121b6054fdc803f03bd309df40c => generated 0 bytes in 995 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:53:22.078760 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea1651-4818-47c8-9e88-2297d62b05cd admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:22.083860 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-e2ea1651-4818-47c8-9e88-2297d62b05cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:22.236449 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ea1651-4818-47c8-9e88-2297d62b05cd admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:22.466178 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:22.563960 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3298d-8709-4c72-9a66-dc55cd7e9a38 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:22.564705 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3298d-8709-4c72-9a66-dc55cd7e9a38 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:22.565059 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3298d-8709-4c72-9a66-dc55cd7e9a38 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:22.569841 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 905/1790] 10.222.0.69 () {54 vars in 921 bytes} [Thu Sep 8 13:53:22 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:53:22.742252 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c860636-3932-4dd1-8122-e5cca6998ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:22.743502 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c860636-3932-4dd1-8122-e5cca6998ce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:22.744048 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c860636-3932-4dd1-8122-e5cca6998ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:22.744410 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c860636-3932-4dd1-8122-e5cca6998ce0 admin admin] PATH_INFO: `/v3/projects/35089db72b9143d4bccd29b598f8b282` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:22.770876 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c860636-3932-4dd1-8122-e5cca6998ce0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35089db72b9143d4bccd29b598f8b282)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:22.774289 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c860636-3932-4dd1-8122-e5cca6998ce0 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:22.831876 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd8e1b-14f7-4e46-893c-4fcc12acb3d2 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:22.840015 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd8e1b-14f7-4e46-893c-4fcc12acb3d2 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:22.841023 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd8e1b-14f7-4e46-893c-4fcc12acb3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:22.921924 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-bebd8e1b-14f7-4e46-893c-4fcc12acb3d2 None None] MFA Rules not processed for user `c95448c1b8b1466cae37fda5c713d53f`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:22.923990 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-bebd8e1b-14f7-4e46-893c-4fcc12acb3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:22.939066 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:22.992463 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-7c860636-3932-4dd1-8122-e5cca6998ce0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35089db72b9143d4bccd29b598f8b282', 'request_id': 'req-7c860636-3932-4dd1-8122-e5cca6998ce0'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:23.026492 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-7c860636-3932-4dd1-8122-e5cca6998ce0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35089db72b9143d4bccd29b598f8b282', 'request_id': 'req-7c860636-3932-4dd1-8122-e5cca6998ce0'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:23.057173 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-7c860636-3932-4dd1-8122-e5cca6998ce0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35089db72b9143d4bccd29b598f8b282', 'request_id': 'req-7c860636-3932-4dd1-8122-e5cca6998ce0'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:23.102582 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-7c860636-3932-4dd1-8122-e5cca6998ce0 admin admin] The token cache is being invalidate because project 35089db72b9143d4bccd29b598f8b282 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:53:23.106302 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-7c860636-3932-4dd1-8122-e5cca6998ce0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:23.108455 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-7c860636-3932-4dd1-8122-e5cca6998ce0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:23.120411 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 886/1791] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:53:22 2022] DELETE /identity/v3/projects/35089db72b9143d4bccd29b598f8b282 => generated 0 bytes in 1043 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:53:23.131231 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5df8d6-5dc4-4e21-a923-54c77f47bcc2 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:23.132621 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5df8d6-5dc4-4e21-a923-54c77f47bcc2 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:23.135094 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5df8d6-5dc4-4e21-a923-54c77f47bcc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:23.203643 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-fb5df8d6-5dc4-4e21-a923-54c77f47bcc2 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:23.210315 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-fb5df8d6-5dc4-4e21-a923-54c77f47bcc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:23.254805 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 906/1792] 10.222.0.69 () {58 vars in 1018 bytes} [Thu Sep 8 13:53:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 427 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:53:23.479525 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 887/1793] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:53:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:53:23.494446 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3506bdd-0ff4-4569-b076-64d77087bd34 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:23.494973 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3506bdd-0ff4-4569-b076-64d77087bd34 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:23.495821 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3506bdd-0ff4-4569-b076-64d77087bd34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:23.585464 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-f3506bdd-0ff4-4569-b076-64d77087bd34 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:23.592825 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-f3506bdd-0ff4-4569-b076-64d77087bd34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:23.633555 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 907/1794] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:53:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:53:23.636464 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5df8d6-5dc4-4e21-a923-54c77f47bcc2 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:23.677676 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5df8d6-5dc4-4e21-a923-54c77f47bcc2 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:23.704671 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a7961-5b31-45c7-aab9-2af30ab66f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:23.705960 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a7961-5b31-45c7-aab9-2af30ab66f1e admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:23.707135 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a7961-5b31-45c7-aab9-2af30ab66f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:23.707847 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a7961-5b31-45c7-aab9-2af30ab66f1e admin admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:23.710122 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a7961-5b31-45c7-aab9-2af30ab66f1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:53:23.710434 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a7961-5b31-45c7-aab9-2af30ab66f1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:23.713734 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a7961-5b31-45c7-aab9-2af30ab66f1e admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:23.799189 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 888/1795] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 13:53:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:53:23.805959 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3506bdd-0ff4-4569-b076-64d77087bd34 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:23.830065 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3506bdd-0ff4-4569-b076-64d77087bd34 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:23.856947 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c4135-e595-4671-b455-1cf081b3d374 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:23.859773 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c4135-e595-4671-b455-1cf081b3d374 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:23.868958 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c4135-e595-4671-b455-1cf081b3d374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:23.912649 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812cce0-785d-4dc2-83ac-c21df356787d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:23.918805 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812cce0-785d-4dc2-83ac-c21df356787d admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:23.920790 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812cce0-785d-4dc2-83ac-c21df356787d admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:23.924740 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812cce0-785d-4dc2-83ac-c21df356787d admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:23.931544 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3812cce0-785d-4dc2-83ac-c21df356787d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:23.936702 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3812cce0-785d-4dc2-83ac-c21df356787d admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:24.095593 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-f49c4135-e595-4671-b455-1cf081b3d374 None None] MFA Rules not processed for user `d2c7a213a3304503943f053a3238d426`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:24.101466 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-f49c4135-e595-4671-b455-1cf081b3d374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:24.108799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 908/1796] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:53:23 2022] POST /identity/v3/projects => generated 381 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:53:24.110940 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812cce0-785d-4dc2-83ac-c21df356787d admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:24.439836 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:24.692775 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812cce0-785d-4dc2-83ac-c21df356787d admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:24.739164 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1e206-03dd-4260-9602-146f62b2c0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:24.739898 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1e206-03dd-4260-9602-146f62b2c0b1 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:24.740188 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1e206-03dd-4260-9602-146f62b2c0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:24.740488 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1e206-03dd-4260-9602-146f62b2c0b1 admin admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:24.750694 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e1e206-03dd-4260-9602-146f62b2c0b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:24.760432 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e1e206-03dd-4260-9602-146f62b2c0b1 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:24.785980 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 889/1797] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:53:23 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 950 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:53:24.788924 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c4135-e595-4671-b455-1cf081b3d374 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:24.801308 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-f49c4135-e595-4671-b455-1cf081b3d374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:24.915348 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 909/1798] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:53:24 2022] POST /identity/v3/users => generated 291 bytes in 806 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:53:24.926913 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1e206-03dd-4260-9602-146f62b2c0b1 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:24.976019 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1e206-03dd-4260-9602-146f62b2c0b1 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:25.037407 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268abfee-e3a1-48d4-ae83-3ba1c39d8b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:25.037407 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268abfee-e3a1-48d4-ae83-3ba1c39d8b8e admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:25.037407 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268abfee-e3a1-48d4-ae83-3ba1c39d8b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:25.037407 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268abfee-e3a1-48d4-ae83-3ba1c39d8b8e admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:25.038218 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268abfee-e3a1-48d4-ae83-3ba1c39d8b8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:25.038218 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268abfee-e3a1-48d4-ae83-3ba1c39d8b8e admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:25.102257 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 910/1799] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:53:24 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:53:25.146781 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268abfee-e3a1-48d4-ae83-3ba1c39d8b8e admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:25.186873 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268abfee-e3a1-48d4-ae83-3ba1c39d8b8e admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:25.238403 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9feb965-881f-46bc-9cd8-1229b9f8bd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:25.239464 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9feb965-881f-46bc-9cd8-1229b9f8bd49 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:25.239938 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9feb965-881f-46bc-9cd8-1229b9f8bd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:25.240344 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9feb965-881f-46bc-9cd8-1229b9f8bd49 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:25.241277 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9feb965-881f-46bc-9cd8-1229b9f8bd49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:25.243519 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9feb965-881f-46bc-9cd8-1229b9f8bd49 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:25.312340 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 911/1800] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:53:25.328971 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9feb965-881f-46bc-9cd8-1229b9f8bd49 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:25.376469 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c4135-e595-4671-b455-1cf081b3d374 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:25.431411 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9feb965-881f-46bc-9cd8-1229b9f8bd49 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:25.433244 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f285848-0c56-465d-a3b5-e3565f61f3f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:25.434015 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f285848-0c56-465d-a3b5-e3565f61f3f5 service nova] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:25.434436 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f285848-0c56-465d-a3b5-e3565f61f3f5 service nova] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:25.434816 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f285848-0c56-465d-a3b5-e3565f61f3f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:25.455899 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34990bee-c713-43a2-bf34-a232086a4791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:25.456689 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34990bee-c713-43a2-bf34-a232086a4791 admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:25.456971 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34990bee-c713-43a2-bf34-a232086a4791 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:25.457504 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34990bee-c713-43a2-bf34-a232086a4791 admin admin] PATH_INFO: `/v3/projects/70dc7d00ae1148afbf552271731d3cb4/users/3ed23246573640c98e0d0268809ded4a/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:25.496217 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f285848-0c56-465d-a3b5-e3565f61f3f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:25.507506 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f285848-0c56-465d-a3b5-e3565f61f3f5 service nova] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:25.547338 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34990bee-c713-43a2-bf34-a232086a4791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70dc7d00ae1148afbf552271731d3cb4, user_id=3ed23246573640c98e0d0268809ded4a, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:25.555281 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34990bee-c713-43a2-bf34-a232086a4791 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:25.595313 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 912/1801] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:53:25 2022] PUT /identity/v3/projects/70dc7d00ae1148afbf552271731d3cb4/users/3ed23246573640c98e0d0268809ded4a/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:53:25.618640 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5ef1b-b1c1-4c2b-89e0-022e1c7b3c8d None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:25.619467 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5ef1b-b1c1-4c2b-89e0-022e1c7b3c8d None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:25.620112 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5ef1b-b1c1-4c2b-89e0-022e1c7b3c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:25.620587 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 890/1802] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:53:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 834 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:53:25.793150 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-32c5ef1b-b1c1-4c2b-89e0-022e1c7b3c8d None None] MFA Rules not processed for user `3ed23246573640c98e0d0268809ded4a`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:25.795342 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-32c5ef1b-b1c1-4c2b-89e0-022e1c7b3c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:25.848948 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:26.137247 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 913/1803] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:53:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 520 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:53:26.140776 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f285848-0c56-465d-a3b5-e3565f61f3f5 service nova] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:26.211543 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f285848-0c56-465d-a3b5-e3565f61f3f5 service nova] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:26.550628 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf47e0-e842-4760-bb47-5e164c59fc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:26.552736 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf47e0-e842-4760-bb47-5e164c59fc0a admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:26.555926 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf47e0-e842-4760-bb47-5e164c59fc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:26.557221 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf47e0-e842-4760-bb47-5e164c59fc0a admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:26.561295 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf47e0-e842-4760-bb47-5e164c59fc0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:26.574544 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf47e0-e842-4760-bb47-5e164c59fc0a admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:26.687853 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 891/1804] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:53:26 2022] POST /identity/v3/projects => generated 381 bytes in 548 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:53:26.694819 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5ef1b-b1c1-4c2b-89e0-022e1c7b3c8d None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:26.733162 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5ef1b-b1c1-4c2b-89e0-022e1c7b3c8d None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:26.996633 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83991475-13dc-41ce-a75c-2d1864e1678d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:26.997773 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83991475-13dc-41ce-a75c-2d1864e1678d admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:26.998237 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83991475-13dc-41ce-a75c-2d1864e1678d admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:26.998725 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83991475-13dc-41ce-a75c-2d1864e1678d admin admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:26.999933 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83991475-13dc-41ce-a75c-2d1864e1678d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:27.010211 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83991475-13dc-41ce-a75c-2d1864e1678d admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:27.094251 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6592bb2-8dc6-422c-8002-c7d5b3ac5397 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:27.095059 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6592bb2-8dc6-422c-8002-c7d5b3ac5397 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:27.096268 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 914/1805] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:53:26 2022] POST /identity/v3/users => generated 297 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:53:27.097828 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6592bb2-8dc6-422c-8002-c7d5b3ac5397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:27.098524 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83991475-13dc-41ce-a75c-2d1864e1678d admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:27.143139 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83991475-13dc-41ce-a75c-2d1864e1678d admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:27.177156 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281170e8-ed1f-4fd4-bbc8-31254900b096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:27.179016 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281170e8-ed1f-4fd4-bbc8-31254900b096 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:27.179521 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281170e8-ed1f-4fd4-bbc8-31254900b096 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:27.180014 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281170e8-ed1f-4fd4-bbc8-31254900b096 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:27.181310 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281170e8-ed1f-4fd4-bbc8-31254900b096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:27.189976 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281170e8-ed1f-4fd4-bbc8-31254900b096 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:27.236377 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 915/1806] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:53:27.248264 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281170e8-ed1f-4fd4-bbc8-31254900b096 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:27.258024 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-281170e8-ed1f-4fd4-bbc8-31254900b096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:27.276414 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-a6592bb2-8dc6-422c-8002-c7d5b3ac5397 None None] MFA Rules not processed for user `75cd9652625a4935a9af31bd4549ccf1`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:27.289485 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-a6592bb2-8dc6-422c-8002-c7d5b3ac5397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:27.335152 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281170e8-ed1f-4fd4-bbc8-31254900b096 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:27.371937 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079496af-c8b0-4548-8b66-b5241874a489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:27.373303 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079496af-c8b0-4548-8b66-b5241874a489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:27.374118 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079496af-c8b0-4548-8b66-b5241874a489 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:27.375356 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079496af-c8b0-4548-8b66-b5241874a489 admin admin] PATH_INFO: `/v3/projects/f83812ac80134e8bb5b4574e7487f693` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:27.379052 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079496af-c8b0-4548-8b66-b5241874a489 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f83812ac80134e8bb5b4574e7487f693)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:27.388294 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079496af-c8b0-4548-8b66-b5241874a489 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:27.620203 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:27.664948 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-079496af-c8b0-4548-8b66-b5241874a489 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f83812ac80134e8bb5b4574e7487f693', 'request_id': 'req-079496af-c8b0-4548-8b66-b5241874a489'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:27.697637 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-079496af-c8b0-4548-8b66-b5241874a489 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f83812ac80134e8bb5b4574e7487f693', 'request_id': 'req-079496af-c8b0-4548-8b66-b5241874a489'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:27.763477 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-079496af-c8b0-4548-8b66-b5241874a489 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f83812ac80134e8bb5b4574e7487f693', 'request_id': 'req-079496af-c8b0-4548-8b66-b5241874a489'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:27.832732 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-079496af-c8b0-4548-8b66-b5241874a489 admin admin] The token cache is being invalidate because project f83812ac80134e8bb5b4574e7487f693 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:53:27.833262 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-079496af-c8b0-4548-8b66-b5241874a489 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:27.834636 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-079496af-c8b0-4548-8b66-b5241874a489 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:27.835586 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 892/1807] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:53:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 742 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:53:27.837174 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6592bb2-8dc6-422c-8002-c7d5b3ac5397 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:27.837885 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 916/1808] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:53:27 2022] DELETE /identity/v3/projects/f83812ac80134e8bb5b4574e7487f693 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:53:27.847931 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f0e8c-df9e-4af3-a5e6-c9b202b88ab8 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:27.848987 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f0e8c-df9e-4af3-a5e6-c9b202b88ab8 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:27.849739 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f0e8c-df9e-4af3-a5e6-c9b202b88ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:27.919117 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6592bb2-8dc6-422c-8002-c7d5b3ac5397 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:27.932928 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-522f0e8c-df9e-4af3-a5e6-c9b202b88ab8 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:27.950267 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-522f0e8c-df9e-4af3-a5e6-c9b202b88ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:27.985096 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:28.234779 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 917/1809] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:53:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:53:28.258881 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b15e5b-91bb-4773-a345-9500fe40d1f7 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:28.259616 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b15e5b-91bb-4773-a345-9500fe40d1f7 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:28.260635 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b15e5b-91bb-4773-a345-9500fe40d1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:28.428022 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-01b15e5b-91bb-4773-a345-9500fe40d1f7 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:28.430112 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-01b15e5b-91bb-4773-a345-9500fe40d1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:28.431633 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e43292-61d8-4cfb-b1d7-f059d9cd7cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:28.442265 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e43292-61d8-4cfb-b1d7-f059d9cd7cc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:28.443127 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e43292-61d8-4cfb-b1d7-f059d9cd7cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:28.444360 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e43292-61d8-4cfb-b1d7-f059d9cd7cc2 admin admin] PATH_INFO: `/v3/projects/c09fe62ade8e40988a77f2549b439f1d/users/98b9ca471c6741eeacf83225c7f2df9e/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:28.495620 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 918/1810] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:53:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:53:28.499523 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be334787-3fe8-4149-84a1-003a5a6843c9 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:28.499918 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be334787-3fe8-4149-84a1-003a5a6843c9 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:28.500255 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be334787-3fe8-4149-84a1-003a5a6843c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:28.578658 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e43292-61d8-4cfb-b1d7-f059d9cd7cc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c09fe62ade8e40988a77f2549b439f1d, user_id=98b9ca471c6741eeacf83225c7f2df9e, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:28.596509 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e43292-61d8-4cfb-b1d7-f059d9cd7cc2 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:28.605794 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-be334787-3fe8-4149-84a1-003a5a6843c9 None None] MFA Rules not processed for user `c38575a2f7bc408f8b5eb58ad513c078`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:28.616322 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-be334787-3fe8-4149-84a1-003a5a6843c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:28.678726 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 893/1811] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:53:27 2022] PUT /identity/v3/projects/c09fe62ade8e40988a77f2549b439f1d/users/98b9ca471c6741eeacf83225c7f2df9e/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 843 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:53:28.695811 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e43292-61d8-4cfb-b1d7-f059d9cd7cc2 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:28.997344 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 919/1812] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:53:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 493 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:53:28.997344 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be334787-3fe8-4149-84a1-003a5a6843c9 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:28.997344 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-be334787-3fe8-4149-84a1-003a5a6843c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:29.045089 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be334787-3fe8-4149-84a1-003a5a6843c9 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:29.089062 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e43292-61d8-4cfb-b1d7-f059d9cd7cc2 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:29.098116 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd5ef9-bd6b-4452-a106-a6c50a49f998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:29.099390 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd5ef9-bd6b-4452-a106-a6c50a49f998 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:29.099894 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd5ef9-bd6b-4452-a106-a6c50a49f998 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:29.100593 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd5ef9-bd6b-4452-a106-a6c50a49f998 admin admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:29.101738 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd5ef9-bd6b-4452-a106-a6c50a49f998 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:53:29.102504 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd5ef9-bd6b-4452-a106-a6c50a49f998 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:29.105987 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd5ef9-bd6b-4452-a106-a6c50a49f998 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:29.157451 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 894/1813] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 13:53:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 478 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:53:29.161076 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd5ef9-bd6b-4452-a106-a6c50a49f998 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:29.197695 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd5ef9-bd6b-4452-a106-a6c50a49f998 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:29.208172 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d753fe-1141-4352-98e1-15a9efd2e66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:29.212226 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d753fe-1141-4352-98e1-15a9efd2e66f admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:29.214147 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d753fe-1141-4352-98e1-15a9efd2e66f admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:29.214806 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d753fe-1141-4352-98e1-15a9efd2e66f admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:29.216525 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d753fe-1141-4352-98e1-15a9efd2e66f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:29.229178 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d753fe-1141-4352-98e1-15a9efd2e66f admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:29.372855 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb5a99-15c6-4efc-9b6f-380ddb3ca839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:29.376937 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb5a99-15c6-4efc-9b6f-380ddb3ca839 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:29.377218 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb5a99-15c6-4efc-9b6f-380ddb3ca839 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:29.379993 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb5a99-15c6-4efc-9b6f-380ddb3ca839 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:29.383889 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb5a99-15c6-4efc-9b6f-380ddb3ca839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:29.397489 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb5a99-15c6-4efc-9b6f-380ddb3ca839 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:29.402811 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 895/1814] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:53:29 2022] POST /identity/v3/projects => generated 379 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:53:29.406013 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d753fe-1141-4352-98e1-15a9efd2e66f admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:29.438546 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 920/1815] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:53:28 2022] GET /identity/v3/roles => generated 1420 bytes in 447 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:53:29.446394 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb5a99-15c6-4efc-9b6f-380ddb3ca839 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:29.486180 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb5a99-15c6-4efc-9b6f-380ddb3ca839 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:29.552510 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:29.621684 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:29.635317 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d753fe-1141-4352-98e1-15a9efd2e66f admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:29.657988 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac121be-8a6d-4183-bcb1-98c2477e068f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:29.659080 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac121be-8a6d-4183-bcb1-98c2477e068f admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:29.660700 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac121be-8a6d-4183-bcb1-98c2477e068f admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:29.661335 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac121be-8a6d-4183-bcb1-98c2477e068f admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:29.664145 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac121be-8a6d-4183-bcb1-98c2477e068f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:29.670656 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c894d48-ff13-4bd4-b195-7c2a52d7f30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:29.671977 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c894d48-ff13-4bd4-b195-7c2a52d7f30b admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:29.672578 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c894d48-ff13-4bd4-b195-7c2a52d7f30b admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:29.674052 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c894d48-ff13-4bd4-b195-7c2a52d7f30b admin admin] PATH_INFO: `/v3/projects/c09fe62ade8e40988a77f2549b439f1d/users/98b9ca471c6741eeacf83225c7f2df9e/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:29.675297 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac121be-8a6d-4183-bcb1-98c2477e068f admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:29.680052 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c894d48-ff13-4bd4-b195-7c2a52d7f30b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c09fe62ade8e40988a77f2549b439f1d, user_id=98b9ca471c6741eeacf83225c7f2df9e, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:29.687363 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c894d48-ff13-4bd4-b195-7c2a52d7f30b admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:29.715252 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 921/1816] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:53:29 2022] PUT /identity/v3/projects/c09fe62ade8e40988a77f2549b439f1d/users/98b9ca471c6741eeacf83225c7f2df9e/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:53:29.717726 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140c12f-7e1f-449b-ab85-1426e97fe099 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:29.718389 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140c12f-7e1f-449b-ab85-1426e97fe099 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:29.719251 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140c12f-7e1f-449b-ab85-1426e97fe099 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:29.722654 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 922/1817] 10.222.0.69 () {54 vars in 921 bytes} [Thu Sep 8 13:53:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:53:29.738704 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d7abe-7e91-4c6f-9636-6c97eb5eb1a7 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:29.741619 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d7abe-7e91-4c6f-9636-6c97eb5eb1a7 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:29.743488 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d7abe-7e91-4c6f-9636-6c97eb5eb1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:29.767901 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 896/1818] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:53:29 2022] POST /identity/v3/users => generated 290 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:53:29.775411 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac121be-8a6d-4183-bcb1-98c2477e068f admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:29.818520 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac121be-8a6d-4183-bcb1-98c2477e068f admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:29.887115 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-e25d7abe-7e91-4c6f-9636-6c97eb5eb1a7 None None] MFA Rules not processed for user `98b9ca471c6741eeacf83225c7f2df9e`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:29.889416 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-e25d7abe-7e91-4c6f-9636-6c97eb5eb1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:30.201850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64044ba-b226-46d9-8532-d01b30b3aacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:30.206189 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64044ba-b226-46d9-8532-d01b30b3aacc admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:30.208278 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64044ba-b226-46d9-8532-d01b30b3aacc admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:30.224312 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 923/1819] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:53:29 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 489 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:53:30.227040 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a419dd4-a167-4dab-a380-cb18bd637148 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:30.227797 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a419dd4-a167-4dab-a380-cb18bd637148 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:30.229109 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a419dd4-a167-4dab-a380-cb18bd637148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:30.241790 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64044ba-b226-46d9-8532-d01b30b3aacc admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:30.252814 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64044ba-b226-46d9-8532-d01b30b3aacc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:30.263518 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64044ba-b226-46d9-8532-d01b30b3aacc admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:30.283328 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-7a419dd4-a167-4dab-a380-cb18bd637148 None None] MFA Rules not processed for user `c95448c1b8b1466cae37fda5c713d53f`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:30.287565 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-7a419dd4-a167-4dab-a380-cb18bd637148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:30.309565 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 897/1820] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 535 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 13:53:30.311586 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64044ba-b226-46d9-8532-d01b30b3aacc admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:30.315097 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-e64044ba-b226-46d9-8532-d01b30b3aacc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:30.469883 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64044ba-b226-46d9-8532-d01b30b3aacc admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:30.482987 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c258369-c600-4c3c-b232-d6d45c41b572 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:30.485897 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c258369-c600-4c3c-b232-d6d45c41b572 service cinder] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:30.486689 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c258369-c600-4c3c-b232-d6d45c41b572 service cinder] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:30.487954 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c258369-c600-4c3c-b232-d6d45c41b572 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:30.514352 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c258369-c600-4c3c-b232-d6d45c41b572 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:30.518231 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c258369-c600-4c3c-b232-d6d45c41b572 service cinder] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:30.520891 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 924/1821] 10.222.0.69 () {58 vars in 1018 bytes} [Thu Sep 8 13:53:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:53:30.522463 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a419dd4-a167-4dab-a380-cb18bd637148 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:30.548264 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 898/1822] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:53:30 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:53:30.550552 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a419dd4-a167-4dab-a380-cb18bd637148 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:30.556234 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a633d7c-e626-46b6-a38d-9ebd2602993f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:30.557205 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a633d7c-e626-46b6-a38d-9ebd2602993f admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:30.557689 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a633d7c-e626-46b6-a38d-9ebd2602993f admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:30.558155 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a633d7c-e626-46b6-a38d-9ebd2602993f admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:30.559189 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a633d7c-e626-46b6-a38d-9ebd2602993f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:30.561298 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a633d7c-e626-46b6-a38d-9ebd2602993f admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:30.577155 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 925/1823] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:53:30.584343 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c258369-c600-4c3c-b232-d6d45c41b572 service cinder] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:30.608031 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c258369-c600-4c3c-b232-d6d45c41b572 service cinder] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:30.633000 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00382dc-c2e0-4369-9a3d-433ff8fc4402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:30.635111 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00382dc-c2e0-4369-9a3d-433ff8fc4402 admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:30.638766 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00382dc-c2e0-4369-9a3d-433ff8fc4402 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:30.639401 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00382dc-c2e0-4369-9a3d-433ff8fc4402 admin admin] PATH_INFO: `/v3/projects/0044fcd4c1574c89887619385bb551d5/users/c3dd72cabb484f95b76c7aa5860de3d3/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:30.729828 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00382dc-c2e0-4369-9a3d-433ff8fc4402 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0044fcd4c1574c89887619385bb551d5, user_id=c3dd72cabb484f95b76c7aa5860de3d3, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:30.734871 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00382dc-c2e0-4369-9a3d-433ff8fc4402 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:30.784545 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 899/1824] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:53:30 2022] PUT /identity/v3/projects/0044fcd4c1574c89887619385bb551d5/users/c3dd72cabb484f95b76c7aa5860de3d3/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:53:30.790243 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e6179-b230-44b6-80bc-683ee6723a14 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:30.791838 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e6179-b230-44b6-80bc-683ee6723a14 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:30.792457 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e6179-b230-44b6-80bc-683ee6723a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:30.880383 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-4e2e6179-b230-44b6-80bc-683ee6723a14 None None] MFA Rules not processed for user `c3dd72cabb484f95b76c7aa5860de3d3`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:30.888010 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-4e2e6179-b230-44b6-80bc-683ee6723a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:30.986950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:31.114405 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 926/1825] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:53:30 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:53:31.243452 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00382dc-c2e0-4369-9a3d-433ff8fc4402 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:31.259648 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-c00382dc-c2e0-4369-9a3d-433ff8fc4402 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:31.463616 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:31.491069 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00382dc-c2e0-4369-9a3d-433ff8fc4402 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:31.498076 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0dbe85-598d-4d9e-a1d8-0b6a56ca4789 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:31.499707 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dbe85-598d-4d9e-a1d8-0b6a56ca4789 service cinder] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:31.500435 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dbe85-598d-4d9e-a1d8-0b6a56ca4789 service cinder] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:31.501071 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dbe85-598d-4d9e-a1d8-0b6a56ca4789 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:31.529058 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0dbe85-598d-4d9e-a1d8-0b6a56ca4789 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:31.533400 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0dbe85-598d-4d9e-a1d8-0b6a56ca4789 service cinder] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:31.571401 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 900/1826] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:53:31 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:53:31.609234 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e6179-b230-44b6-80bc-683ee6723a14 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:31.785690 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c2cdd-4771-4dd2-a05c-a961579d5a60 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:31.786915 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c2cdd-4771-4dd2-a05c-a961579d5a60 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:31.787415 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c2cdd-4771-4dd2-a05c-a961579d5a60 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:31.789234 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 901/1827] 10.222.0.69 () {54 vars in 921 bytes} [Thu Sep 8 13:53:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:53:31.790289 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c2cdd-4771-4dd2-a05c-a961579d5a60 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:31.820299 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e6179-b230-44b6-80bc-683ee6723a14 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:31.830661 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a249f4-7a0d-4420-b505-ab44269b721e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:31.832157 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a249f4-7a0d-4420-b505-ab44269b721e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:31.832885 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a249f4-7a0d-4420-b505-ab44269b721e admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:31.833504 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a249f4-7a0d-4420-b505-ab44269b721e admin admin] PATH_INFO: `/v3/users/c3dd72cabb484f95b76c7aa5860de3d3` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:31.836556 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a249f4-7a0d-4420-b505-ab44269b721e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3dd72cabb484f95b76c7aa5860de3d3)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:31.842709 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a249f4-7a0d-4420-b505-ab44269b721e admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:31.977507 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c2cdd-4771-4dd2-a05c-a961579d5a60 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:31.985396 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-35a249f4-7a0d-4420-b505-ab44269b721e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3dd72cabb484f95b76c7aa5860de3d3'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:31.986590 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-35a249f4-7a0d-4420-b505-ab44269b721e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3dd72cabb484f95b76c7aa5860de3d3'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:31.987534 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-35a249f4-7a0d-4420-b505-ab44269b721e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3dd72cabb484f95b76c7aa5860de3d3'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:31.987897 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dfc77c-ff7d-4639-8343-10d6cdd33701 tempest-VolumeQuotaClassesTest-1247827352 tempest-VolumeQuotaClassesTest-1247827352-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b9ca471c6741eeacf83225c7f2df9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c09fe62ade8e40988a77f2549b439f1d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:31.989174 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfc77c-ff7d-4639-8343-10d6cdd33701 tempest-VolumeQuotaClassesTest-1247827352 tempest-VolumeQuotaClassesTest-1247827352-project-admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:31.989868 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfc77c-ff7d-4639-8343-10d6cdd33701 tempest-VolumeQuotaClassesTest-1247827352 tempest-VolumeQuotaClassesTest-1247827352-project-admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:31.990497 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfc77c-ff7d-4639-8343-10d6cdd33701 tempest-VolumeQuotaClassesTest-1247827352 tempest-VolumeQuotaClassesTest-1247827352-project-admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:31.992240 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dfc77c-ff7d-4639-8343-10d6cdd33701 tempest-VolumeQuotaClassesTest-1247827352 tempest-VolumeQuotaClassesTest-1247827352-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:53:31.992876 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dfc77c-ff7d-4639-8343-10d6cdd33701 tempest-VolumeQuotaClassesTest-1247827352 tempest-VolumeQuotaClassesTest-1247827352-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:31.996212 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dfc77c-ff7d-4639-8343-10d6cdd33701 tempest-VolumeQuotaClassesTest-1247827352 tempest-VolumeQuotaClassesTest-1247827352-project-admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:32.008339 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-35a249f4-7a0d-4420-b505-ab44269b721e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3dd72cabb484f95b76c7aa5860de3d3'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:32.045863 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-35a249f4-7a0d-4420-b505-ab44269b721e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3dd72cabb484f95b76c7aa5860de3d3'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:32.046201 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 902/1828] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 13:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:53:32.048778 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba78e7-aa1e-4655-82a1-1dde8f5b9789 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:32.049416 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba78e7-aa1e-4655-82a1-1dde8f5b9789 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:32.050300 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba78e7-aa1e-4655-82a1-1dde8f5b9789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:32.102178 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-83ba78e7-aa1e-4655-82a1-1dde8f5b9789 None None] MFA Rules not processed for user `733797f12a1741e1a55332991e867aab`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:32.104820 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-83ba78e7-aa1e-4655-82a1-1dde8f5b9789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:32.117990 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 927/1829] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:53:31 2022] DELETE /identity/v3/users/c3dd72cabb484f95b76c7aa5860de3d3 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:53:32.131230 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a249f4-7a0d-4420-b505-ab44269b721e admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:32.136140 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-35a249f4-7a0d-4420-b505-ab44269b721e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:32.432384 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:32.458447 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 903/1830] 10.222.0.69 () {58 vars in 1018 bytes} [Thu Sep 8 13:53:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:53:32.460720 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c566a4-202e-44b0-8fe3-26fa3cb7bd17 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:32.461212 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c566a4-202e-44b0-8fe3-26fa3cb7bd17 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:32.461726 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c566a4-202e-44b0-8fe3-26fa3cb7bd17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:32.502362 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a249f4-7a0d-4420-b505-ab44269b721e admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:32.530328 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db483229-fe22-44c3-8bfd-d7e8a46f8735 tempest-VolumeQuotaClassesTest-1247827352 tempest-VolumeQuotaClassesTest-1247827352-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b9ca471c6741eeacf83225c7f2df9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c09fe62ade8e40988a77f2549b439f1d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:32.531456 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db483229-fe22-44c3-8bfd-d7e8a46f8735 tempest-VolumeQuotaClassesTest-1247827352 tempest-VolumeQuotaClassesTest-1247827352-project-admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:32.531867 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db483229-fe22-44c3-8bfd-d7e8a46f8735 tempest-VolumeQuotaClassesTest-1247827352 tempest-VolumeQuotaClassesTest-1247827352-project-admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:32.532360 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db483229-fe22-44c3-8bfd-d7e8a46f8735 tempest-VolumeQuotaClassesTest-1247827352 tempest-VolumeQuotaClassesTest-1247827352-project-admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:32.533589 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db483229-fe22-44c3-8bfd-d7e8a46f8735 tempest-VolumeQuotaClassesTest-1247827352 tempest-VolumeQuotaClassesTest-1247827352-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:32.556345 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db483229-fe22-44c3-8bfd-d7e8a46f8735 tempest-VolumeQuotaClassesTest-1247827352 tempest-VolumeQuotaClassesTest-1247827352-project-admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:32.562842 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-12c566a4-202e-44b0-8fe3-26fa3cb7bd17 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:32.564972 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-12c566a4-202e-44b0-8fe3-26fa3cb7bd17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:32.663400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 928/1831] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:53:32 2022] POST /identity/v3/projects => generated 355 bytes in 539 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:53:32.665426 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db483229-fe22-44c3-8bfd-d7e8a46f8735 tempest-VolumeQuotaClassesTest-1247827352 tempest-VolumeQuotaClassesTest-1247827352-project-admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:32.799404 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 904/1832] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:53:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:53:32.802751 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c566a4-202e-44b0-8fe3-26fa3cb7bd17 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:32.805511 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-12c566a4-202e-44b0-8fe3-26fa3cb7bd17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:32.827872 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db483229-fe22-44c3-8bfd-d7e8a46f8735 tempest-VolumeQuotaClassesTest-1247827352 tempest-VolumeQuotaClassesTest-1247827352-project-admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:32.854846 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff5a40-989e-4070-b4ad-9fd8fc880b45 tempest-VolumeQuotaClassesTest-1247827352 tempest-VolumeQuotaClassesTest-1247827352-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b9ca471c6741eeacf83225c7f2df9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c09fe62ade8e40988a77f2549b439f1d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:32.855698 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff5a40-989e-4070-b4ad-9fd8fc880b45 tempest-VolumeQuotaClassesTest-1247827352 tempest-VolumeQuotaClassesTest-1247827352-project-admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:32.856205 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff5a40-989e-4070-b4ad-9fd8fc880b45 tempest-VolumeQuotaClassesTest-1247827352 tempest-VolumeQuotaClassesTest-1247827352-project-admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:32.856947 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff5a40-989e-4070-b4ad-9fd8fc880b45 tempest-VolumeQuotaClassesTest-1247827352 tempest-VolumeQuotaClassesTest-1247827352-project-admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:32.858242 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff5a40-989e-4070-b4ad-9fd8fc880b45 tempest-VolumeQuotaClassesTest-1247827352 tempest-VolumeQuotaClassesTest-1247827352-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:53:32.858786 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff5a40-989e-4070-b4ad-9fd8fc880b45 tempest-VolumeQuotaClassesTest-1247827352 tempest-VolumeQuotaClassesTest-1247827352-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:32.862858 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff5a40-989e-4070-b4ad-9fd8fc880b45 tempest-VolumeQuotaClassesTest-1247827352 tempest-VolumeQuotaClassesTest-1247827352-project-admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:32.868041 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:32.901764 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 929/1833] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 13:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:53:32.905358 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0285d4-a60f-4725-bfce-bd536f6397ce None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:32.905894 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0285d4-a60f-4725-bfce-bd536f6397ce None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:32.913305 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0285d4-a60f-4725-bfce-bd536f6397ce None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:32.916217 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 930/1834] 10.222.0.69 () {54 vars in 961 bytes} [Thu Sep 8 13:53:32 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:53:32.927024 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b005ef71-41e3-4743-b5a2-7c8f5c6b974d None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:32.927531 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b005ef71-41e3-4743-b5a2-7c8f5c6b974d None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:32.928982 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b005ef71-41e3-4743-b5a2-7c8f5c6b974d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:32.999694 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-b005ef71-41e3-4743-b5a2-7c8f5c6b974d None None] MFA Rules not processed for user `733797f12a1741e1a55332991e867aab`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:33.001942 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-b005ef71-41e3-4743-b5a2-7c8f5c6b974d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:33.202766 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c566a4-202e-44b0-8fe3-26fa3cb7bd17 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:33.327409 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 931/1835] 10.222.0.69 () {58 vars in 1058 bytes} [Thu Sep 8 13:53:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:53:33.330633 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b005ef71-41e3-4743-b5a2-7c8f5c6b974d None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:33.389854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b005ef71-41e3-4743-b5a2-7c8f5c6b974d None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:33.406386 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f23287-e0d5-470f-b3e7-71b1340a8001 tempest-VolumeQuotaClassesTest-1247827352 tempest-VolumeQuotaClassesTest-1247827352-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98b9ca471c6741eeacf83225c7f2df9e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c09fe62ade8e40988a77f2549b439f1d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:33.411988 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f23287-e0d5-470f-b3e7-71b1340a8001 tempest-VolumeQuotaClassesTest-1247827352 tempest-VolumeQuotaClassesTest-1247827352-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:33.413808 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f23287-e0d5-470f-b3e7-71b1340a8001 tempest-VolumeQuotaClassesTest-1247827352 tempest-VolumeQuotaClassesTest-1247827352-project-admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:33.415917 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f23287-e0d5-470f-b3e7-71b1340a8001 tempest-VolumeQuotaClassesTest-1247827352 tempest-VolumeQuotaClassesTest-1247827352-project-admin] PATH_INFO: `/v3/projects/f2f9b33350b149f6bebb30f831bbcaca` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:33.423838 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f23287-e0d5-470f-b3e7-71b1340a8001 tempest-VolumeQuotaClassesTest-1247827352 tempest-VolumeQuotaClassesTest-1247827352-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f2f9b33350b149f6bebb30f831bbcaca)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:33.438992 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f23287-e0d5-470f-b3e7-71b1340a8001 tempest-VolumeQuotaClassesTest-1247827352 tempest-VolumeQuotaClassesTest-1247827352-project-admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:33.529310 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd3c28-fadb-4f19-a8b8-41f7c8536021 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:33.531145 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd3c28-fadb-4f19-a8b8-41f7c8536021 service nova] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:33.531953 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd3c28-fadb-4f19-a8b8-41f7c8536021 service nova] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:33.533300 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd3c28-fadb-4f19-a8b8-41f7c8536021 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:33.545334 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-54cd3c28-fadb-4f19-a8b8-41f7c8536021 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:33.616920 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cd3c28-fadb-4f19-a8b8-41f7c8536021 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:33.621820 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cd3c28-fadb-4f19-a8b8-41f7c8536021 service nova] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:33.653609 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 905/1836] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:53:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 854 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:53:33.658072 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-56f23287-e0d5-470f-b3e7-71b1340a8001 tempest-VolumeQuotaClassesTest-1247827352 tempest-VolumeQuotaClassesTest-1247827352-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2f9b33350b149f6bebb30f831bbcaca', 'request_id': 'req-56f23287-e0d5-470f-b3e7-71b1340a8001'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:33.660384 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd3c28-fadb-4f19-a8b8-41f7c8536021 service nova] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:33.663866 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-54cd3c28-fadb-4f19-a8b8-41f7c8536021 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:33.674529 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-56f23287-e0d5-470f-b3e7-71b1340a8001 tempest-VolumeQuotaClassesTest-1247827352 tempest-VolumeQuotaClassesTest-1247827352-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2f9b33350b149f6bebb30f831bbcaca', 'request_id': 'req-56f23287-e0d5-470f-b3e7-71b1340a8001'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:33.689467 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-56f23287-e0d5-470f-b3e7-71b1340a8001 tempest-VolumeQuotaClassesTest-1247827352 tempest-VolumeQuotaClassesTest-1247827352-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2f9b33350b149f6bebb30f831bbcaca', 'request_id': 'req-56f23287-e0d5-470f-b3e7-71b1340a8001'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:33.695390 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:33.731925 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-56f23287-e0d5-470f-b3e7-71b1340a8001 tempest-VolumeQuotaClassesTest-1247827352 tempest-VolumeQuotaClassesTest-1247827352-project-admin] The token cache is being invalidate because project f2f9b33350b149f6bebb30f831bbcaca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:53:33.731925 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-56f23287-e0d5-470f-b3e7-71b1340a8001 tempest-VolumeQuotaClassesTest-1247827352 tempest-VolumeQuotaClassesTest-1247827352-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:33.739533 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-56f23287-e0d5-470f-b3e7-71b1340a8001 tempest-VolumeQuotaClassesTest-1247827352 tempest-VolumeQuotaClassesTest-1247827352-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:33.743257 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 932/1837] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:53:33 2022] DELETE /identity/v3/projects/f2f9b33350b149f6bebb30f831bbcaca => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:53:33.748564 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f23287-e0d5-470f-b3e7-71b1340a8001 tempest-VolumeQuotaClassesTest-1247827352 tempest-VolumeQuotaClassesTest-1247827352-project-admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:33.752835 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-56f23287-e0d5-470f-b3e7-71b1340a8001 tempest-VolumeQuotaClassesTest-1247827352 tempest-VolumeQuotaClassesTest-1247827352-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:33.884558 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd3c28-fadb-4f19-a8b8-41f7c8536021 service nova] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:34.062903 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f23287-e0d5-470f-b3e7-71b1340a8001 tempest-VolumeQuotaClassesTest-1247827352 tempest-VolumeQuotaClassesTest-1247827352-project-admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:34.084291 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e0810-8120-4ecd-8093-93c32188a584 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733797f12a1741e1a55332991e867aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:34.086414 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e0810-8120-4ecd-8093-93c32188a584 service placement] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:34.089074 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e0810-8120-4ecd-8093-93c32188a584 service placement] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:34.089639 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e0810-8120-4ecd-8093-93c32188a584 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:34.097655 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-028e0810-8120-4ecd-8093-93c32188a584 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:34.119719 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be5f0d0-e9a6-4102-80d5-8358aa52f785 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:34.120726 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5f0d0-e9a6-4102-80d5-8358aa52f785 service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:34.121166 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5f0d0-e9a6-4102-80d5-8358aa52f785 service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:34.121650 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5f0d0-e9a6-4102-80d5-8358aa52f785 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:34.134261 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-9be5f0d0-e9a6-4102-80d5-8358aa52f785 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:34.145961 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e0810-8120-4ecd-8093-93c32188a584 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:34.155844 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e0810-8120-4ecd-8093-93c32188a584 service placement] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:34.160463 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:34.202664 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 933/1838] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:53:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:53:34.293243 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e0810-8120-4ecd-8093-93c32188a584 service placement] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:34.297430 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-028e0810-8120-4ecd-8093-93c32188a584 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:34.339645 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be5f0d0-e9a6-4102-80d5-8358aa52f785 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:34.345578 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be5f0d0-e9a6-4102-80d5-8358aa52f785 service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:34.369693 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e0810-8120-4ecd-8093-93c32188a584 service placement] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:34.389420 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48d4e6-c015-47cd-bc81-8bed6355ac0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:34.390482 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48d4e6-c015-47cd-bc81-8bed6355ac0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:34.390951 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48d4e6-c015-47cd-bc81-8bed6355ac0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:34.391411 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48d4e6-c015-47cd-bc81-8bed6355ac0d admin admin] PATH_INFO: `/v3/users/75833fc0653b47109404543767abd3f2` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:34.394526 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 906/1839] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:53:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 740 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:53:34.406881 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af48d4e6-c015-47cd-bc81-8bed6355ac0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=75833fc0653b47109404543767abd3f2)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:34.416438 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af48d4e6-c015-47cd-bc81-8bed6355ac0d admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:34.562630 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be5f0d0-e9a6-4102-80d5-8358aa52f785 service neutron] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:34.567262 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-9be5f0d0-e9a6-4102-80d5-8358aa52f785 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:34.632734 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be5f0d0-e9a6-4102-80d5-8358aa52f785 service neutron] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:34.655049 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad21356-4355-442b-86b4-e0f397ab0c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:34.657834 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad21356-4355-442b-86b4-e0f397ab0c9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:34.661652 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad21356-4355-442b-86b4-e0f397ab0c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:34.662238 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad21356-4355-442b-86b4-e0f397ab0c9d admin admin] PATH_INFO: `/v3/users/3ed23246573640c98e0d0268809ded4a` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:34.670305 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad21356-4355-442b-86b4-e0f397ab0c9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ed23246573640c98e0d0268809ded4a)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:34.678482 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad21356-4355-442b-86b4-e0f397ab0c9d admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:34.709334 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-af48d4e6-c015-47cd-bc81-8bed6355ac0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75833fc0653b47109404543767abd3f2'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:34.710742 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-af48d4e6-c015-47cd-bc81-8bed6355ac0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75833fc0653b47109404543767abd3f2'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:34.711830 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-af48d4e6-c015-47cd-bc81-8bed6355ac0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75833fc0653b47109404543767abd3f2'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:34.735344 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-af48d4e6-c015-47cd-bc81-8bed6355ac0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75833fc0653b47109404543767abd3f2'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:34.793304 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-af48d4e6-c015-47cd-bc81-8bed6355ac0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75833fc0653b47109404543767abd3f2'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:34.867048 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 934/1840] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:53:34 2022] DELETE /identity/v3/users/75833fc0653b47109404543767abd3f2 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:53:34.886957 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-8ad21356-4355-442b-86b4-e0f397ab0c9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ed23246573640c98e0d0268809ded4a'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:34.888316 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-8ad21356-4355-442b-86b4-e0f397ab0c9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ed23246573640c98e0d0268809ded4a'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:34.925412 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-8ad21356-4355-442b-86b4-e0f397ab0c9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ed23246573640c98e0d0268809ded4a'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:34.986060 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-8ad21356-4355-442b-86b4-e0f397ab0c9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ed23246573640c98e0d0268809ded4a'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:34.990758 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-8ad21356-4355-442b-86b4-e0f397ab0c9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ed23246573640c98e0d0268809ded4a'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:35.109266 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 907/1841] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:53:34 2022] DELETE /identity/v3/users/3ed23246573640c98e0d0268809ded4a => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:53:35.119461 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9d728-e952-4f12-b7be-6f26ee22db53 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:35.120418 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9d728-e952-4f12-b7be-6f26ee22db53 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:35.121667 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9d728-e952-4f12-b7be-6f26ee22db53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:35.311341 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-a6f9d728-e952-4f12-b7be-6f26ee22db53 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:35.326653 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-a6f9d728-e952-4f12-b7be-6f26ee22db53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:35.704271 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:35.778502 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 935/1842] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:53:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 661 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:53:35.947316 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad21356-4355-442b-86b4-e0f397ab0c9d admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:35.949669 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-8ad21356-4355-442b-86b4-e0f397ab0c9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:36.248882 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad21356-4355-442b-86b4-e0f397ab0c9d admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:36.258700 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3cdb48-999c-4668-ab83-e7036a8503f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:36.260017 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3cdb48-999c-4668-ab83-e7036a8503f5 service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:36.260993 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3cdb48-999c-4668-ab83-e7036a8503f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:36.261990 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3cdb48-999c-4668-ab83-e7036a8503f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:36.291868 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3cdb48-999c-4668-ab83-e7036a8503f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:36.299160 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3cdb48-999c-4668-ab83-e7036a8503f5 service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:36.324395 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 908/1843] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:53:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:53:36.627422 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f9d728-e952-4f12-b7be-6f26ee22db53 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:36.630825 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-a6f9d728-e952-4f12-b7be-6f26ee22db53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:36.662061 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f9d728-e952-4f12-b7be-6f26ee22db53 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:36.681753 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9c6b1-047a-4562-8c17-2e0a020c0064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:36.683074 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9c6b1-047a-4562-8c17-2e0a020c0064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:36.683957 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9c6b1-047a-4562-8c17-2e0a020c0064 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:36.684641 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9c6b1-047a-4562-8c17-2e0a020c0064 admin admin] PATH_INFO: `/v3/projects/a1225cea60e9463c85c6c89ca1eeeb0e` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:36.690898 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c9c6b1-047a-4562-8c17-2e0a020c0064 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1225cea60e9463c85c6c89ca1eeeb0e)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:36.716410 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c9c6b1-047a-4562-8c17-2e0a020c0064 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:36.855565 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3cdb48-999c-4668-ab83-e7036a8503f5 service neutron] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:36.857782 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-aa3cdb48-999c-4668-ab83-e7036a8503f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:36.887924 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3cdb48-999c-4668-ab83-e7036a8503f5 service neutron] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:36.995369 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:37.034664 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-a6c9c6b1-047a-4562-8c17-2e0a020c0064 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1225cea60e9463c85c6c89ca1eeeb0e', 'request_id': 'req-a6c9c6b1-047a-4562-8c17-2e0a020c0064'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:37.079224 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-a6c9c6b1-047a-4562-8c17-2e0a020c0064 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1225cea60e9463c85c6c89ca1eeeb0e', 'request_id': 'req-a6c9c6b1-047a-4562-8c17-2e0a020c0064'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:37.130355 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-a6c9c6b1-047a-4562-8c17-2e0a020c0064 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1225cea60e9463c85c6c89ca1eeeb0e', 'request_id': 'req-a6c9c6b1-047a-4562-8c17-2e0a020c0064'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:37.194243 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3af96-1802-4bca-a274-fce68c9a373d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:37.195822 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3af96-1802-4bca-a274-fce68c9a373d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:37.196416 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3af96-1802-4bca-a274-fce68c9a373d admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:37.196932 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3af96-1802-4bca-a274-fce68c9a373d admin admin] PATH_INFO: `/v3/projects/0044fcd4c1574c89887619385bb551d5` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:37.202171 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c3af96-1802-4bca-a274-fce68c9a373d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0044fcd4c1574c89887619385bb551d5)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:37.205867 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c3af96-1802-4bca-a274-fce68c9a373d admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:37.211963 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-a6c9c6b1-047a-4562-8c17-2e0a020c0064 admin admin] The token cache is being invalidate because project a1225cea60e9463c85c6c89ca1eeeb0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:53:37.213765 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-a6c9c6b1-047a-4562-8c17-2e0a020c0064 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:37.215823 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-a6c9c6b1-047a-4562-8c17-2e0a020c0064 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:37.232765 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 936/1844] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:53:36 2022] DELETE /identity/v3/projects/a1225cea60e9463c85c6c89ca1eeeb0e => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:53:37.236480 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9c6b1-047a-4562-8c17-2e0a020c0064 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:37.250785 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-a6c9c6b1-047a-4562-8c17-2e0a020c0064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:37.296449 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9c6b1-047a-4562-8c17-2e0a020c0064 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:37.306922 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9d97f-0ef2-474e-89d1-f8bb6883bde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:37.308253 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9d97f-0ef2-474e-89d1-f8bb6883bde5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:37.309746 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9d97f-0ef2-474e-89d1-f8bb6883bde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:37.310492 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9d97f-0ef2-474e-89d1-f8bb6883bde5 admin admin] PATH_INFO: `/v3/users/d2c7a213a3304503943f053a3238d426` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:37.313272 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d9d97f-0ef2-474e-89d1-f8bb6883bde5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2c7a213a3304503943f053a3238d426)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:37.334945 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d9d97f-0ef2-474e-89d1-f8bb6883bde5 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:37.432938 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-97c3af96-1802-4bca-a274-fce68c9a373d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0044fcd4c1574c89887619385bb551d5', 'request_id': 'req-97c3af96-1802-4bca-a274-fce68c9a373d'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:37.459978 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-97c3af96-1802-4bca-a274-fce68c9a373d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0044fcd4c1574c89887619385bb551d5', 'request_id': 'req-97c3af96-1802-4bca-a274-fce68c9a373d'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:37.482087 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-97c3af96-1802-4bca-a274-fce68c9a373d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0044fcd4c1574c89887619385bb551d5', 'request_id': 'req-97c3af96-1802-4bca-a274-fce68c9a373d'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:37.538505 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-97c3af96-1802-4bca-a274-fce68c9a373d admin admin] The token cache is being invalidate because project 0044fcd4c1574c89887619385bb551d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:53:37.538838 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-97c3af96-1802-4bca-a274-fce68c9a373d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:37.540574 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-f9d9d97f-0ef2-474e-89d1-f8bb6883bde5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2c7a213a3304503943f053a3238d426'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:37.544993 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-f9d9d97f-0ef2-474e-89d1-f8bb6883bde5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2c7a213a3304503943f053a3238d426'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:37.545555 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-f9d9d97f-0ef2-474e-89d1-f8bb6883bde5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2c7a213a3304503943f053a3238d426'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:37.546252 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-97c3af96-1802-4bca-a274-fce68c9a373d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:37.556562 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 909/1845] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:53:36 2022] DELETE /identity/v3/projects/0044fcd4c1574c89887619385bb551d5 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:53:37.569407 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423f628-46de-446b-8be4-6e73301a4c4c None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:37.570937 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423f628-46de-446b-8be4-6e73301a4c4c None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:37.571135 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423f628-46de-446b-8be4-6e73301a4c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:37.584845 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-f9d9d97f-0ef2-474e-89d1-f8bb6883bde5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2c7a213a3304503943f053a3238d426'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:37.624536 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-f9d9d97f-0ef2-474e-89d1-f8bb6883bde5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2c7a213a3304503943f053a3238d426'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:37.642380 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-a423f628-46de-446b-8be4-6e73301a4c4c None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:37.644001 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-a423f628-46de-446b-8be4-6e73301a4c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:37.661456 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 937/1846] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:53:37 2022] DELETE /identity/v3/users/d2c7a213a3304503943f053a3238d426 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:53:37.817850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 910/1847] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:53:37.836965 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424422b2-c8de-430f-91cf-900d4cd67690 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:37.836965 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424422b2-c8de-430f-91cf-900d4cd67690 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:37.837302 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424422b2-c8de-430f-91cf-900d4cd67690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:37.891313 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-424422b2-c8de-430f-91cf-900d4cd67690 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:37.896328 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-424422b2-c8de-430f-91cf-900d4cd67690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:38.060373 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:38.127288 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 938/1848] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:53:38.134648 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423f628-46de-446b-8be4-6e73301a4c4c None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:38.169471 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423f628-46de-446b-8be4-6e73301a4c4c None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:38.183050 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a78067-f774-48de-b88c-643182132128 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:38.184613 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a78067-f774-48de-b88c-643182132128 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:38.185311 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a78067-f774-48de-b88c-643182132128 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:38.189268 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 939/1849] 10.222.0.69 () {54 vars in 921 bytes} [Thu Sep 8 13:53:38 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 13:53:38.190284 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16654cf2-3bc2-415a-b5c8-6c558e12f42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:38.192174 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16654cf2-3bc2-415a-b5c8-6c558e12f42c admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:38.193230 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16654cf2-3bc2-415a-b5c8-6c558e12f42c admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:38.193945 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16654cf2-3bc2-415a-b5c8-6c558e12f42c admin admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:38.209681 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16654cf2-3bc2-415a-b5c8-6c558e12f42c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:53:38.211474 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16654cf2-3bc2-415a-b5c8-6c558e12f42c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:38.218108 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16654cf2-3bc2-415a-b5c8-6c558e12f42c admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:38.219343 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d0b35-f8c7-4af6-8925-d40e554a2af5 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:38.219914 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d0b35-f8c7-4af6-8925-d40e554a2af5 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:38.220635 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d0b35-f8c7-4af6-8925-d40e554a2af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:38.308532 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-813d0b35-f8c7-4af6-8925-d40e554a2af5 None None] MFA Rules not processed for user `c95448c1b8b1466cae37fda5c713d53f`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:38.314493 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 911/1850] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 13:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:53:38.315774 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-813d0b35-f8c7-4af6-8925-d40e554a2af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:38.322953 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16654cf2-3bc2-415a-b5c8-6c558e12f42c admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:38.372387 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16654cf2-3bc2-415a-b5c8-6c558e12f42c admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:38.383217 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95760458-f5f0-4b61-bd89-9011fb402131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:38.385283 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95760458-f5f0-4b61-bd89-9011fb402131 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:38.386001 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95760458-f5f0-4b61-bd89-9011fb402131 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:38.386559 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95760458-f5f0-4b61-bd89-9011fb402131 admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:38.387943 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95760458-f5f0-4b61-bd89-9011fb402131 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:38.404916 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95760458-f5f0-4b61-bd89-9011fb402131 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:38.501190 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 912/1851] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:53:38 2022] POST /identity/v3/projects => generated 367 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:53:38.507381 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95760458-f5f0-4b61-bd89-9011fb402131 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:38.567274 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:38.604606 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 940/1852] 10.222.0.69 () {58 vars in 1018 bytes} [Thu Sep 8 13:53:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:53:38.644185 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d0b35-f8c7-4af6-8925-d40e554a2af5 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:38.646192 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-813d0b35-f8c7-4af6-8925-d40e554a2af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:38.684035 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d0b35-f8c7-4af6-8925-d40e554a2af5 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:38.696438 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95760458-f5f0-4b61-bd89-9011fb402131 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:38.716217 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1f075-53be-4dca-998c-16586f80824f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:38.717123 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1f075-53be-4dca-998c-16586f80824f admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:38.717474 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1f075-53be-4dca-998c-16586f80824f admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:38.717801 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b1f075-53be-4dca-998c-16586f80824f admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:38.718779 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301b794-574a-486a-b02c-00525c604317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:38.719333 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b1f075-53be-4dca-998c-16586f80824f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:38.722117 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b1f075-53be-4dca-998c-16586f80824f admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:38.724853 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301b794-574a-486a-b02c-00525c604317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:38.727324 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301b794-574a-486a-b02c-00525c604317 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:38.728454 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301b794-574a-486a-b02c-00525c604317 admin admin] PATH_INFO: `/v3/projects/92e60ea013bd4e4e9e3dd4dd84ce0187` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:38.738758 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d301b794-574a-486a-b02c-00525c604317 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92e60ea013bd4e4e9e3dd4dd84ce0187)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:38.758894 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d301b794-574a-486a-b02c-00525c604317 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:38.780282 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 913/1853] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:53:38 2022] POST /identity/v3/users => generated 284 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:53:38.783606 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1f075-53be-4dca-998c-16586f80824f admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:38.789847 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-30b1f075-53be-4dca-998c-16586f80824f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:38.812179 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b1f075-53be-4dca-998c-16586f80824f admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:38.820018 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496f3b6-27d2-4532-9f51-5094fedd787b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:38.821100 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496f3b6-27d2-4532-9f51-5094fedd787b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:38.821545 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496f3b6-27d2-4532-9f51-5094fedd787b admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:38.821930 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496f3b6-27d2-4532-9f51-5094fedd787b admin admin] PATH_INFO: `/v3/projects/70dc7d00ae1148afbf552271731d3cb4` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:38.823657 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8496f3b6-27d2-4532-9f51-5094fedd787b admin admin] RBAC: Authorizing `identity:delete_project(project_id=70dc7d00ae1148afbf552271731d3cb4)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:38.826469 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8496f3b6-27d2-4532-9f51-5094fedd787b admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:38.940713 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-8496f3b6-27d2-4532-9f51-5094fedd787b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70dc7d00ae1148afbf552271731d3cb4', 'request_id': 'req-8496f3b6-27d2-4532-9f51-5094fedd787b'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:38.947575 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-d301b794-574a-486a-b02c-00525c604317 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92e60ea013bd4e4e9e3dd4dd84ce0187', 'request_id': 'req-d301b794-574a-486a-b02c-00525c604317'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:38.955588 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-8496f3b6-27d2-4532-9f51-5094fedd787b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70dc7d00ae1148afbf552271731d3cb4', 'request_id': 'req-8496f3b6-27d2-4532-9f51-5094fedd787b'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:38.965783 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-d301b794-574a-486a-b02c-00525c604317 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92e60ea013bd4e4e9e3dd4dd84ce0187', 'request_id': 'req-d301b794-574a-486a-b02c-00525c604317'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:38.972744 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-8496f3b6-27d2-4532-9f51-5094fedd787b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70dc7d00ae1148afbf552271731d3cb4', 'request_id': 'req-8496f3b6-27d2-4532-9f51-5094fedd787b'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:38.974231 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-d301b794-574a-486a-b02c-00525c604317 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92e60ea013bd4e4e9e3dd4dd84ce0187', 'request_id': 'req-d301b794-574a-486a-b02c-00525c604317'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:38.997301 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-8496f3b6-27d2-4532-9f51-5094fedd787b admin admin] The token cache is being invalidate because project 70dc7d00ae1148afbf552271731d3cb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:53:38.997735 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-8496f3b6-27d2-4532-9f51-5094fedd787b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:38.998968 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-8496f3b6-27d2-4532-9f51-5094fedd787b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:39.004319 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 914/1854] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:53:38 2022] DELETE /identity/v3/projects/70dc7d00ae1148afbf552271731d3cb4 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:53:39.006279 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496f3b6-27d2-4532-9f51-5094fedd787b admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:39.009068 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-8496f3b6-27d2-4532-9f51-5094fedd787b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:39.010666 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-d301b794-574a-486a-b02c-00525c604317 admin admin] The token cache is being invalidate because project 92e60ea013bd4e4e9e3dd4dd84ce0187 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:53:39.013917 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-d301b794-574a-486a-b02c-00525c604317 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:39.018939 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-d301b794-574a-486a-b02c-00525c604317 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:39.026533 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 941/1855] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:53:38 2022] DELETE /identity/v3/projects/92e60ea013bd4e4e9e3dd4dd84ce0187 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:53:39.026533 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301b794-574a-486a-b02c-00525c604317 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:39.039533 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-d301b794-574a-486a-b02c-00525c604317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:39.128686 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496f3b6-27d2-4532-9f51-5094fedd787b admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:39.185790 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:39.274692 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36aaed-d2ba-4669-bb33-14482345f590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:39.275675 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36aaed-d2ba-4669-bb33-14482345f590 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:39.276599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36aaed-d2ba-4669-bb33-14482345f590 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:39.276999 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36aaed-d2ba-4669-bb33-14482345f590 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:39.280153 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b36aaed-d2ba-4669-bb33-14482345f590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:39.283178 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b36aaed-d2ba-4669-bb33-14482345f590 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:39.313416 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 915/1856] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:53:39.316490 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36aaed-d2ba-4669-bb33-14482345f590 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:39.321695 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-5b36aaed-d2ba-4669-bb33-14482345f590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:39.347889 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:39.355671 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36aaed-d2ba-4669-bb33-14482345f590 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:39.369207 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301b794-574a-486a-b02c-00525c604317 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:39.380909 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30032160-2f09-4360-b45c-c461632a4efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:39.386061 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30032160-2f09-4360-b45c-c461632a4efa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:39.386542 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30032160-2f09-4360-b45c-c461632a4efa admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:39.394054 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30032160-2f09-4360-b45c-c461632a4efa admin admin] PATH_INFO: `/v3/users/98b9ca471c6741eeacf83225c7f2df9e` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:39.406419 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30032160-2f09-4360-b45c-c461632a4efa admin admin] RBAC: Authorizing `identity:delete_user(user_id=98b9ca471c6741eeacf83225c7f2df9e)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:39.411761 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b372d697-11fd-4fe1-8a0e-385bb184f199 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:39.412029 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30032160-2f09-4360-b45c-c461632a4efa admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:39.426683 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372d697-11fd-4fe1-8a0e-385bb184f199 service nova] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:39.427105 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372d697-11fd-4fe1-8a0e-385bb184f199 service nova] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:39.427279 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372d697-11fd-4fe1-8a0e-385bb184f199 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:39.438688 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-b372d697-11fd-4fe1-8a0e-385bb184f199 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:39.486878 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b372d697-11fd-4fe1-8a0e-385bb184f199 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:39.490235 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b372d697-11fd-4fe1-8a0e-385bb184f199 service nova] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:39.533230 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 942/1857] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:53:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:53:39.533230 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d573c3-7bdb-4918-aefb-758d007fad92 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:39.533823 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d573c3-7bdb-4918-aefb-758d007fad92 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:39.536471 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d573c3-7bdb-4918-aefb-758d007fad92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:39.570963 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-30032160-2f09-4360-b45c-c461632a4efa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98b9ca471c6741eeacf83225c7f2df9e'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:39.572496 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-30032160-2f09-4360-b45c-c461632a4efa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98b9ca471c6741eeacf83225c7f2df9e'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:39.591918 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-06d573c3-7bdb-4918-aefb-758d007fad92 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:39.593987 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-06d573c3-7bdb-4918-aefb-758d007fad92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:39.626320 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 943/1858] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:53:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:53:39.626320 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d573c3-7bdb-4918-aefb-758d007fad92 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:39.626467 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-30032160-2f09-4360-b45c-c461632a4efa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98b9ca471c6741eeacf83225c7f2df9e'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:39.628804 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-06d573c3-7bdb-4918-aefb-758d007fad92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:39.667909 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-30032160-2f09-4360-b45c-c461632a4efa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98b9ca471c6741eeacf83225c7f2df9e'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:39.670990 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-30032160-2f09-4360-b45c-c461632a4efa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98b9ca471c6741eeacf83225c7f2df9e'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:39.676859 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d573c3-7bdb-4918-aefb-758d007fad92 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:39.697913 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212d0df-be8e-48fb-a507-a25a21ed091c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:39.699096 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212d0df-be8e-48fb-a507-a25a21ed091c admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:39.699700 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212d0df-be8e-48fb-a507-a25a21ed091c admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:39.700599 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212d0df-be8e-48fb-a507-a25a21ed091c admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:39.701873 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2212d0df-be8e-48fb-a507-a25a21ed091c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:39.707175 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2212d0df-be8e-48fb-a507-a25a21ed091c admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:39.733304 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 916/1859] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:53:39 2022] DELETE /identity/v3/users/98b9ca471c6741eeacf83225c7f2df9e => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:53:39.733304 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6219f-0f59-46a4-a802-c52d53d3468c None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:39.733304 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6219f-0f59-46a4-a802-c52d53d3468c None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:39.733304 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6219f-0f59-46a4-a802-c52d53d3468c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:39.743587 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 944/1860] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:53:39.743587 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212d0df-be8e-48fb-a507-a25a21ed091c admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:39.747693 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-2212d0df-be8e-48fb-a507-a25a21ed091c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:39.788929 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212d0df-be8e-48fb-a507-a25a21ed091c admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:39.790902 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-6ee6219f-0f59-46a4-a802-c52d53d3468c None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:39.797087 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-6ee6219f-0f59-46a4-a802-c52d53d3468c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:40.074880 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb07f9-ab28-47ad-b802-6ddcb2dfad0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:40.076688 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb07f9-ab28-47ad-b802-6ddcb2dfad0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:40.077719 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb07f9-ab28-47ad-b802-6ddcb2dfad0b admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:40.078447 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb07f9-ab28-47ad-b802-6ddcb2dfad0b admin admin] PATH_INFO: `/v3/users/1f8a7e2d3f384f7a96f9a01c4e711ec3` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:40.083495 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb07f9-ab28-47ad-b802-6ddcb2dfad0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f8a7e2d3f384f7a96f9a01c4e711ec3)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:40.087695 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb07f9-ab28-47ad-b802-6ddcb2dfad0b admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:40.125862 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 917/1861] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:53:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:53:40.134152 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6219f-0f59-46a4-a802-c52d53d3468c None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:40.157864 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6219f-0f59-46a4-a802-c52d53d3468c None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:40.189303 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a6f55-7ab1-47d4-b977-bfe0c5a6a7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:40.191603 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a6f55-7ab1-47d4-b977-bfe0c5a6a7f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:40.192267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a6f55-7ab1-47d4-b977-bfe0c5a6a7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:40.193011 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a6f55-7ab1-47d4-b977-bfe0c5a6a7f0 admin admin] PATH_INFO: `/v3/projects/17ed7d5e06614f6c8a7a35dd498f282b/users/edeb5d6700094c70a69c79c9d442b10c/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:40.271106 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a6f55-7ab1-47d4-b977-bfe0c5a6a7f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17ed7d5e06614f6c8a7a35dd498f282b, user_id=edeb5d6700094c70a69c79c9d442b10c, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:40.278386 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a6f55-7ab1-47d4-b977-bfe0c5a6a7f0 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:40.309921 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-c2bb07f9-ab28-47ad-b802-6ddcb2dfad0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f8a7e2d3f384f7a96f9a01c4e711ec3'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:40.310437 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-c2bb07f9-ab28-47ad-b802-6ddcb2dfad0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f8a7e2d3f384f7a96f9a01c4e711ec3'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:40.311682 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-c2bb07f9-ab28-47ad-b802-6ddcb2dfad0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f8a7e2d3f384f7a96f9a01c4e711ec3'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:40.320118 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 918/1862] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:53:40 2022] PUT /identity/v3/projects/17ed7d5e06614f6c8a7a35dd498f282b/users/edeb5d6700094c70a69c79c9d442b10c/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:53:40.323243 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a6f55-7ab1-47d4-b977-bfe0c5a6a7f0 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:40.328481 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-c2bb07f9-ab28-47ad-b802-6ddcb2dfad0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f8a7e2d3f384f7a96f9a01c4e711ec3'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:40.332406 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-964a6f55-7ab1-47d4-b977-bfe0c5a6a7f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:40.369180 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-c2bb07f9-ab28-47ad-b802-6ddcb2dfad0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f8a7e2d3f384f7a96f9a01c4e711ec3'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:40.406446 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:40.411448 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 945/1863] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:53:39 2022] DELETE /identity/v3/users/1f8a7e2d3f384f7a96f9a01c4e711ec3 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:53:40.413489 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e79d32-8e8f-48c3-9861-db367db2c7d1 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:40.413727 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e79d32-8e8f-48c3-9861-db367db2c7d1 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:40.414039 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e79d32-8e8f-48c3-9861-db367db2c7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:40.463330 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-99e79d32-8e8f-48c3-9861-db367db2c7d1 None None] MFA Rules not processed for user `edeb5d6700094c70a69c79c9d442b10c`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:40.465272 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-99e79d32-8e8f-48c3-9861-db367db2c7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:40.560268 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a6f55-7ab1-47d4-b977-bfe0c5a6a7f0 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:40.572133 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:40.646532 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 946/1864] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:53:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:53:40.648052 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b53aac-3afb-49dd-bc73-6dca3838ffec None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:40.648461 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b53aac-3afb-49dd-bc73-6dca3838ffec None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:40.648608 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b53aac-3afb-49dd-bc73-6dca3838ffec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:40.703390 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-a2b53aac-3afb-49dd-bc73-6dca3838ffec None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:40.709304 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-a2b53aac-3afb-49dd-bc73-6dca3838ffec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:40.759028 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed6146e-a4c2-4592-8a21-bbbc7fc702cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:40.760906 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6146e-a4c2-4592-8a21-bbbc7fc702cd admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:40.761548 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6146e-a4c2-4592-8a21-bbbc7fc702cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:40.762103 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed6146e-a4c2-4592-8a21-bbbc7fc702cd admin admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:40.763183 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed6146e-a4c2-4592-8a21-bbbc7fc702cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:53:40.763944 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed6146e-a4c2-4592-8a21-bbbc7fc702cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:40.768145 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed6146e-a4c2-4592-8a21-bbbc7fc702cd admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:40.789577 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 919/1865] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 13:53:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 469 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:53:40.791806 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed6146e-a4c2-4592-8a21-bbbc7fc702cd admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:40.794497 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-1ed6146e-a4c2-4592-8a21-bbbc7fc702cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:40.921764 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 947/1866] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:53:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:53:40.928909 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b53aac-3afb-49dd-bc73-6dca3838ffec None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:40.949119 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b53aac-3afb-49dd-bc73-6dca3838ffec None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:40.957835 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50974b8-1bae-4785-b308-fa334dd09039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:40.958914 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50974b8-1bae-4785-b308-fa334dd09039 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:40.959401 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50974b8-1bae-4785-b308-fa334dd09039 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:40.961122 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50974b8-1bae-4785-b308-fa334dd09039 admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:40.961400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50974b8-1bae-4785-b308-fa334dd09039 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:40.965456 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50974b8-1bae-4785-b308-fa334dd09039 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:40.986906 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed6146e-a4c2-4592-8a21-bbbc7fc702cd admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:40.992246 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e03ff7-6afd-4727-8fc1-f09782fd3876 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6677b4518c094636bc8ed7b588103390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:40.992936 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e03ff7-6afd-4727-8fc1-f09782fd3876 service glance] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:40.993288 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e03ff7-6afd-4727-8fc1-f09782fd3876 service glance] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:40.993659 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e03ff7-6afd-4727-8fc1-f09782fd3876 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:41.015966 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e03ff7-6afd-4727-8fc1-f09782fd3876 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:41.018141 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e03ff7-6afd-4727-8fc1-f09782fd3876 service glance] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:41.031802 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 948/1867] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:53:40 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:53:41.033247 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50974b8-1bae-4785-b308-fa334dd09039 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:41.036228 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-e50974b8-1bae-4785-b308-fa334dd09039 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:41.041473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 920/1868] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:53:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:53:41.043806 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e03ff7-6afd-4727-8fc1-f09782fd3876 service glance] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:41.086859 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e03ff7-6afd-4727-8fc1-f09782fd3876 service glance] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:41.187201 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50974b8-1bae-4785-b308-fa334dd09039 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:41.192864 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640bccdd-d198-4554-bdea-88e4356a6709 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:41.193809 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640bccdd-d198-4554-bdea-88e4356a6709 service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:41.194249 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640bccdd-d198-4554-bdea-88e4356a6709 service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:41.194628 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640bccdd-d198-4554-bdea-88e4356a6709 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:41.197539 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:41.283455 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406d35d-c79a-4d97-9843-736f6f8e8994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:41.285243 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406d35d-c79a-4d97-9843-736f6f8e8994 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:41.286060 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406d35d-c79a-4d97-9843-736f6f8e8994 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:41.286573 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406d35d-c79a-4d97-9843-736f6f8e8994 admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:41.287879 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7406d35d-c79a-4d97-9843-736f6f8e8994 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:41.296556 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7406d35d-c79a-4d97-9843-736f6f8e8994 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:41.371109 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640bccdd-d198-4554-bdea-88e4356a6709 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:41.375754 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640bccdd-d198-4554-bdea-88e4356a6709 service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:41.382099 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 921/1869] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:53:41 2022] POST /identity/v3/users => generated 287 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:53:41.384417 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406d35d-c79a-4d97-9843-736f6f8e8994 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:41.419878 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 949/1870] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:53:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:53:41.420149 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406d35d-c79a-4d97-9843-736f6f8e8994 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:41.446017 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b83566-506c-40d6-9d80-d29dcc0d650e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:41.447070 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b83566-506c-40d6-9d80-d29dcc0d650e admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:41.447652 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b83566-506c-40d6-9d80-d29dcc0d650e admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:41.448152 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b83566-506c-40d6-9d80-d29dcc0d650e admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:41.459972 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b83566-506c-40d6-9d80-d29dcc0d650e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:41.464357 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b83566-506c-40d6-9d80-d29dcc0d650e admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:41.510317 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 922/1871] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:53:41 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:53:41.512042 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640bccdd-d198-4554-bdea-88e4356a6709 service neutron] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:41.534920 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640bccdd-d198-4554-bdea-88e4356a6709 service neutron] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:41.542626 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996fe7df-52e6-49f6-ab01-4d3dc9dd9fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:41.543648 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996fe7df-52e6-49f6-ab01-4d3dc9dd9fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:41.543872 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996fe7df-52e6-49f6-ab01-4d3dc9dd9fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:41.544540 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996fe7df-52e6-49f6-ab01-4d3dc9dd9fd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:41.545340 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996fe7df-52e6-49f6-ab01-4d3dc9dd9fd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:41.549305 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996fe7df-52e6-49f6-ab01-4d3dc9dd9fd6 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:41.554909 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:41.577456 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b83566-506c-40d6-9d80-d29dcc0d650e admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:41.586994 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 950/1872] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:53:41 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 13:53:41.612809 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b83566-506c-40d6-9d80-d29dcc0d650e admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:41.631528 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df8591-468e-422b-97eb-269c61940029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:41.635125 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df8591-468e-422b-97eb-269c61940029 admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:41.635652 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df8591-468e-422b-97eb-269c61940029 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:41.636202 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df8591-468e-422b-97eb-269c61940029 admin admin] PATH_INFO: `/v3/projects/ca6aa1918c6944b3b389f4c251f29ab5/users/86a08a4fb9b442a0b0a48d0d2db7e5fe/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:41.718603 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df8591-468e-422b-97eb-269c61940029 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca6aa1918c6944b3b389f4c251f29ab5, user_id=86a08a4fb9b442a0b0a48d0d2db7e5fe, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:41.725441 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df8591-468e-422b-97eb-269c61940029 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:41.802221 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 923/1873] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:53:41 2022] PUT /identity/v3/projects/ca6aa1918c6944b3b389f4c251f29ab5/users/86a08a4fb9b442a0b0a48d0d2db7e5fe/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:53:41.808454 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40eeb27-15e3-40cb-84f3-940f20e8c751 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:41.808454 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40eeb27-15e3-40cb-84f3-940f20e8c751 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:41.808454 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40eeb27-15e3-40cb-84f3-940f20e8c751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:41.853744 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-a40eeb27-15e3-40cb-84f3-940f20e8c751 None None] MFA Rules not processed for user `86a08a4fb9b442a0b0a48d0d2db7e5fe`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:41.855070 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-a40eeb27-15e3-40cb-84f3-940f20e8c751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:42.085025 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 951/1874] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:53:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:53:42.090518 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df8591-468e-422b-97eb-269c61940029 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:42.398898 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df8591-468e-422b-97eb-269c61940029 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:42.415931 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85ee56-d428-466f-9b0e-f2d2c30667c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:42.418438 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85ee56-d428-466f-9b0e-f2d2c30667c0 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:42.419377 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85ee56-d428-466f-9b0e-f2d2c30667c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:42.420047 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85ee56-d428-466f-9b0e-f2d2c30667c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:42.425426 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85ee56-d428-466f-9b0e-f2d2c30667c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:42.429254 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85ee56-d428-466f-9b0e-f2d2c30667c0 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:42.493900 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 924/1875] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:53:42 2022] POST /identity/v3/projects => generated 371 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:53:42.505399 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40eeb27-15e3-40cb-84f3-940f20e8c751 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:42.531843 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40eeb27-15e3-40cb-84f3-940f20e8c751 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:42.698300 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe6b04-858c-45f5-b3f8-d078ca9e29ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:42.702334 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe6b04-858c-45f5-b3f8-d078ca9e29ef admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:42.703649 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe6b04-858c-45f5-b3f8-d078ca9e29ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:42.704922 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe6b04-858c-45f5-b3f8-d078ca9e29ef admin admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:42.708361 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fe6b04-858c-45f5-b3f8-d078ca9e29ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:42.715876 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fe6b04-858c-45f5-b3f8-d078ca9e29ef admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:42.794440 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 952/1876] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:53:42 2022] POST /identity/v3/users => generated 292 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:53:42.799292 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85ee56-d428-466f-9b0e-f2d2c30667c0 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:42.825228 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85ee56-d428-466f-9b0e-f2d2c30667c0 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:42.835270 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6e7fd-2223-4313-8294-23dbaafdf097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:42.836270 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6e7fd-2223-4313-8294-23dbaafdf097 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:42.836843 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6e7fd-2223-4313-8294-23dbaafdf097 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:42.837666 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6e7fd-2223-4313-8294-23dbaafdf097 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:42.839964 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6e7fd-2223-4313-8294-23dbaafdf097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:42.844646 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6e7fd-2223-4313-8294-23dbaafdf097 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:42.876131 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 925/1877] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:53:42.878980 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe6b04-858c-45f5-b3f8-d078ca9e29ef admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:42.942763 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe6b04-858c-45f5-b3f8-d078ca9e29ef admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:42.967584 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce82ac8-c133-4f25-9c0b-39055cfd75b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:42.969256 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce82ac8-c133-4f25-9c0b-39055cfd75b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:42.969986 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce82ac8-c133-4f25-9c0b-39055cfd75b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:42.971229 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce82ac8-c133-4f25-9c0b-39055cfd75b6 admin admin] PATH_INFO: `/v3/projects/710a6e313487430389c9ab09f99af584/users/f2a2c5592032495db95fb8b6eed375f2/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:43.051533 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce82ac8-c133-4f25-9c0b-39055cfd75b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=710a6e313487430389c9ab09f99af584, user_id=f2a2c5592032495db95fb8b6eed375f2, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:43.063376 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce82ac8-c133-4f25-9c0b-39055cfd75b6 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:43.115473 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 953/1878] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:53:42 2022] PUT /identity/v3/projects/710a6e313487430389c9ab09f99af584/users/f2a2c5592032495db95fb8b6eed375f2/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:53:43.121489 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6e7fd-2223-4313-8294-23dbaafdf097 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:43.162153 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6e7fd-2223-4313-8294-23dbaafdf097 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:43.379012 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21efa7a0-d830-41b7-9005-69521569242d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:43.380181 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efa7a0-d830-41b7-9005-69521569242d admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:43.381586 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efa7a0-d830-41b7-9005-69521569242d admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:43.382325 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efa7a0-d830-41b7-9005-69521569242d admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:43.383940 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21efa7a0-d830-41b7-9005-69521569242d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:43.389833 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21efa7a0-d830-41b7-9005-69521569242d admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:43.427188 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 926/1879] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:53:43.435321 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce82ac8-c133-4f25-9c0b-39055cfd75b6 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:43.476161 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce82ac8-c133-4f25-9c0b-39055cfd75b6 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:43.506225 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee4222-4dee-4da0-a2fb-0e68960b4de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:43.508425 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee4222-4dee-4da0-a2fb-0e68960b4de8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:43.509420 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee4222-4dee-4da0-a2fb-0e68960b4de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:43.510030 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee4222-4dee-4da0-a2fb-0e68960b4de8 admin admin] PATH_INFO: `/v3/projects/710a6e313487430389c9ab09f99af584/users/f2a2c5592032495db95fb8b6eed375f2/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:43.520878 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee4222-4dee-4da0-a2fb-0e68960b4de8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=710a6e313487430389c9ab09f99af584, user_id=f2a2c5592032495db95fb8b6eed375f2, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:43.523839 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee4222-4dee-4da0-a2fb-0e68960b4de8 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:43.564769 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 954/1880] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:53:43 2022] PUT /identity/v3/projects/710a6e313487430389c9ab09f99af584/users/f2a2c5592032495db95fb8b6eed375f2/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:53:43.589044 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650670a-c0b1-47ae-8a15-34bfa7012063 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:43.589614 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650670a-c0b1-47ae-8a15-34bfa7012063 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:43.590155 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650670a-c0b1-47ae-8a15-34bfa7012063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:43.634301 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:43.648960 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-3650670a-c0b1-47ae-8a15-34bfa7012063 None None] MFA Rules not processed for user `f2a2c5592032495db95fb8b6eed375f2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:43.656649 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-3650670a-c0b1-47ae-8a15-34bfa7012063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:43.799557 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee4222-4dee-4da0-a2fb-0e68960b4de8 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:43.806871 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-b8ee4222-4dee-4da0-a2fb-0e68960b4de8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:43.910544 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 927/1881] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:53:43 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:53:43.918274 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3650670a-c0b1-47ae-8a15-34bfa7012063 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:43.922850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-3650670a-c0b1-47ae-8a15-34bfa7012063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:43.941514 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:44.000903 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee4222-4dee-4da0-a2fb-0e68960b4de8 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:44.024934 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f1bc05-d120-49e9-912c-fda592e5f954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:44.031053 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1bc05-d120-49e9-912c-fda592e5f954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:44.031704 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1bc05-d120-49e9-912c-fda592e5f954 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:44.032224 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1bc05-d120-49e9-912c-fda592e5f954 admin admin] PATH_INFO: `/v3/projects/660a1e0fa97c49d3be46e55561456ffc` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:44.052860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f1bc05-d120-49e9-912c-fda592e5f954 admin admin] RBAC: Authorizing `identity:delete_project(project_id=660a1e0fa97c49d3be46e55561456ffc)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:44.070173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f1bc05-d120-49e9-912c-fda592e5f954 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:44.188558 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3650670a-c0b1-47ae-8a15-34bfa7012063 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:44.201389 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdad71b-c106-4203-8354-44ef6f0edc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:44.205501 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdad71b-c106-4203-8354-44ef6f0edc43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:44.206474 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdad71b-c106-4203-8354-44ef6f0edc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:44.207610 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdad71b-c106-4203-8354-44ef6f0edc43 admin admin] PATH_INFO: `/v3/projects/c09fe62ade8e40988a77f2549b439f1d` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:44.213870 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdad71b-c106-4203-8354-44ef6f0edc43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c09fe62ade8e40988a77f2549b439f1d)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:44.215991 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdad71b-c106-4203-8354-44ef6f0edc43 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:44.279574 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-78f1bc05-d120-49e9-912c-fda592e5f954 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '660a1e0fa97c49d3be46e55561456ffc', 'request_id': 'req-78f1bc05-d120-49e9-912c-fda592e5f954'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:44.326543 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-78f1bc05-d120-49e9-912c-fda592e5f954 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '660a1e0fa97c49d3be46e55561456ffc', 'request_id': 'req-78f1bc05-d120-49e9-912c-fda592e5f954'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:44.358117 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-78f1bc05-d120-49e9-912c-fda592e5f954 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '660a1e0fa97c49d3be46e55561456ffc', 'request_id': 'req-78f1bc05-d120-49e9-912c-fda592e5f954'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:44.421822 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-78f1bc05-d120-49e9-912c-fda592e5f954 admin admin] The token cache is being invalidate because project 660a1e0fa97c49d3be46e55561456ffc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:53:44.422600 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-78f1bc05-d120-49e9-912c-fda592e5f954 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:44.424124 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-78f1bc05-d120-49e9-912c-fda592e5f954 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:44.432665 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 955/1882] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:53:43 2022] DELETE /identity/v3/projects/660a1e0fa97c49d3be46e55561456ffc => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:53:44.437503 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f1bc05-d120-49e9-912c-fda592e5f954 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:44.440497 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-78f1bc05-d120-49e9-912c-fda592e5f954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:44.460932 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-abdad71b-c106-4203-8354-44ef6f0edc43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c09fe62ade8e40988a77f2549b439f1d', 'request_id': 'req-abdad71b-c106-4203-8354-44ef6f0edc43'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:44.490353 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-abdad71b-c106-4203-8354-44ef6f0edc43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c09fe62ade8e40988a77f2549b439f1d', 'request_id': 'req-abdad71b-c106-4203-8354-44ef6f0edc43'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:44.510124 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-abdad71b-c106-4203-8354-44ef6f0edc43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c09fe62ade8e40988a77f2549b439f1d', 'request_id': 'req-abdad71b-c106-4203-8354-44ef6f0edc43'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:44.555863 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-abdad71b-c106-4203-8354-44ef6f0edc43 admin admin] The token cache is being invalidate because project c09fe62ade8e40988a77f2549b439f1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:53:44.556465 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-abdad71b-c106-4203-8354-44ef6f0edc43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:44.557205 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-abdad71b-c106-4203-8354-44ef6f0edc43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:44.559114 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 928/1883] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:53:43 2022] DELETE /identity/v3/projects/c09fe62ade8e40988a77f2549b439f1d => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:53:44.559972 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdad71b-c106-4203-8354-44ef6f0edc43 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:44.563503 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-abdad71b-c106-4203-8354-44ef6f0edc43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:44.607446 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f1bc05-d120-49e9-912c-fda592e5f954 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:44.678218 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:44.789013 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b7c5f-dfbb-4ab9-a8b0-eea8366b376f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:44.789754 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b7c5f-dfbb-4ab9-a8b0-eea8366b376f service cinder] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:44.790377 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b7c5f-dfbb-4ab9-a8b0-eea8366b376f service cinder] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:44.791409 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b7c5f-dfbb-4ab9-a8b0-eea8366b376f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:44.799899 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-9c0b7c5f-dfbb-4ab9-a8b0-eea8366b376f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:44.835285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdad71b-c106-4203-8354-44ef6f0edc43 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:44.847486 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814c8ef-5ee2-4daf-8739-97b56b27f055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:44.850059 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814c8ef-5ee2-4daf-8739-97b56b27f055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:44.851687 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814c8ef-5ee2-4daf-8739-97b56b27f055 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:44.852417 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814c8ef-5ee2-4daf-8739-97b56b27f055 admin admin] PATH_INFO: `/v3/users/205d09be91df4e5088a5d84b0855951c` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:44.855747 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8814c8ef-5ee2-4daf-8739-97b56b27f055 admin admin] RBAC: Authorizing `identity:delete_user(user_id=205d09be91df4e5088a5d84b0855951c)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:44.861150 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8814c8ef-5ee2-4daf-8739-97b56b27f055 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:44.949892 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:44.997095 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-8814c8ef-5ee2-4daf-8739-97b56b27f055 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '205d09be91df4e5088a5d84b0855951c'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:45.006066 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-8814c8ef-5ee2-4daf-8739-97b56b27f055 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '205d09be91df4e5088a5d84b0855951c'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:45.006896 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b7c5f-dfbb-4ab9-a8b0-eea8366b376f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:45.008581 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b7c5f-dfbb-4ab9-a8b0-eea8366b376f service cinder] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:45.049540 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 956/1884] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:53:44 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:53:45.049540 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e7319-e88d-4c78-9213-1af58c427a94 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:45.049540 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e7319-e88d-4c78-9213-1af58c427a94 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:45.049540 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e7319-e88d-4c78-9213-1af58c427a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:45.053418 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-8814c8ef-5ee2-4daf-8739-97b56b27f055 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '205d09be91df4e5088a5d84b0855951c'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:45.076140 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-669e7319-e88d-4c78-9213-1af58c427a94 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:45.078231 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-669e7319-e88d-4c78-9213-1af58c427a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:45.080637 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-8814c8ef-5ee2-4daf-8739-97b56b27f055 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '205d09be91df4e5088a5d84b0855951c'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:45.081508 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-8814c8ef-5ee2-4daf-8739-97b56b27f055 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '205d09be91df4e5088a5d84b0855951c'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:45.115384 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 929/1885] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:53:44 2022] DELETE /identity/v3/users/205d09be91df4e5088a5d84b0855951c => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:53:45.135854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 957/1886] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:53:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:53:45.140356 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442fec8-2c6c-4c88-a15a-7e4eeb50a177 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:45.141918 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442fec8-2c6c-4c88-a15a-7e4eeb50a177 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:45.144175 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3442fec8-2c6c-4c88-a15a-7e4eeb50a177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:45.226382 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-3442fec8-2c6c-4c88-a15a-7e4eeb50a177 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:45.229282 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-3442fec8-2c6c-4c88-a15a-7e4eeb50a177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:45.288110 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e7319-e88d-4c78-9213-1af58c427a94 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:45.290900 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-669e7319-e88d-4c78-9213-1af58c427a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:45.311006 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e7319-e88d-4c78-9213-1af58c427a94 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:45.399287 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 930/1887] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:53:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:53:45.411269 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3442fec8-2c6c-4c88-a15a-7e4eeb50a177 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:45.441483 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3442fec8-2c6c-4c88-a15a-7e4eeb50a177 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:45.463511 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3522209-fa61-40af-a045-63abd0697168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:45.465455 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3522209-fa61-40af-a045-63abd0697168 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:45.465455 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3522209-fa61-40af-a045-63abd0697168 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:45.466025 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3522209-fa61-40af-a045-63abd0697168 admin admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:45.467495 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3522209-fa61-40af-a045-63abd0697168 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:53:45.468026 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3522209-fa61-40af-a045-63abd0697168 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:45.472242 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3522209-fa61-40af-a045-63abd0697168 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:45.484134 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5366c235-ee7a-4b16-8be0-988e6f760f52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:45.485598 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366c235-ee7a-4b16-8be0-988e6f760f52 service cinder] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:45.486306 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366c235-ee7a-4b16-8be0-988e6f760f52 service cinder] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:45.487006 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366c235-ee7a-4b16-8be0-988e6f760f52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:45.512201 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-5366c235-ee7a-4b16-8be0-988e6f760f52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:45.515355 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 931/1888] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 13:53:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:53:45.522503 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3522209-fa61-40af-a045-63abd0697168 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:45.543046 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3522209-fa61-40af-a045-63abd0697168 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:45.551417 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709fc282-30c0-4354-9edf-8e336cc0ebc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:45.552473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709fc282-30c0-4354-9edf-8e336cc0ebc4 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:45.553207 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709fc282-30c0-4354-9edf-8e336cc0ebc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:45.553924 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709fc282-30c0-4354-9edf-8e336cc0ebc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:45.555056 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709fc282-30c0-4354-9edf-8e336cc0ebc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:45.559547 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709fc282-30c0-4354-9edf-8e336cc0ebc4 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:45.633420 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 932/1889] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:53:45 2022] POST /identity/v3/projects => generated 375 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:53:45.641485 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709fc282-30c0-4354-9edf-8e336cc0ebc4 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:45.668452 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:45.718353 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5366c235-ee7a-4b16-8be0-988e6f760f52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:45.726146 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5366c235-ee7a-4b16-8be0-988e6f760f52 service cinder] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:45.805352 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 958/1890] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:53:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:53:45.867405 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709fc282-30c0-4354-9edf-8e336cc0ebc4 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:45.925024 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73d542-42f4-42ae-9061-bc7532d7192b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:45.926154 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73d542-42f4-42ae-9061-bc7532d7192b admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:45.926576 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73d542-42f4-42ae-9061-bc7532d7192b admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:45.927020 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73d542-42f4-42ae-9061-bc7532d7192b admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:45.928178 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c73d542-42f4-42ae-9061-bc7532d7192b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:45.935506 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c73d542-42f4-42ae-9061-bc7532d7192b admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:46.004704 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 933/1891] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:53:45 2022] POST /identity/v3/users => generated 288 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:53:46.011732 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5366c235-ee7a-4b16-8be0-988e6f760f52 service cinder] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:46.033409 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5366c235-ee7a-4b16-8be0-988e6f760f52 service cinder] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:46.046546 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a1d92-0c86-426d-beab-60e4696d223a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:46.047344 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a1d92-0c86-426d-beab-60e4696d223a admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:46.047804 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a1d92-0c86-426d-beab-60e4696d223a admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:46.048501 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a1d92-0c86-426d-beab-60e4696d223a admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:46.049281 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78a1d92-0c86-426d-beab-60e4696d223a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:46.051831 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78a1d92-0c86-426d-beab-60e4696d223a admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:46.094845 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 959/1892] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:53:46.097649 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73d542-42f4-42ae-9061-bc7532d7192b admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:46.166892 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73d542-42f4-42ae-9061-bc7532d7192b admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:46.199194 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a1dde2-dbfb-444f-aa61-582b3c1e4ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:46.217857 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1dde2-dbfb-444f-aa61-582b3c1e4ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:46.218429 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1dde2-dbfb-444f-aa61-582b3c1e4ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:46.218904 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1dde2-dbfb-444f-aa61-582b3c1e4ef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:46.226536 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a1dde2-dbfb-444f-aa61-582b3c1e4ef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:46.234894 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a1dde2-dbfb-444f-aa61-582b3c1e4ef8 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:46.291390 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 934/1893] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:53:46.293342 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a1d92-0c86-426d-beab-60e4696d223a admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:46.321386 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a1d92-0c86-426d-beab-60e4696d223a admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:46.330528 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08924bd1-3412-47c9-8151-066a1417e8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:46.332016 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08924bd1-3412-47c9-8151-066a1417e8cf admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:46.332363 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08924bd1-3412-47c9-8151-066a1417e8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:46.333089 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08924bd1-3412-47c9-8151-066a1417e8cf admin admin] PATH_INFO: `/v3/projects/7f5fb3c4307f4323bc5949fec1013d6b/users/2f18afb9b7b544bda40402af1a97f5f5/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:46.378860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08924bd1-3412-47c9-8151-066a1417e8cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f5fb3c4307f4323bc5949fec1013d6b, user_id=2f18afb9b7b544bda40402af1a97f5f5, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:46.387206 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08924bd1-3412-47c9-8151-066a1417e8cf admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:46.429478 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 960/1894] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:53:46 2022] PUT /identity/v3/projects/7f5fb3c4307f4323bc5949fec1013d6b/users/2f18afb9b7b544bda40402af1a97f5f5/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:53:46.449287 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64be6b2-bfe4-4e1c-9831-23ba7fc51e10 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:46.449899 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64be6b2-bfe4-4e1c-9831-23ba7fc51e10 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:46.451110 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64be6b2-bfe4-4e1c-9831-23ba7fc51e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:46.530467 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-b64be6b2-bfe4-4e1c-9831-23ba7fc51e10 None None] MFA Rules not processed for user `2f18afb9b7b544bda40402af1a97f5f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:46.532667 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-b64be6b2-bfe4-4e1c-9831-23ba7fc51e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:46.572891 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08924bd1-3412-47c9-8151-066a1417e8cf admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:46.576407 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-08924bd1-3412-47c9-8151-066a1417e8cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:46.757834 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:46.801605 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 935/1895] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:53:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:53:46.805133 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08924bd1-3412-47c9-8151-066a1417e8cf admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:46.819377 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b351f75-46ab-4c1f-b6f1-beed71149170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:46.819808 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64be6b2-bfe4-4e1c-9831-23ba7fc51e10 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:46.821653 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b351f75-46ab-4c1f-b6f1-beed71149170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:46.822372 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b351f75-46ab-4c1f-b6f1-beed71149170 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:46.823128 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b351f75-46ab-4c1f-b6f1-beed71149170 admin admin] PATH_INFO: `/v3/projects/3934c55d49fb470c828c64a502c85560` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:46.825601 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b351f75-46ab-4c1f-b6f1-beed71149170 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3934c55d49fb470c828c64a502c85560)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:46.833069 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b351f75-46ab-4c1f-b6f1-beed71149170 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:46.857027 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64be6b2-bfe4-4e1c-9831-23ba7fc51e10 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:46.886712 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb83629e-2b98-4a3c-b520-d26580dab876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:46.886712 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83629e-2b98-4a3c-b520-d26580dab876 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:46.887082 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83629e-2b98-4a3c-b520-d26580dab876 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:46.887327 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83629e-2b98-4a3c-b520-d26580dab876 admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:46.891472 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb83629e-2b98-4a3c-b520-d26580dab876 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:46.896699 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb83629e-2b98-4a3c-b520-d26580dab876 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:47.045861 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 936/1896] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:53:46 2022] POST /identity/v3/projects => generated 373 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:53:47.047173 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb83629e-2b98-4a3c-b520-d26580dab876 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:47.063197 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-7b351f75-46ab-4c1f-b6f1-beed71149170 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3934c55d49fb470c828c64a502c85560', 'request_id': 'req-7b351f75-46ab-4c1f-b6f1-beed71149170'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:47.104500 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-7b351f75-46ab-4c1f-b6f1-beed71149170 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3934c55d49fb470c828c64a502c85560', 'request_id': 'req-7b351f75-46ab-4c1f-b6f1-beed71149170'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:47.123473 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-7b351f75-46ab-4c1f-b6f1-beed71149170 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3934c55d49fb470c828c64a502c85560', 'request_id': 'req-7b351f75-46ab-4c1f-b6f1-beed71149170'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:47.200985 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-7b351f75-46ab-4c1f-b6f1-beed71149170 admin admin] The token cache is being invalidate because project 3934c55d49fb470c828c64a502c85560 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:53:47.201565 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-7b351f75-46ab-4c1f-b6f1-beed71149170 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:47.206212 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-7b351f75-46ab-4c1f-b6f1-beed71149170 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:47.214240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 961/1897] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:53:46 2022] DELETE /identity/v3/projects/3934c55d49fb470c828c64a502c85560 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:53:47.222019 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e988ce8-2819-4dba-b2a4-8f31e2ed3685 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:47.222623 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e988ce8-2819-4dba-b2a4-8f31e2ed3685 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:47.223217 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e988ce8-2819-4dba-b2a4-8f31e2ed3685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:47.273037 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-5e988ce8-2819-4dba-b2a4-8f31e2ed3685 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:47.276735 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:47.279527 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-5e988ce8-2819-4dba-b2a4-8f31e2ed3685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:47.291004 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb83629e-2b98-4a3c-b520-d26580dab876 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:47.303519 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54abea8-1a20-48f9-87e3-5f4e560e55e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:47.305223 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54abea8-1a20-48f9-87e3-5f4e560e55e8 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:47.306185 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54abea8-1a20-48f9-87e3-5f4e560e55e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:47.306898 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54abea8-1a20-48f9-87e3-5f4e560e55e8 admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:47.309251 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54abea8-1a20-48f9-87e3-5f4e560e55e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:47.314956 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 962/1898] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:53:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:53:47.316179 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54abea8-1a20-48f9-87e3-5f4e560e55e8 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:47.319725 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af8eb9-8ad1-4b87-92a0-5a5c1cab3bad None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:47.320167 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af8eb9-8ad1-4b87-92a0-5a5c1cab3bad None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:47.320660 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af8eb9-8ad1-4b87-92a0-5a5c1cab3bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:47.377038 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 937/1899] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:53:47 2022] POST /identity/v3/users => generated 293 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:53:47.378040 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54abea8-1a20-48f9-87e3-5f4e560e55e8 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:47.379452 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-55af8eb9-8ad1-4b87-92a0-5a5c1cab3bad None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:47.380174 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-b54abea8-1a20-48f9-87e3-5f4e560e55e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:47.383466 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-55af8eb9-8ad1-4b87-92a0-5a5c1cab3bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:47.414700 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54abea8-1a20-48f9-87e3-5f4e560e55e8 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:47.415091 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 963/1900] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:53:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:53:47.415091 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af8eb9-8ad1-4b87-92a0-5a5c1cab3bad None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:47.428123 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf832a-6b5d-4845-8015-2c2eba18014d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:47.429244 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf832a-6b5d-4845-8015-2c2eba18014d admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:47.433571 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf832a-6b5d-4845-8015-2c2eba18014d admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:47.433571 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bf832a-6b5d-4845-8015-2c2eba18014d admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:47.434165 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af8eb9-8ad1-4b87-92a0-5a5c1cab3bad None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:47.434312 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bf832a-6b5d-4845-8015-2c2eba18014d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:47.435219 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bf832a-6b5d-4845-8015-2c2eba18014d admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:47.441638 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef78b97-313b-4562-8f01-972826fde1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:47.442275 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef78b97-313b-4562-8f01-972826fde1dc admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:47.442609 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef78b97-313b-4562-8f01-972826fde1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:47.442967 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef78b97-313b-4562-8f01-972826fde1dc admin admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:47.443782 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef78b97-313b-4562-8f01-972826fde1dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:53:47.444233 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef78b97-313b-4562-8f01-972826fde1dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:47.448561 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef78b97-313b-4562-8f01-972826fde1dc admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:47.461230 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 938/1901] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:53:47.476525 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf832a-6b5d-4845-8015-2c2eba18014d admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:47.501643 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bf832a-6b5d-4845-8015-2c2eba18014d admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:47.517467 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 964/1902] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 13:53:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:53:47.519296 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18978050-8808-400b-9c95-5a9ae198d96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:47.520251 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18978050-8808-400b-9c95-5a9ae198d96c admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:47.520480 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef78b97-313b-4562-8f01-972826fde1dc admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:47.520867 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18978050-8808-400b-9c95-5a9ae198d96c admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:47.521254 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18978050-8808-400b-9c95-5a9ae198d96c admin admin] PATH_INFO: `/v3/projects/5f87692421f0491385dfd82cf0ff6ddc/users/b01e2804d7a24b7896653bb5db7fab02/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:47.554826 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18978050-8808-400b-9c95-5a9ae198d96c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f87692421f0491385dfd82cf0ff6ddc, user_id=b01e2804d7a24b7896653bb5db7fab02, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:47.564175 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18978050-8808-400b-9c95-5a9ae198d96c admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:47.569223 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef78b97-313b-4562-8f01-972826fde1dc admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:47.594011 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 939/1903] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:53:47 2022] PUT /identity/v3/projects/5f87692421f0491385dfd82cf0ff6ddc/users/b01e2804d7a24b7896653bb5db7fab02/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:53:47.600407 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18978050-8808-400b-9c95-5a9ae198d96c admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:47.766503 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a980d-9ce0-4cc1-91d6-803ff161d15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:47.769230 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a980d-9ce0-4cc1-91d6-803ff161d15b admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:47.769840 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a980d-9ce0-4cc1-91d6-803ff161d15b admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:47.771125 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a980d-9ce0-4cc1-91d6-803ff161d15b admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:47.772766 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25a980d-9ce0-4cc1-91d6-803ff161d15b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:47.780185 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25a980d-9ce0-4cc1-91d6-803ff161d15b admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:47.795706 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18978050-8808-400b-9c95-5a9ae198d96c admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:47.808445 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed9fab-7fcb-4c88-91e7-0b0422867801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:47.809984 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed9fab-7fcb-4c88-91e7-0b0422867801 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:47.813441 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed9fab-7fcb-4c88-91e7-0b0422867801 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:47.813441 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed9fab-7fcb-4c88-91e7-0b0422867801 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:47.813441 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed9fab-7fcb-4c88-91e7-0b0422867801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:47.817209 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed9fab-7fcb-4c88-91e7-0b0422867801 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:47.845534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 940/1904] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:53:47.848372 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 965/1905] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:53:47 2022] POST /identity/v3/projects => generated 385 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:53:47.853934 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed9fab-7fcb-4c88-91e7-0b0422867801 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:47.858330 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a980d-9ce0-4cc1-91d6-803ff161d15b admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:47.896313 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed9fab-7fcb-4c88-91e7-0b0422867801 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:47.993622 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:48.044194 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52844fcc-8879-4448-8b0f-8ebbae2d58a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:48.045224 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52844fcc-8879-4448-8b0f-8ebbae2d58a2 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:48.045706 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52844fcc-8879-4448-8b0f-8ebbae2d58a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:48.046140 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52844fcc-8879-4448-8b0f-8ebbae2d58a2 admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:48.047185 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52844fcc-8879-4448-8b0f-8ebbae2d58a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:48.051385 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52844fcc-8879-4448-8b0f-8ebbae2d58a2 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:48.055155 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a980d-9ce0-4cc1-91d6-803ff161d15b admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:48.065084 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145069ea-1f2c-4967-9863-d9cbb48a7ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:48.066725 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145069ea-1f2c-4967-9863-d9cbb48a7ac8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:48.067443 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145069ea-1f2c-4967-9863-d9cbb48a7ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:48.068000 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145069ea-1f2c-4967-9863-d9cbb48a7ac8 admin admin] PATH_INFO: `/v3/projects/5f87692421f0491385dfd82cf0ff6ddc/users/b01e2804d7a24b7896653bb5db7fab02/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:48.072948 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145069ea-1f2c-4967-9863-d9cbb48a7ac8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f87692421f0491385dfd82cf0ff6ddc, user_id=b01e2804d7a24b7896653bb5db7fab02, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:48.078818 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145069ea-1f2c-4967-9863-d9cbb48a7ac8 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:48.103069 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 941/1906] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:53:47 2022] POST /identity/v3/users => generated 293 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:53:48.104846 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 966/1907] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:53:47 2022] PUT /identity/v3/projects/5f87692421f0491385dfd82cf0ff6ddc/users/b01e2804d7a24b7896653bb5db7fab02/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:53:48.126149 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc0abf-caa8-4dc4-824c-00a7d32ecec1 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:48.126359 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc0abf-caa8-4dc4-824c-00a7d32ecec1 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:48.126850 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc0abf-caa8-4dc4-824c-00a7d32ecec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:48.136475 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52844fcc-8879-4448-8b0f-8ebbae2d58a2 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:48.199088 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-90fc0abf-caa8-4dc4-824c-00a7d32ecec1 None None] MFA Rules not processed for user `b01e2804d7a24b7896653bb5db7fab02`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:48.200611 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52844fcc-8879-4448-8b0f-8ebbae2d58a2 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:48.201405 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-90fc0abf-caa8-4dc4-824c-00a7d32ecec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:48.386896 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:48.505301 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 967/1908] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:53:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:53:48.526616 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba9e78-0450-48a7-975b-9a2d9a1eb8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:48.527927 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba9e78-0450-48a7-975b-9a2d9a1eb8a5 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:48.540267 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc0abf-caa8-4dc4-824c-00a7d32ecec1 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:48.545984 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba9e78-0450-48a7-975b-9a2d9a1eb8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:48.545984 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba9e78-0450-48a7-975b-9a2d9a1eb8a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:48.548624 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba9e78-0450-48a7-975b-9a2d9a1eb8a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:48.548801 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-90fc0abf-caa8-4dc4-824c-00a7d32ecec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:48.555735 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba9e78-0450-48a7-975b-9a2d9a1eb8a5 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:48.661904 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 942/1909] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:53:48 2022] GET /identity/v3/roles => generated 1420 bytes in 558 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:53:48.668813 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba9e78-0450-48a7-975b-9a2d9a1eb8a5 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:48.701234 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba9e78-0450-48a7-975b-9a2d9a1eb8a5 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:48.721739 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a4063-bd7d-4c90-ad76-fe879bf989f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:48.724597 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a4063-bd7d-4c90-ad76-fe879bf989f5 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:48.725245 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a4063-bd7d-4c90-ad76-fe879bf989f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:48.725908 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a4063-bd7d-4c90-ad76-fe879bf989f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:48.727935 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a4063-bd7d-4c90-ad76-fe879bf989f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:48.732012 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a4063-bd7d-4c90-ad76-fe879bf989f5 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:48.771710 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 943/1910] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:53:48 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:53:48.778817 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a4063-bd7d-4c90-ad76-fe879bf989f5 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:48.781691 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc0abf-caa8-4dc4-824c-00a7d32ecec1 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:48.796824 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed059a7d-497d-4d81-a865-bd7b7513a5b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:48.798098 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed059a7d-497d-4d81-a865-bd7b7513a5b4 service cinder] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:48.798670 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed059a7d-497d-4d81-a865-bd7b7513a5b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:48.799273 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed059a7d-497d-4d81-a865-bd7b7513a5b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:48.804940 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-ed059a7d-497d-4d81-a865-bd7b7513a5b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:48.806327 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a4063-bd7d-4c90-ad76-fe879bf989f5 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:48.834264 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e09553-c80a-4983-992a-55678580bdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:48.835444 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e09553-c80a-4983-992a-55678580bdeb admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:48.835947 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e09553-c80a-4983-992a-55678580bdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:48.836451 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e09553-c80a-4983-992a-55678580bdeb admin admin] PATH_INFO: `/v3/projects/f93548afb46c421bb8c3c4a043f61e62/users/23c5c4d1f20448e9a1db8db14324b1c0/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:48.883492 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e09553-c80a-4983-992a-55678580bdeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f93548afb46c421bb8c3c4a043f61e62, user_id=23c5c4d1f20448e9a1db8db14324b1c0, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:48.888969 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e09553-c80a-4983-992a-55678580bdeb admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:48.941654 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 944/1911] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:53:48 2022] PUT /identity/v3/projects/f93548afb46c421bb8c3c4a043f61e62/users/23c5c4d1f20448e9a1db8db14324b1c0/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:53:48.951177 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e67b5-e74c-4b2d-ab76-a8d9634325a5 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:48.951674 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e67b5-e74c-4b2d-ab76-a8d9634325a5 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:48.958982 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e67b5-e74c-4b2d-ab76-a8d9634325a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:49.029257 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-1d4e67b5-e74c-4b2d-ab76-a8d9634325a5 None None] MFA Rules not processed for user `23c5c4d1f20448e9a1db8db14324b1c0`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:49.032116 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-1d4e67b5-e74c-4b2d-ab76-a8d9634325a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:49.074318 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed059a7d-497d-4d81-a865-bd7b7513a5b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:49.079496 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed059a7d-497d-4d81-a865-bd7b7513a5b4 service cinder] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:49.127682 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 968/1912] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:53:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:53:49.227269 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 945/1913] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:53:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:53:49.232984 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed059a7d-497d-4d81-a865-bd7b7513a5b4 service cinder] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:49.261090 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed059a7d-497d-4d81-a865-bd7b7513a5b4 service cinder] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:49.281485 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:49.530142 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb70d0c-8848-4b2a-8dbf-f2475d7c2150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:49.531155 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb70d0c-8848-4b2a-8dbf-f2475d7c2150 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:49.532009 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb70d0c-8848-4b2a-8dbf-f2475d7c2150 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:49.532417 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb70d0c-8848-4b2a-8dbf-f2475d7c2150 admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:49.534053 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb70d0c-8848-4b2a-8dbf-f2475d7c2150 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:49.540063 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb70d0c-8848-4b2a-8dbf-f2475d7c2150 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:49.667362 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 969/1914] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:53:49 2022] POST /identity/v3/projects => generated 385 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:53:49.674008 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e67b5-e74c-4b2d-ab76-a8d9634325a5 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:49.716235 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e67b5-e74c-4b2d-ab76-a8d9634325a5 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:49.932535 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8787aa-a5d0-47ac-a402-647ee32da1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:49.933982 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8787aa-a5d0-47ac-a402-647ee32da1a5 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:49.934815 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8787aa-a5d0-47ac-a402-647ee32da1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:49.935426 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8787aa-a5d0-47ac-a402-647ee32da1a5 admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:49.937261 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8787aa-a5d0-47ac-a402-647ee32da1a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:49.943481 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8787aa-a5d0-47ac-a402-647ee32da1a5 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:50.048032 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 946/1915] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:53:49 2022] POST /identity/v3/users => generated 299 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:53:50.054072 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb70d0c-8848-4b2a-8dbf-f2475d7c2150 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:50.119504 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb70d0c-8848-4b2a-8dbf-f2475d7c2150 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:50.157025 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db30ae-59e4-48fc-9694-503ec8f95eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:50.158325 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db30ae-59e4-48fc-9694-503ec8f95eab admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:50.158808 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db30ae-59e4-48fc-9694-503ec8f95eab admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:50.159298 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75db30ae-59e4-48fc-9694-503ec8f95eab admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:50.163576 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75db30ae-59e4-48fc-9694-503ec8f95eab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:50.169063 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75db30ae-59e4-48fc-9694-503ec8f95eab admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:50.211721 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 970/1916] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 13:53:50.217879 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8787aa-a5d0-47ac-a402-647ee32da1a5 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:50.239194 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8787aa-a5d0-47ac-a402-647ee32da1a5 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:50.247374 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ffab8e-c776-4bcb-a2ca-8d6773dfae05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:50.248803 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ffab8e-c776-4bcb-a2ca-8d6773dfae05 admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:50.249518 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ffab8e-c776-4bcb-a2ca-8d6773dfae05 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:50.250169 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ffab8e-c776-4bcb-a2ca-8d6773dfae05 admin admin] PATH_INFO: `/v3/projects/0b47e443cf3f4f14877ea694df4c110c/users/ebfd720d375b47e5a20b3915f1e0adc2/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:50.286795 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ffab8e-c776-4bcb-a2ca-8d6773dfae05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b47e443cf3f4f14877ea694df4c110c, user_id=ebfd720d375b47e5a20b3915f1e0adc2, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:50.292960 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ffab8e-c776-4bcb-a2ca-8d6773dfae05 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:50.297018 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:50.338494 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db30ae-59e4-48fc-9694-503ec8f95eab admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:50.338982 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 947/1917] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:53:50 2022] PUT /identity/v3/projects/0b47e443cf3f4f14877ea694df4c110c/users/ebfd720d375b47e5a20b3915f1e0adc2/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:53:50.374761 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75db30ae-59e4-48fc-9694-503ec8f95eab admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:50.509772 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64544251-eabb-446b-8a1f-97cf2aa39de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:50.510889 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64544251-eabb-446b-8a1f-97cf2aa39de4 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:50.511109 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64544251-eabb-446b-8a1f-97cf2aa39de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:50.511782 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64544251-eabb-446b-8a1f-97cf2aa39de4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:50.513104 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64544251-eabb-446b-8a1f-97cf2aa39de4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:50.515502 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64544251-eabb-446b-8a1f-97cf2aa39de4 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:50.537936 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ffab8e-c776-4bcb-a2ca-8d6773dfae05 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:50.550657 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 971/1918] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:53:50.559090 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ffab8e-c776-4bcb-a2ca-8d6773dfae05 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:50.567241 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c57d1a-855e-4f80-ab1c-af3fe535a703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:50.568270 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c57d1a-855e-4f80-ab1c-af3fe535a703 admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:50.568633 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c57d1a-855e-4f80-ab1c-af3fe535a703 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:50.568963 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c57d1a-855e-4f80-ab1c-af3fe535a703 admin admin] PATH_INFO: `/v3/projects/0b47e443cf3f4f14877ea694df4c110c/users/ebfd720d375b47e5a20b3915f1e0adc2/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:50.572836 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c57d1a-855e-4f80-ab1c-af3fe535a703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b47e443cf3f4f14877ea694df4c110c, user_id=ebfd720d375b47e5a20b3915f1e0adc2, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:50.577067 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c57d1a-855e-4f80-ab1c-af3fe535a703 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:50.614488 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baea375-4a65-4741-a9bb-4d324f953143 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:50.614847 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baea375-4a65-4741-a9bb-4d324f953143 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:50.615134 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baea375-4a65-4741-a9bb-4d324f953143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:50.618269 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 948/1919] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:53:50 2022] PUT /identity/v3/projects/0b47e443cf3f4f14877ea694df4c110c/users/ebfd720d375b47e5a20b3915f1e0adc2/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:53:50.663788 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-8baea375-4a65-4741-a9bb-4d324f953143 None None] MFA Rules not processed for user `ebfd720d375b47e5a20b3915f1e0adc2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:50.667782 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-8baea375-4a65-4741-a9bb-4d324f953143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:50.813279 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 972/1920] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:53:50 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:53:50.833015 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c57d1a-855e-4f80-ab1c-af3fe535a703 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:50.835995 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-c2c57d1a-855e-4f80-ab1c-af3fe535a703 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:51.000967 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c57d1a-855e-4f80-ab1c-af3fe535a703 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:51.016380 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ba45f-5ead-4267-a8a7-53712a292db4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:51.018184 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ba45f-5ead-4267-a8a7-53712a292db4 service cinder] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:51.018830 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ba45f-5ead-4267-a8a7-53712a292db4 service cinder] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:51.019241 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ba45f-5ead-4267-a8a7-53712a292db4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:51.059241 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ba45f-5ead-4267-a8a7-53712a292db4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:51.063620 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ba45f-5ead-4267-a8a7-53712a292db4 service cinder] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:51.086852 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 949/1921] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:53:50 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:53:51.388672 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baea375-4a65-4741-a9bb-4d324f953143 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:51.412348 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:51.674494 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baea375-4a65-4741-a9bb-4d324f953143 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:51.700932 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a234aaf-9ff9-4d52-9f62-f9bd13f35370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:51.702021 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a234aaf-9ff9-4d52-9f62-f9bd13f35370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:51.702460 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a234aaf-9ff9-4d52-9f62-f9bd13f35370 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:51.702893 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a234aaf-9ff9-4d52-9f62-f9bd13f35370 admin admin] PATH_INFO: `/v3/users/23c5c4d1f20448e9a1db8db14324b1c0` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:51.706687 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a234aaf-9ff9-4d52-9f62-f9bd13f35370 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23c5c4d1f20448e9a1db8db14324b1c0)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:51.711000 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a234aaf-9ff9-4d52-9f62-f9bd13f35370 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:51.883791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-6a234aaf-9ff9-4d52-9f62-f9bd13f35370 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23c5c4d1f20448e9a1db8db14324b1c0'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:51.885155 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-6a234aaf-9ff9-4d52-9f62-f9bd13f35370 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23c5c4d1f20448e9a1db8db14324b1c0'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:51.886559 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-6a234aaf-9ff9-4d52-9f62-f9bd13f35370 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23c5c4d1f20448e9a1db8db14324b1c0'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:51.923623 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-6a234aaf-9ff9-4d52-9f62-f9bd13f35370 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23c5c4d1f20448e9a1db8db14324b1c0'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:51.964732 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-6a234aaf-9ff9-4d52-9f62-f9bd13f35370 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23c5c4d1f20448e9a1db8db14324b1c0'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:52.044172 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 973/1922] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:53:51 2022] DELETE /identity/v3/users/23c5c4d1f20448e9a1db8db14324b1c0 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:53:52.052067 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9699e-53ef-4c8c-99ff-a0c21eec3731 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:52.052998 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9699e-53ef-4c8c-99ff-a0c21eec3731 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:52.053280 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9699e-53ef-4c8c-99ff-a0c21eec3731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:52.104699 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-7ee9699e-53ef-4c8c-99ff-a0c21eec3731 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:52.106550 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-7ee9699e-53ef-4c8c-99ff-a0c21eec3731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:52.337311 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 950/1923] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:53:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:53:52.351934 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a234aaf-9ff9-4d52-9f62-f9bd13f35370 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:52.359011 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-6a234aaf-9ff9-4d52-9f62-f9bd13f35370 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:52.538935 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a234aaf-9ff9-4d52-9f62-f9bd13f35370 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:52.553737 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0ac51-fcdd-4b12-837a-3ae9856fd73a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:52.553737 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0ac51-fcdd-4b12-837a-3ae9856fd73a service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:52.553737 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0ac51-fcdd-4b12-837a-3ae9856fd73a service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:52.553737 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0ac51-fcdd-4b12-837a-3ae9856fd73a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:52.592281 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f0ac51-fcdd-4b12-837a-3ae9856fd73a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:52.595442 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f0ac51-fcdd-4b12-837a-3ae9856fd73a service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:52.634506 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 974/1924] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:53:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:53:52.891721 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee9699e-53ef-4c8c-99ff-a0c21eec3731 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:52.895697 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-7ee9699e-53ef-4c8c-99ff-a0c21eec3731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:52.919229 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee9699e-53ef-4c8c-99ff-a0c21eec3731 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:52.928483 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6dfdfb-f12b-4b18-9b9b-8d9fa1ca7813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:52.929148 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6dfdfb-f12b-4b18-9b9b-8d9fa1ca7813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:52.929825 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6dfdfb-f12b-4b18-9b9b-8d9fa1ca7813 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:52.929825 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6dfdfb-f12b-4b18-9b9b-8d9fa1ca7813 admin admin] PATH_INFO: `/v3/users/2f18afb9b7b544bda40402af1a97f5f5` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:52.932916 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6dfdfb-f12b-4b18-9b9b-8d9fa1ca7813 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f18afb9b7b544bda40402af1a97f5f5)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:52.935749 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6dfdfb-f12b-4b18-9b9b-8d9fa1ca7813 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:53.076255 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-3b6dfdfb-f12b-4b18-9b9b-8d9fa1ca7813 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f18afb9b7b544bda40402af1a97f5f5'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:53.090343 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-3b6dfdfb-f12b-4b18-9b9b-8d9fa1ca7813 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f18afb9b7b544bda40402af1a97f5f5'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:53.123244 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-3b6dfdfb-f12b-4b18-9b9b-8d9fa1ca7813 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f18afb9b7b544bda40402af1a97f5f5'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:53.185387 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-3b6dfdfb-f12b-4b18-9b9b-8d9fa1ca7813 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f18afb9b7b544bda40402af1a97f5f5'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:53.186441 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-3b6dfdfb-f12b-4b18-9b9b-8d9fa1ca7813 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f18afb9b7b544bda40402af1a97f5f5'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:53.222570 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:53.278562 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 951/1925] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:53:52 2022] DELETE /identity/v3/users/2f18afb9b7b544bda40402af1a97f5f5 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:53:53.285913 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd65be-bca8-4b7d-99ae-9b9ad2482d80 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:53.286256 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd65be-bca8-4b7d-99ae-9b9ad2482d80 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:53.286746 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd65be-bca8-4b7d-99ae-9b9ad2482d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:53.364412 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-82dd65be-bca8-4b7d-99ae-9b9ad2482d80 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:53.372129 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-82dd65be-bca8-4b7d-99ae-9b9ad2482d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:53.509975 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:53.598729 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 975/1926] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:53:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:53:53.789296 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6dfdfb-f12b-4b18-9b9b-8d9fa1ca7813 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:53.792104 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-3b6dfdfb-f12b-4b18-9b9b-8d9fa1ca7813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:54.011765 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6dfdfb-f12b-4b18-9b9b-8d9fa1ca7813 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:54.023475 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44841c-551c-4f45-b2b9-cda3ad715457 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:54.024531 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44841c-551c-4f45-b2b9-cda3ad715457 service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:54.025030 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44841c-551c-4f45-b2b9-cda3ad715457 service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:54.025544 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44841c-551c-4f45-b2b9-cda3ad715457 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:54.066336 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea44841c-551c-4f45-b2b9-cda3ad715457 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:54.068756 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea44841c-551c-4f45-b2b9-cda3ad715457 service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:54.086532 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 952/1927] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:53:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:53:54.640280 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd65be-bca8-4b7d-99ae-9b9ad2482d80 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:54.644299 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-82dd65be-bca8-4b7d-99ae-9b9ad2482d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:54.695644 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd65be-bca8-4b7d-99ae-9b9ad2482d80 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:54.725069 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe849cf4-5a7e-42a2-bb45-cf6f2017f311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:54.726299 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe849cf4-5a7e-42a2-bb45-cf6f2017f311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:54.726896 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe849cf4-5a7e-42a2-bb45-cf6f2017f311 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:54.727365 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe849cf4-5a7e-42a2-bb45-cf6f2017f311 admin admin] PATH_INFO: `/v3/projects/f93548afb46c421bb8c3c4a043f61e62` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:54.731866 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe849cf4-5a7e-42a2-bb45-cf6f2017f311 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f93548afb46c421bb8c3c4a043f61e62)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:54.741689 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe849cf4-5a7e-42a2-bb45-cf6f2017f311 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:55.084208 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-fe849cf4-5a7e-42a2-bb45-cf6f2017f311 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f93548afb46c421bb8c3c4a043f61e62', 'request_id': 'req-fe849cf4-5a7e-42a2-bb45-cf6f2017f311'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:55.084744 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44841c-551c-4f45-b2b9-cda3ad715457 service neutron] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:55.103787 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-ea44841c-551c-4f45-b2b9-cda3ad715457 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:55.113895 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-fe849cf4-5a7e-42a2-bb45-cf6f2017f311 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f93548afb46c421bb8c3c4a043f61e62', 'request_id': 'req-fe849cf4-5a7e-42a2-bb45-cf6f2017f311'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:55.132651 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-fe849cf4-5a7e-42a2-bb45-cf6f2017f311 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f93548afb46c421bb8c3c4a043f61e62', 'request_id': 'req-fe849cf4-5a7e-42a2-bb45-cf6f2017f311'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:55.152283 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44841c-551c-4f45-b2b9-cda3ad715457 service neutron] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:55.214648 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-fe849cf4-5a7e-42a2-bb45-cf6f2017f311 admin admin] The token cache is being invalidate because project f93548afb46c421bb8c3c4a043f61e62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:53:55.215006 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-fe849cf4-5a7e-42a2-bb45-cf6f2017f311 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:55.216181 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-fe849cf4-5a7e-42a2-bb45-cf6f2017f311 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:55.223204 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 976/1928] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:53:54 2022] DELETE /identity/v3/projects/f93548afb46c421bb8c3c4a043f61e62 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:53:55.225200 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe849cf4-5a7e-42a2-bb45-cf6f2017f311 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:55.228250 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-fe849cf4-5a7e-42a2-bb45-cf6f2017f311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:55.340817 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f7230-6b90-4a3d-83fc-ba6a84b36fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:55.344241 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f7230-6b90-4a3d-83fc-ba6a84b36fa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:55.345133 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f7230-6b90-4a3d-83fc-ba6a84b36fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:55.345891 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f7230-6b90-4a3d-83fc-ba6a84b36fa9 admin admin] PATH_INFO: `/v3/projects/7f5fb3c4307f4323bc5949fec1013d6b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:55.351189 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67f7230-6b90-4a3d-83fc-ba6a84b36fa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f5fb3c4307f4323bc5949fec1013d6b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:55.355978 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67f7230-6b90-4a3d-83fc-ba6a84b36fa9 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:55.387790 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe849cf4-5a7e-42a2-bb45-cf6f2017f311 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:55.401429 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03ce37-f6aa-4605-97d6-4d928149636f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:55.401429 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03ce37-f6aa-4605-97d6-4d928149636f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:55.401429 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03ce37-f6aa-4605-97d6-4d928149636f admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:55.401429 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03ce37-f6aa-4605-97d6-4d928149636f admin admin] PATH_INFO: `/v3/users/ebfd720d375b47e5a20b3915f1e0adc2` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:55.403743 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b03ce37-f6aa-4605-97d6-4d928149636f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebfd720d375b47e5a20b3915f1e0adc2)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:55.406353 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b03ce37-f6aa-4605-97d6-4d928149636f admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:55.446032 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-b67f7230-6b90-4a3d-83fc-ba6a84b36fa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f5fb3c4307f4323bc5949fec1013d6b', 'request_id': 'req-b67f7230-6b90-4a3d-83fc-ba6a84b36fa9'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:55.463278 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-b67f7230-6b90-4a3d-83fc-ba6a84b36fa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f5fb3c4307f4323bc5949fec1013d6b', 'request_id': 'req-b67f7230-6b90-4a3d-83fc-ba6a84b36fa9'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:55.485638 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-b67f7230-6b90-4a3d-83fc-ba6a84b36fa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f5fb3c4307f4323bc5949fec1013d6b', 'request_id': 'req-b67f7230-6b90-4a3d-83fc-ba6a84b36fa9'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:55.512772 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-7b03ce37-f6aa-4605-97d6-4d928149636f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebfd720d375b47e5a20b3915f1e0adc2'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:55.514331 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-7b03ce37-f6aa-4605-97d6-4d928149636f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebfd720d375b47e5a20b3915f1e0adc2'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:55.517037 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-7b03ce37-f6aa-4605-97d6-4d928149636f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebfd720d375b47e5a20b3915f1e0adc2'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:55.520615 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-b67f7230-6b90-4a3d-83fc-ba6a84b36fa9 admin admin] The token cache is being invalidate because project 7f5fb3c4307f4323bc5949fec1013d6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:53:55.521054 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-b67f7230-6b90-4a3d-83fc-ba6a84b36fa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:55.522574 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-b67f7230-6b90-4a3d-83fc-ba6a84b36fa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:55.530505 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 953/1929] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:53:55 2022] DELETE /identity/v3/projects/7f5fb3c4307f4323bc5949fec1013d6b => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:53:55.530816 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:55.538925 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f7230-6b90-4a3d-83fc-ba6a84b36fa9 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:55.539404 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-7b03ce37-f6aa-4605-97d6-4d928149636f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebfd720d375b47e5a20b3915f1e0adc2'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:55.539575 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-b67f7230-6b90-4a3d-83fc-ba6a84b36fa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:55.579108 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-7b03ce37-f6aa-4605-97d6-4d928149636f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebfd720d375b47e5a20b3915f1e0adc2'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:55.617442 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:55.618672 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 977/1930] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:53:55 2022] DELETE /identity/v3/users/ebfd720d375b47e5a20b3915f1e0adc2 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:53:55.729186 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f7230-6b90-4a3d-83fc-ba6a84b36fa9 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:55.931653 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4512d84a-d98e-4e35-b450-8b167680bacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:55.931653 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512d84a-d98e-4e35-b450-8b167680bacf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:55.932382 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512d84a-d98e-4e35-b450-8b167680bacf admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:55.932382 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512d84a-d98e-4e35-b450-8b167680bacf admin admin] PATH_INFO: `/v3/users/b01e2804d7a24b7896653bb5db7fab02` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:55.933511 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4512d84a-d98e-4e35-b450-8b167680bacf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b01e2804d7a24b7896653bb5db7fab02)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:55.936818 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4512d84a-d98e-4e35-b450-8b167680bacf admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:56.100804 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-4512d84a-d98e-4e35-b450-8b167680bacf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b01e2804d7a24b7896653bb5db7fab02'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:56.101297 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-4512d84a-d98e-4e35-b450-8b167680bacf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b01e2804d7a24b7896653bb5db7fab02'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:56.145027 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-4512d84a-d98e-4e35-b450-8b167680bacf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b01e2804d7a24b7896653bb5db7fab02'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:56.212924 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-4512d84a-d98e-4e35-b450-8b167680bacf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b01e2804d7a24b7896653bb5db7fab02'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:56.218909 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-4512d84a-d98e-4e35-b450-8b167680bacf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b01e2804d7a24b7896653bb5db7fab02'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:56.281181 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 954/1931] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:53:55 2022] DELETE /identity/v3/users/b01e2804d7a24b7896653bb5db7fab02 => generated 0 bytes in 748 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:53:56.852029 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03ce37-f6aa-4605-97d6-4d928149636f admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:56.856773 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-7b03ce37-f6aa-4605-97d6-4d928149636f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:56.886331 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03ce37-f6aa-4605-97d6-4d928149636f admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:57.172798 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1467514-e9c4-40d7-95a3-a50a6646d78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:57.176778 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1467514-e9c4-40d7-95a3-a50a6646d78f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:57.177291 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1467514-e9c4-40d7-95a3-a50a6646d78f admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:57.177855 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1467514-e9c4-40d7-95a3-a50a6646d78f admin admin] PATH_INFO: `/v3/projects/0b47e443cf3f4f14877ea694df4c110c` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:57.183000 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1467514-e9c4-40d7-95a3-a50a6646d78f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b47e443cf3f4f14877ea694df4c110c)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:57.189159 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1467514-e9c4-40d7-95a3-a50a6646d78f admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:57.375318 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4512d84a-d98e-4e35-b450-8b167680bacf admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:57.378921 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-4512d84a-d98e-4e35-b450-8b167680bacf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:57.418027 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-d1467514-e9c4-40d7-95a3-a50a6646d78f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b47e443cf3f4f14877ea694df4c110c', 'request_id': 'req-d1467514-e9c4-40d7-95a3-a50a6646d78f'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:57.438785 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4512d84a-d98e-4e35-b450-8b167680bacf admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:57.444272 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-d1467514-e9c4-40d7-95a3-a50a6646d78f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b47e443cf3f4f14877ea694df4c110c', 'request_id': 'req-d1467514-e9c4-40d7-95a3-a50a6646d78f'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:57.484000 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-d1467514-e9c4-40d7-95a3-a50a6646d78f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b47e443cf3f4f14877ea694df4c110c', 'request_id': 'req-d1467514-e9c4-40d7-95a3-a50a6646d78f'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:57.560996 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-d1467514-e9c4-40d7-95a3-a50a6646d78f admin admin] The token cache is being invalidate because project 0b47e443cf3f4f14877ea694df4c110c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:53:57.561810 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-d1467514-e9c4-40d7-95a3-a50a6646d78f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:57.564066 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-d1467514-e9c4-40d7-95a3-a50a6646d78f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:57.578555 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 978/1932] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:53:56 2022] DELETE /identity/v3/projects/0b47e443cf3f4f14877ea694df4c110c => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:53:57.584159 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e19fa-0a71-47dd-99f8-0b83a218739e None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:57.584862 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e19fa-0a71-47dd-99f8-0b83a218739e None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:57.585110 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e19fa-0a71-47dd-99f8-0b83a218739e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:57.647540 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-904e19fa-0a71-47dd-99f8-0b83a218739e None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:57.647917 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-904e19fa-0a71-47dd-99f8-0b83a218739e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:57.710097 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:57.735791 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9bb73f-8102-47a4-9faa-1758d309b6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:57.743159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9bb73f-8102-47a4-9faa-1758d309b6e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:57.743665 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9bb73f-8102-47a4-9faa-1758d309b6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:57.744161 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9bb73f-8102-47a4-9faa-1758d309b6e6 admin admin] PATH_INFO: `/v3/projects/5f87692421f0491385dfd82cf0ff6ddc` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:57.750792 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9bb73f-8102-47a4-9faa-1758d309b6e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f87692421f0491385dfd82cf0ff6ddc)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:57.760378 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9bb73f-8102-47a4-9faa-1758d309b6e6 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:58.019201 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 979/1933] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:53:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:53:58.021591 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-8e9bb73f-8102-47a4-9faa-1758d309b6e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f87692421f0491385dfd82cf0ff6ddc', 'request_id': 'req-8e9bb73f-8102-47a4-9faa-1758d309b6e6'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:58.025354 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abaced-2d9d-4d76-a12b-6f14c6363dc1 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:58.026067 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abaced-2d9d-4d76-a12b-6f14c6363dc1 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:58.026566 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abaced-2d9d-4d76-a12b-6f14c6363dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:58.059973 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:58.067514 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-8e9bb73f-8102-47a4-9faa-1758d309b6e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f87692421f0491385dfd82cf0ff6ddc', 'request_id': 'req-8e9bb73f-8102-47a4-9faa-1758d309b6e6'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:58.095864 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-8e9bb73f-8102-47a4-9faa-1758d309b6e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f87692421f0491385dfd82cf0ff6ddc', 'request_id': 'req-8e9bb73f-8102-47a4-9faa-1758d309b6e6'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:58.127010 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-98abaced-2d9d-4d76-a12b-6f14c6363dc1 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:58.129922 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-98abaced-2d9d-4d76-a12b-6f14c6363dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:58.167477 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-8e9bb73f-8102-47a4-9faa-1758d309b6e6 admin admin] The token cache is being invalidate because project 5f87692421f0491385dfd82cf0ff6ddc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:53:58.168345 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-8e9bb73f-8102-47a4-9faa-1758d309b6e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:58.169952 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-8e9bb73f-8102-47a4-9faa-1758d309b6e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:53:58.173956 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 955/1934] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:53:57 2022] DELETE /identity/v3/projects/5f87692421f0491385dfd82cf0ff6ddc => generated 0 bytes in 799 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:53:58.188242 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407a30d-02b8-458b-9e56-bcfbba986370 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:58.193052 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407a30d-02b8-458b-9e56-bcfbba986370 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:58.202320 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407a30d-02b8-458b-9e56-bcfbba986370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:58.272093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-3407a30d-02b8-458b-9e56-bcfbba986370 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:58.274385 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-3407a30d-02b8-458b-9e56-bcfbba986370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:58.341427 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 980/1935] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:53:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:53:58.348642 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98abaced-2d9d-4d76-a12b-6f14c6363dc1 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:58.366595 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98abaced-2d9d-4d76-a12b-6f14c6363dc1 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:58.378448 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6a926-cfc7-4d1b-8921-fc5cd800e980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:58.379441 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6a926-cfc7-4d1b-8921-fc5cd800e980 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:58.379980 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6a926-cfc7-4d1b-8921-fc5cd800e980 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:58.381099 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea6a926-cfc7-4d1b-8921-fc5cd800e980 admin admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:58.382413 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea6a926-cfc7-4d1b-8921-fc5cd800e980 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:53:58.383019 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea6a926-cfc7-4d1b-8921-fc5cd800e980 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:58.386874 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea6a926-cfc7-4d1b-8921-fc5cd800e980 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:58.421097 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 981/1936] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 13:53:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:53:58.422561 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6a926-cfc7-4d1b-8921-fc5cd800e980 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:58.440431 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 956/1937] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:53:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:53:58.452213 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea6a926-cfc7-4d1b-8921-fc5cd800e980 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:58.452213 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da120c-3cca-4fb0-a4d8-f84b4f5a1238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:58.454076 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da120c-3cca-4fb0-a4d8-f84b4f5a1238 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:58.454437 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da120c-3cca-4fb0-a4d8-f84b4f5a1238 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:58.454931 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da120c-3cca-4fb0-a4d8-f84b4f5a1238 admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:58.457589 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0da120c-3cca-4fb0-a4d8-f84b4f5a1238 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:58.458602 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc543c0-0d4d-4d47-9acf-41a08371917b None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:58.459409 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc543c0-0d4d-4d47-9acf-41a08371917b None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:58.459988 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc543c0-0d4d-4d47-9acf-41a08371917b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:58.462244 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0da120c-3cca-4fb0-a4d8-f84b4f5a1238 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:58.506279 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-6cc543c0-0d4d-4d47-9acf-41a08371917b None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:58.508341 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 982/1938] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:53:58 2022] POST /identity/v3/projects => generated 377 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:53:58.515095 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da120c-3cca-4fb0-a4d8-f84b4f5a1238 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:58.515475 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-6cc543c0-0d4d-4d47-9acf-41a08371917b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:58.639553 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 957/1939] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:53:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:53:58.649415 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc543c0-0d4d-4d47-9acf-41a08371917b None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:58.661335 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da120c-3cca-4fb0-a4d8-f84b4f5a1238 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:58.665132 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc543c0-0d4d-4d47-9acf-41a08371917b None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:58.673481 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6617eeb-8ec1-4ceb-923b-413f3c0153d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:58.675412 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6617eeb-8ec1-4ceb-923b-413f3c0153d0 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:58.675645 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5820a17-8064-400e-a07e-1c003d816646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:58.675834 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6617eeb-8ec1-4ceb-923b-413f3c0153d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:58.676202 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6617eeb-8ec1-4ceb-923b-413f3c0153d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:58.676829 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5820a17-8064-400e-a07e-1c003d816646 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:58.676996 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6617eeb-8ec1-4ceb-923b-413f3c0153d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:53:58.677353 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6617eeb-8ec1-4ceb-923b-413f3c0153d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:58.677548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5820a17-8064-400e-a07e-1c003d816646 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:58.677983 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5820a17-8064-400e-a07e-1c003d816646 admin admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:58.679164 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5820a17-8064-400e-a07e-1c003d816646 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:58.679331 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6617eeb-8ec1-4ceb-923b-413f3c0153d0 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:58.684826 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5820a17-8064-400e-a07e-1c003d816646 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:58.697427 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 958/1940] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 13:53:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:53:58.703327 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6617eeb-8ec1-4ceb-923b-413f3c0153d0 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:58.723720 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6617eeb-8ec1-4ceb-923b-413f3c0153d0 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:58.733763 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 983/1941] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:53:58 2022] POST /identity/v3/users => generated 289 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:53:58.736016 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5820a17-8064-400e-a07e-1c003d816646 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:58.740105 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e94734-14d9-4b9e-8a7e-1aa919639ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:58.741178 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e94734-14d9-4b9e-8a7e-1aa919639ad6 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:58.741751 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e94734-14d9-4b9e-8a7e-1aa919639ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:58.742213 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e94734-14d9-4b9e-8a7e-1aa919639ad6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:58.743224 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e94734-14d9-4b9e-8a7e-1aa919639ad6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:58.746137 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e94734-14d9-4b9e-8a7e-1aa919639ad6 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:58.758136 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5820a17-8064-400e-a07e-1c003d816646 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:58.766585 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e056ff9-e8f5-41b5-9901-896a50448a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:58.767657 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e056ff9-e8f5-41b5-9901-896a50448a44 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:58.769526 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e056ff9-e8f5-41b5-9901-896a50448a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:58.769989 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e056ff9-e8f5-41b5-9901-896a50448a44 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:58.771342 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e056ff9-e8f5-41b5-9901-896a50448a44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:58.774523 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e056ff9-e8f5-41b5-9901-896a50448a44 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:58.776439 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:58.803534 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 984/1942] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:53:58.805999 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e056ff9-e8f5-41b5-9901-896a50448a44 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:58.827077 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 959/1943] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:53:58 2022] POST /identity/v3/projects => generated 373 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:53:58.828909 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e056ff9-e8f5-41b5-9901-896a50448a44 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:58.829102 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e94734-14d9-4b9e-8a7e-1aa919639ad6 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:58.960775 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:58.961742 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e94734-14d9-4b9e-8a7e-1aa919639ad6 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:58.968816 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f527926-b2a4-4cdf-a4b9-698b8a7e29ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:58.969903 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f527926-b2a4-4cdf-a4b9-698b8a7e29ff admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:58.970432 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f527926-b2a4-4cdf-a4b9-698b8a7e29ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:58.970882 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f527926-b2a4-4cdf-a4b9-698b8a7e29ff admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:58.982210 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f527926-b2a4-4cdf-a4b9-698b8a7e29ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:58.985177 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f527926-b2a4-4cdf-a4b9-698b8a7e29ff admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:58.992760 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a4915-a232-4b50-8ea3-599e35411f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:58.993880 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a4915-a232-4b50-8ea3-599e35411f85 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:58.994167 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a4915-a232-4b50-8ea3-599e35411f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:58.994516 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a4915-a232-4b50-8ea3-599e35411f85 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:58.995222 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a4915-a232-4b50-8ea3-599e35411f85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:58.997216 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a4915-a232-4b50-8ea3-599e35411f85 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:59.015077 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 985/1944] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 13:53:59.020855 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 960/1945] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:53:58 2022] POST /identity/v3/users => generated 287 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:53:59.021817 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a4915-a232-4b50-8ea3-599e35411f85 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:59.026309 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f527926-b2a4-4cdf-a4b9-698b8a7e29ff admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:59.042830 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f527926-b2a4-4cdf-a4b9-698b8a7e29ff admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:59.044727 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a4915-a232-4b50-8ea3-599e35411f85 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:59.049396 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2b308-3fa3-4620-aa6e-24b350e8e26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:59.050267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2b308-3fa3-4620-aa6e-24b350e8e26c admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:59.050686 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2b308-3fa3-4620-aa6e-24b350e8e26c admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:59.051150 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2b308-3fa3-4620-aa6e-24b350e8e26c admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:59.052174 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de2b308-3fa3-4620-aa6e-24b350e8e26c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:59.053541 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72763cb-aa06-4887-9e1b-7ee6ce86ece4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:59.054314 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de2b308-3fa3-4620-aa6e-24b350e8e26c admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:59.054549 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72763cb-aa06-4887-9e1b-7ee6ce86ece4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:59.054888 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72763cb-aa06-4887-9e1b-7ee6ce86ece4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:59.055306 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72763cb-aa06-4887-9e1b-7ee6ce86ece4 admin admin] PATH_INFO: `/v3/projects/de5785b7d83f4c7898040cb7edb75f1f/users/863ab789f224477b9a4b4170e6db547e/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:59.073002 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 961/1946] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 13:53:59.078521 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2b308-3fa3-4620-aa6e-24b350e8e26c admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:59.087853 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72763cb-aa06-4887-9e1b-7ee6ce86ece4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de5785b7d83f4c7898040cb7edb75f1f, user_id=863ab789f224477b9a4b4170e6db547e, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:59.091016 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72763cb-aa06-4887-9e1b-7ee6ce86ece4 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:59.093782 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2b308-3fa3-4620-aa6e-24b350e8e26c admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:59.102753 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ae4fb-41c4-4fd7-9e50-44aff18c3b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:59.103612 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ae4fb-41c4-4fd7-9e50-44aff18c3b10 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:59.104026 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ae4fb-41c4-4fd7-9e50-44aff18c3b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:59.104433 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ae4fb-41c4-4fd7-9e50-44aff18c3b10 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:59.105439 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ae4fb-41c4-4fd7-9e50-44aff18c3b10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:59.107569 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ae4fb-41c4-4fd7-9e50-44aff18c3b10 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:59.115591 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 986/1947] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:53:59 2022] PUT /identity/v3/projects/de5785b7d83f4c7898040cb7edb75f1f/users/863ab789f224477b9a4b4170e6db547e/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:53:59.121962 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 962/1948] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:53:59.126846 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72763cb-aa06-4887-9e1b-7ee6ce86ece4 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:59.132333 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb55ec-4dba-41ca-b4bc-08a5efeaa303 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:59.133401 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb55ec-4dba-41ca-b4bc-08a5efeaa303 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:59.133401 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb55ec-4dba-41ca-b4bc-08a5efeaa303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:59.181390 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-4fcb55ec-4dba-41ca-b4bc-08a5efeaa303 None None] MFA Rules not processed for user `863ab789f224477b9a4b4170e6db547e`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:59.183195 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-4fcb55ec-4dba-41ca-b4bc-08a5efeaa303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:59.233301 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72763cb-aa06-4887-9e1b-7ee6ce86ece4 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:59.240025 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e8340-d289-4a1d-8735-5c637417ace3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:59.241120 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e8340-d289-4a1d-8735-5c637417ace3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:59.241645 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e8340-d289-4a1d-8735-5c637417ace3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:59.242428 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e8340-d289-4a1d-8735-5c637417ace3 admin admin] PATH_INFO: `/v3/projects/991413f1353144f9be198205a3b06cc5/users/cac09ed2bb724321a76843ed2cebbef2/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:59.268918 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e8340-d289-4a1d-8735-5c637417ace3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=991413f1353144f9be198205a3b06cc5, user_id=cac09ed2bb724321a76843ed2cebbef2, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:59.273808 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e8340-d289-4a1d-8735-5c637417ace3 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:59.310133 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 987/1949] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:53:59 2022] PUT /identity/v3/projects/991413f1353144f9be198205a3b06cc5/users/cac09ed2bb724321a76843ed2cebbef2/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:53:59.327238 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a6c59-b484-45eb-b9f5-d3d8b0f847db None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:59.327561 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a6c59-b484-45eb-b9f5-d3d8b0f847db None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:59.328037 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a6c59-b484-45eb-b9f5-d3d8b0f847db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:59.334617 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 963/1950] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:53:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:53:59.338195 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcb55ec-4dba-41ca-b4bc-08a5efeaa303 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:59.378684 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-2e4a6c59-b484-45eb-b9f5-d3d8b0f847db None None] MFA Rules not processed for user `cac09ed2bb724321a76843ed2cebbef2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:53:59.380243 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-2e4a6c59-b484-45eb-b9f5-d3d8b0f847db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:59.381802 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcb55ec-4dba-41ca-b4bc-08a5efeaa303 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:59.528391 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:59.553935 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 988/1951] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:53:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:53:59.563556 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d7b43-33b7-4ed2-b2b0-acc8bbe8f2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:59.565753 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d7b43-33b7-4ed2-b2b0-acc8bbe8f2e7 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:59.566779 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d7b43-33b7-4ed2-b2b0-acc8bbe8f2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:59.567593 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d7b43-33b7-4ed2-b2b0-acc8bbe8f2e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:59.569079 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131d7b43-33b7-4ed2-b2b0-acc8bbe8f2e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:59.573666 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131d7b43-33b7-4ed2-b2b0-acc8bbe8f2e7 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:59.576742 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a6c59-b484-45eb-b9f5-d3d8b0f847db None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:59.584461 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-2e4a6c59-b484-45eb-b9f5-d3d8b0f847db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:53:59.669931 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 964/1952] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:53:59 2022] POST /identity/v3/projects => generated 377 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:53:59.676090 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d7b43-33b7-4ed2-b2b0-acc8bbe8f2e7 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:59.690618 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:59.736776 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a6c59-b484-45eb-b9f5-d3d8b0f847db None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:59.837905 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d7b43-33b7-4ed2-b2b0-acc8bbe8f2e7 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:59.851073 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577088f8-1f83-4abc-a970-7ed8e6ca4c61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:59.852221 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577088f8-1f83-4abc-a970-7ed8e6ca4c61 service cinder] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:59.852710 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577088f8-1f83-4abc-a970-7ed8e6ca4c61 service cinder] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:59.853191 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577088f8-1f83-4abc-a970-7ed8e6ca4c61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:59.862890 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014214f-58ee-407f-aa62-7af0d1766981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:59.867183 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014214f-58ee-407f-aa62-7af0d1766981 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:59.867953 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014214f-58ee-407f-aa62-7af0d1766981 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:59.868454 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014214f-58ee-407f-aa62-7af0d1766981 admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:59.870570 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8014214f-58ee-407f-aa62-7af0d1766981 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:59.878524 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8014214f-58ee-407f-aa62-7af0d1766981 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:59.929025 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 965/1953] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:53:59 2022] POST /identity/v3/users => generated 289 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:53:59.942889 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014214f-58ee-407f-aa62-7af0d1766981 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:53:59.974686 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014214f-58ee-407f-aa62-7af0d1766981 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:53:59.988931 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc3c1a-0108-450d-b7f9-a0daa8f67b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:53:59.991108 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc3c1a-0108-450d-b7f9-a0daa8f67b60 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:53:59.991406 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc3c1a-0108-450d-b7f9-a0daa8f67b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:53:59.991755 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc3c1a-0108-450d-b7f9-a0daa8f67b60 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:53:59.993503 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc3c1a-0108-450d-b7f9-a0daa8f67b60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:59.997133 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc3c1a-0108-450d-b7f9-a0daa8f67b60 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:53:59.998099 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577088f8-1f83-4abc-a970-7ed8e6ca4c61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:53:59.999659 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577088f8-1f83-4abc-a970-7ed8e6ca4c61 service cinder] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:00.021666 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 989/1954] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:53:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:54:00.026320 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 966/1955] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:54:00.028340 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577088f8-1f83-4abc-a970-7ed8e6ca4c61 service cinder] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:00.056751 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577088f8-1f83-4abc-a970-7ed8e6ca4c61 service cinder] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:00.067008 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f9d7d-e653-4938-863d-6887dbd3951e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:00.068199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f9d7d-e653-4938-863d-6887dbd3951e admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:00.068740 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f9d7d-e653-4938-863d-6887dbd3951e admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:00.069248 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f9d7d-e653-4938-863d-6887dbd3951e admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:00.070206 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f9d7d-e653-4938-863d-6887dbd3951e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:00.073106 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f9d7d-e653-4938-863d-6887dbd3951e admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:00.105154 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 990/1956] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:54:00.109532 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc3c1a-0108-450d-b7f9-a0daa8f67b60 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:00.125659 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc3c1a-0108-450d-b7f9-a0daa8f67b60 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:00.140475 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e9473-933a-4ee3-b80f-286d72bb09b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:00.144331 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e9473-933a-4ee3-b80f-286d72bb09b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:00.145932 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e9473-933a-4ee3-b80f-286d72bb09b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:00.147667 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e9473-933a-4ee3-b80f-286d72bb09b4 admin admin] PATH_INFO: `/v3/projects/9a0a02eb5601402bb5f40ebe7d4bf6ec/users/1ca54b8c1dd74b45b33298aa26985ae1/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:00.196203 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1e9473-933a-4ee3-b80f-286d72bb09b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a0a02eb5601402bb5f40ebe7d4bf6ec, user_id=1ca54b8c1dd74b45b33298aa26985ae1, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:00.222741 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1e9473-933a-4ee3-b80f-286d72bb09b4 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:00.290183 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfc3e2-b139-47bf-90f8-caee31bac5da None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:00.290415 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfc3e2-b139-47bf-90f8-caee31bac5da None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:00.291007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfc3e2-b139-47bf-90f8-caee31bac5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:00.294015 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 967/1957] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:54:00 2022] PUT /identity/v3/projects/9a0a02eb5601402bb5f40ebe7d4bf6ec/users/1ca54b8c1dd74b45b33298aa26985ae1/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:54:00.346503 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-aabfc3e2-b139-47bf-90f8-caee31bac5da None None] MFA Rules not processed for user `1ca54b8c1dd74b45b33298aa26985ae1`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:00.348533 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-aabfc3e2-b139-47bf-90f8-caee31bac5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:00.525904 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 991/1958] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:54:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:54:00.557224 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e9473-933a-4ee3-b80f-286d72bb09b4 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:00.800309 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e9473-933a-4ee3-b80f-286d72bb09b4 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:00.810050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39412c7-a0f1-450c-9897-f871f66c7033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:00.811278 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39412c7-a0f1-450c-9897-f871f66c7033 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:00.811783 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39412c7-a0f1-450c-9897-f871f66c7033 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:00.812186 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39412c7-a0f1-450c-9897-f871f66c7033 admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:00.813325 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39412c7-a0f1-450c-9897-f871f66c7033 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:00.818752 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39412c7-a0f1-450c-9897-f871f66c7033 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:00.871066 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 968/1959] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:54:00 2022] POST /identity/v3/projects => generated 379 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:54:00.876363 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabfc3e2-b139-47bf-90f8-caee31bac5da None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:00.893691 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabfc3e2-b139-47bf-90f8-caee31bac5da None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:00.932262 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:01.024798 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc639c4-b9fa-4b7b-8a24-91371d24bffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:01.025551 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc639c4-b9fa-4b7b-8a24-91371d24bffd admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:01.025917 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc639c4-b9fa-4b7b-8a24-91371d24bffd admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:01.026368 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc639c4-b9fa-4b7b-8a24-91371d24bffd admin admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:01.027711 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc639c4-b9fa-4b7b-8a24-91371d24bffd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:01.029299 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc639c4-b9fa-4b7b-8a24-91371d24bffd admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:01.067636 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 992/1960] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:54:00 2022] POST /identity/v3/users => generated 296 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:54:01.074779 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39412c7-a0f1-450c-9897-f871f66c7033 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:01.102817 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39412c7-a0f1-450c-9897-f871f66c7033 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:01.112996 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d328853-1b9d-448c-b75c-42218ec8955e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:01.114264 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d328853-1b9d-448c-b75c-42218ec8955e admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:01.114829 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d328853-1b9d-448c-b75c-42218ec8955e admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:01.115379 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d328853-1b9d-448c-b75c-42218ec8955e admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:01.116707 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d328853-1b9d-448c-b75c-42218ec8955e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:01.120433 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d328853-1b9d-448c-b75c-42218ec8955e admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:01.142001 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 969/1961] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:54:01.147589 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc639c4-b9fa-4b7b-8a24-91371d24bffd admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:01.170419 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc639c4-b9fa-4b7b-8a24-91371d24bffd admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:01.179735 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bec2aa-5fd4-4c54-8150-abdbebfcf658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:01.181150 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bec2aa-5fd4-4c54-8150-abdbebfcf658 admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:01.181780 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bec2aa-5fd4-4c54-8150-abdbebfcf658 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:01.182345 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bec2aa-5fd4-4c54-8150-abdbebfcf658 admin admin] PATH_INFO: `/v3/projects/e21667e7692040128ee40bb7bbabc767/users/53d2697f170446ac9ade8af0b04a3242/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:01.207991 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bec2aa-5fd4-4c54-8150-abdbebfcf658 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e21667e7692040128ee40bb7bbabc767, user_id=53d2697f170446ac9ade8af0b04a3242, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:01.213566 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bec2aa-5fd4-4c54-8150-abdbebfcf658 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:01.240940 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 993/1962] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:54:01 2022] PUT /identity/v3/projects/e21667e7692040128ee40bb7bbabc767/users/53d2697f170446ac9ade8af0b04a3242/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:54:01.247046 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d328853-1b9d-448c-b75c-42218ec8955e admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:01.257105 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:01.277519 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d328853-1b9d-448c-b75c-42218ec8955e admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:01.434087 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757231e9-4cf8-49e3-9ff8-f5aede7caf62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:01.434883 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757231e9-4cf8-49e3-9ff8-f5aede7caf62 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:01.435240 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757231e9-4cf8-49e3-9ff8-f5aede7caf62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:01.435704 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757231e9-4cf8-49e3-9ff8-f5aede7caf62 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:01.436580 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757231e9-4cf8-49e3-9ff8-f5aede7caf62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:01.438674 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757231e9-4cf8-49e3-9ff8-f5aede7caf62 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:01.453952 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 970/1963] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:54:01.460100 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bec2aa-5fd4-4c54-8150-abdbebfcf658 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:01.489337 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bec2aa-5fd4-4c54-8150-abdbebfcf658 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:01.499662 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39de5f-7032-41b0-bcf8-20a70440de68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:01.500872 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39de5f-7032-41b0-bcf8-20a70440de68 admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:01.501420 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39de5f-7032-41b0-bcf8-20a70440de68 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:01.501946 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39de5f-7032-41b0-bcf8-20a70440de68 admin admin] PATH_INFO: `/v3/projects/e21667e7692040128ee40bb7bbabc767/users/53d2697f170446ac9ade8af0b04a3242/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:01.506428 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f39de5f-7032-41b0-bcf8-20a70440de68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e21667e7692040128ee40bb7bbabc767, user_id=53d2697f170446ac9ade8af0b04a3242, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:01.512593 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f39de5f-7032-41b0-bcf8-20a70440de68 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:01.549248 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 994/1964] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:54:01 2022] PUT /identity/v3/projects/e21667e7692040128ee40bb7bbabc767/users/53d2697f170446ac9ade8af0b04a3242/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:54:01.551855 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33aa4c2-0f09-4520-8d18-a75abd77abb2 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:01.552120 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33aa4c2-0f09-4520-8d18-a75abd77abb2 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:01.552445 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33aa4c2-0f09-4520-8d18-a75abd77abb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:01.603943 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-a33aa4c2-0f09-4520-8d18-a75abd77abb2 None None] MFA Rules not processed for user `53d2697f170446ac9ade8af0b04a3242`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:01.607426 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-a33aa4c2-0f09-4520-8d18-a75abd77abb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:01.787600 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 971/1965] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:54:01 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:54:01.805790 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39de5f-7032-41b0-bcf8-20a70440de68 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:01.917828 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39de5f-7032-41b0-bcf8-20a70440de68 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:01.926205 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3ed47-259e-429b-8682-919984f6e0c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:01.927440 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3ed47-259e-429b-8682-919984f6e0c0 service cinder] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:01.927940 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3ed47-259e-429b-8682-919984f6e0c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:01.928369 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3ed47-259e-429b-8682-919984f6e0c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:01.943900 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3ed47-259e-429b-8682-919984f6e0c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:01.948091 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3ed47-259e-429b-8682-919984f6e0c0 service cinder] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:01.979136 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 995/1966] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:54:01 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:54:02.038572 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33aa4c2-0f09-4520-8d18-a75abd77abb2 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:02.058031 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33aa4c2-0f09-4520-8d18-a75abd77abb2 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:02.073944 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83e671-c6fd-452e-8768-a7f42db16d40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:02.075151 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83e671-c6fd-452e-8768-a7f42db16d40 service cinder] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:02.075740 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83e671-c6fd-452e-8768-a7f42db16d40 service cinder] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:02.076394 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83e671-c6fd-452e-8768-a7f42db16d40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:02.211631 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b83e671-c6fd-452e-8768-a7f42db16d40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:02.215261 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b83e671-c6fd-452e-8768-a7f42db16d40 service cinder] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:02.235073 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 972/1967] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:54:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:54:05.630278 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3ed47-259e-429b-8682-919984f6e0c0 service cinder] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:05.831585 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3ed47-259e-429b-8682-919984f6e0c0 service cinder] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:05.841051 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d783e-4cbd-49de-a1ad-c37c74b94d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:05.842321 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d783e-4cbd-49de-a1ad-c37c74b94d68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:05.842774 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d783e-4cbd-49de-a1ad-c37c74b94d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:05.843243 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d783e-4cbd-49de-a1ad-c37c74b94d68 admin admin] PATH_INFO: `/v3/users/cac09ed2bb724321a76843ed2cebbef2` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:05.845911 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d783e-4cbd-49de-a1ad-c37c74b94d68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cac09ed2bb724321a76843ed2cebbef2)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:05.850833 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d783e-4cbd-49de-a1ad-c37c74b94d68 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:05.884732 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:05.963226 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-a36d783e-4cbd-49de-a1ad-c37c74b94d68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cac09ed2bb724321a76843ed2cebbef2'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:05.964365 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-a36d783e-4cbd-49de-a1ad-c37c74b94d68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cac09ed2bb724321a76843ed2cebbef2'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:05.965591 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-a36d783e-4cbd-49de-a1ad-c37c74b94d68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cac09ed2bb724321a76843ed2cebbef2'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:05.988629 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-a36d783e-4cbd-49de-a1ad-c37c74b94d68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cac09ed2bb724321a76843ed2cebbef2'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:06.027304 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-a36d783e-4cbd-49de-a1ad-c37c74b94d68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cac09ed2bb724321a76843ed2cebbef2'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:06.060375 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 996/1968] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:54:05 2022] DELETE /identity/v3/users/cac09ed2bb724321a76843ed2cebbef2 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:54:06.068384 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826cbdf-8bd6-45ff-a0ce-280e25bdc35a None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:06.072313 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826cbdf-8bd6-45ff-a0ce-280e25bdc35a None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:06.073407 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826cbdf-8bd6-45ff-a0ce-280e25bdc35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:06.159178 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-7826cbdf-8bd6-45ff-a0ce-280e25bdc35a None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:06.167106 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-7826cbdf-8bd6-45ff-a0ce-280e25bdc35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:06.243614 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:06.387046 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 973/1969] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:54:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:54:06.412880 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d783e-4cbd-49de-a1ad-c37c74b94d68 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:06.415173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-a36d783e-4cbd-49de-a1ad-c37c74b94d68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:06.470258 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826cbdf-8bd6-45ff-a0ce-280e25bdc35a None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:06.473619 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-7826cbdf-8bd6-45ff-a0ce-280e25bdc35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:06.503945 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826cbdf-8bd6-45ff-a0ce-280e25bdc35a None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:06.515857 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886fc033-1d42-4d9d-a564-2a9c4b44b9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:06.517316 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886fc033-1d42-4d9d-a564-2a9c4b44b9d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:06.518531 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886fc033-1d42-4d9d-a564-2a9c4b44b9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:06.519110 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886fc033-1d42-4d9d-a564-2a9c4b44b9d2 admin admin] PATH_INFO: `/v3/users/863ab789f224477b9a4b4170e6db547e` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:06.521734 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886fc033-1d42-4d9d-a564-2a9c4b44b9d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=863ab789f224477b9a4b4170e6db547e)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:06.526482 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886fc033-1d42-4d9d-a564-2a9c4b44b9d2 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:06.644739 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d783e-4cbd-49de-a1ad-c37c74b94d68 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:06.652632 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6479d67-4829-4601-87ce-7a45c63d5e19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:06.653801 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6479d67-4829-4601-87ce-7a45c63d5e19 service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:06.654380 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6479d67-4829-4601-87ce-7a45c63d5e19 service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:06.655326 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6479d67-4829-4601-87ce-7a45c63d5e19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:06.674601 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-886fc033-1d42-4d9d-a564-2a9c4b44b9d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '863ab789f224477b9a4b4170e6db547e'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:06.678288 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-886fc033-1d42-4d9d-a564-2a9c4b44b9d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '863ab789f224477b9a4b4170e6db547e'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:06.694214 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6479d67-4829-4601-87ce-7a45c63d5e19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:06.702093 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6479d67-4829-4601-87ce-7a45c63d5e19 service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:06.716232 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-886fc033-1d42-4d9d-a564-2a9c4b44b9d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '863ab789f224477b9a4b4170e6db547e'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:06.750305 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 997/1970] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:54:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:54:06.784625 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-886fc033-1d42-4d9d-a564-2a9c4b44b9d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '863ab789f224477b9a4b4170e6db547e'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:06.787259 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-886fc033-1d42-4d9d-a564-2a9c4b44b9d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '863ab789f224477b9a4b4170e6db547e'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:06.825583 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 974/1971] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:54:06 2022] DELETE /identity/v3/users/863ab789f224477b9a4b4170e6db547e => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:54:06.831394 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa15556-b8f3-4d65-b7db-f471220ba788 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:06.832982 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa15556-b8f3-4d65-b7db-f471220ba788 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:06.833730 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa15556-b8f3-4d65-b7db-f471220ba788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:06.887035 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-5aa15556-b8f3-4d65-b7db-f471220ba788 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:06.894748 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-5aa15556-b8f3-4d65-b7db-f471220ba788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:07.104631 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 998/1972] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:54:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:54:07.201143 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886fc033-1d42-4d9d-a564-2a9c4b44b9d2 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:07.203198 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-886fc033-1d42-4d9d-a564-2a9c4b44b9d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:07.401626 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886fc033-1d42-4d9d-a564-2a9c4b44b9d2 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:07.407970 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595d8a8-20f6-4497-b73c-adfd6cb62bb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:07.409150 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595d8a8-20f6-4497-b73c-adfd6cb62bb8 service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:07.409789 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595d8a8-20f6-4497-b73c-adfd6cb62bb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:07.412436 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595d8a8-20f6-4497-b73c-adfd6cb62bb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:07.435163 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1595d8a8-20f6-4497-b73c-adfd6cb62bb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:07.438340 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1595d8a8-20f6-4497-b73c-adfd6cb62bb8 service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:07.459953 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 975/1973] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:54:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:54:08.443703 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa15556-b8f3-4d65-b7db-f471220ba788 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:08.448054 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-5aa15556-b8f3-4d65-b7db-f471220ba788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:08.497186 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa15556-b8f3-4d65-b7db-f471220ba788 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:08.541703 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ce1e1-d43a-4a8b-989e-ed2121445b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:08.544735 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ce1e1-d43a-4a8b-989e-ed2121445b34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:08.545281 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ce1e1-d43a-4a8b-989e-ed2121445b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:08.548583 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ce1e1-d43a-4a8b-989e-ed2121445b34 admin admin] PATH_INFO: `/v3/projects/991413f1353144f9be198205a3b06cc5` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:08.574834 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9ce1e1-d43a-4a8b-989e-ed2121445b34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=991413f1353144f9be198205a3b06cc5)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:08.579083 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9ce1e1-d43a-4a8b-989e-ed2121445b34 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:08.766070 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:08.840676 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-ed9ce1e1-d43a-4a8b-989e-ed2121445b34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '991413f1353144f9be198205a3b06cc5', 'request_id': 'req-ed9ce1e1-d43a-4a8b-989e-ed2121445b34'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:08.862753 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-ed9ce1e1-d43a-4a8b-989e-ed2121445b34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '991413f1353144f9be198205a3b06cc5', 'request_id': 'req-ed9ce1e1-d43a-4a8b-989e-ed2121445b34'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:08.894429 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-ed9ce1e1-d43a-4a8b-989e-ed2121445b34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '991413f1353144f9be198205a3b06cc5', 'request_id': 'req-ed9ce1e1-d43a-4a8b-989e-ed2121445b34'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:08.960911 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-ed9ce1e1-d43a-4a8b-989e-ed2121445b34 admin admin] The token cache is being invalidate because project 991413f1353144f9be198205a3b06cc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:54:08.962122 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-ed9ce1e1-d43a-4a8b-989e-ed2121445b34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:08.966397 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-ed9ce1e1-d43a-4a8b-989e-ed2121445b34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:08.979128 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 999/1974] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:54:08 2022] DELETE /identity/v3/projects/991413f1353144f9be198205a3b06cc5 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:54:08.986330 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30f751-15cd-4c03-9910-12a940edcdbc None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:08.987334 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30f751-15cd-4c03-9910-12a940edcdbc None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:08.987651 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30f751-15cd-4c03-9910-12a940edcdbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:09.091114 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-af30f751-15cd-4c03-9910-12a940edcdbc None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:09.093980 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-af30f751-15cd-4c03-9910-12a940edcdbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:09.238788 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:09.402023 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 976/1975] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:54:09.414631 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3880266-d1ca-411b-a70f-b474f098451a None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:09.416747 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3880266-d1ca-411b-a70f-b474f098451a None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:09.424310 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af30f751-15cd-4c03-9910-12a940edcdbc None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:09.427608 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-af30f751-15cd-4c03-9910-12a940edcdbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:09.429973 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3880266-d1ca-411b-a70f-b474f098451a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:09.482916 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af30f751-15cd-4c03-9910-12a940edcdbc None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:09.519047 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d6aa1-0068-4b6e-b9d6-b08abc304ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:09.520547 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d6aa1-0068-4b6e-b9d6-b08abc304ada admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:09.521278 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d6aa1-0068-4b6e-b9d6-b08abc304ada admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:09.525878 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d6aa1-0068-4b6e-b9d6-b08abc304ada admin admin] PATH_INFO: `/v3/projects/de5785b7d83f4c7898040cb7edb75f1f` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:09.530040 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359d6aa1-0068-4b6e-b9d6-b08abc304ada admin admin] RBAC: Authorizing `identity:delete_project(project_id=de5785b7d83f4c7898040cb7edb75f1f)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:09.534388 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359d6aa1-0068-4b6e-b9d6-b08abc304ada admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:09.591570 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-c3880266-d1ca-411b-a70f-b474f098451a None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:09.599629 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-c3880266-d1ca-411b-a70f-b474f098451a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:09.639545 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1000/1976] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:54:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:54:09.653562 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3880266-d1ca-411b-a70f-b474f098451a None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:09.698066 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3880266-d1ca-411b-a70f-b474f098451a None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:09.741499 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-359d6aa1-0068-4b6e-b9d6-b08abc304ada admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de5785b7d83f4c7898040cb7edb75f1f', 'request_id': 'req-359d6aa1-0068-4b6e-b9d6-b08abc304ada'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:09.789837 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-359d6aa1-0068-4b6e-b9d6-b08abc304ada admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de5785b7d83f4c7898040cb7edb75f1f', 'request_id': 'req-359d6aa1-0068-4b6e-b9d6-b08abc304ada'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:09.810961 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-359d6aa1-0068-4b6e-b9d6-b08abc304ada admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de5785b7d83f4c7898040cb7edb75f1f', 'request_id': 'req-359d6aa1-0068-4b6e-b9d6-b08abc304ada'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:09.865390 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-359d6aa1-0068-4b6e-b9d6-b08abc304ada admin admin] The token cache is being invalidate because project de5785b7d83f4c7898040cb7edb75f1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:54:09.866050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-359d6aa1-0068-4b6e-b9d6-b08abc304ada admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:09.867010 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-359d6aa1-0068-4b6e-b9d6-b08abc304ada admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:09.869601 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 977/1977] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:54:09 2022] DELETE /identity/v3/projects/de5785b7d83f4c7898040cb7edb75f1f => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:54:09.876649 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d6aa1-0068-4b6e-b9d6-b08abc304ada admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:09.879328 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-359d6aa1-0068-4b6e-b9d6-b08abc304ada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:09.932471 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11cf7a-ee6f-4156-95a0-c0fa0138bf76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:09.933251 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11cf7a-ee6f-4156-95a0-c0fa0138bf76 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:09.933433 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11cf7a-ee6f-4156-95a0-c0fa0138bf76 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:09.933707 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11cf7a-ee6f-4156-95a0-c0fa0138bf76 admin admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:09.934715 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa11cf7a-ee6f-4156-95a0-c0fa0138bf76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:54:09.936843 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa11cf7a-ee6f-4156-95a0-c0fa0138bf76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:09.941804 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa11cf7a-ee6f-4156-95a0-c0fa0138bf76 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:09.973454 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1001/1978] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 13:54:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:54:09.981614 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11cf7a-ee6f-4156-95a0-c0fa0138bf76 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:09.987963 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-fa11cf7a-ee6f-4156-95a0-c0fa0138bf76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:10.025980 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11cf7a-ee6f-4156-95a0-c0fa0138bf76 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:10.033852 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d6aa1-0068-4b6e-b9d6-b08abc304ada admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:10.044812 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46828735-fc17-498d-abbd-e25acd970ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:10.045031 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f29a8-d3e3-4aac-a1ef-6ab139d67a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:10.045938 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46828735-fc17-498d-abbd-e25acd970ee0 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:10.046321 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f29a8-d3e3-4aac-a1ef-6ab139d67a69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:10.046439 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46828735-fc17-498d-abbd-e25acd970ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:10.046883 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46828735-fc17-498d-abbd-e25acd970ee0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:10.048061 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46828735-fc17-498d-abbd-e25acd970ee0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:10.048417 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f29a8-d3e3-4aac-a1ef-6ab139d67a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:10.049868 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f29a8-d3e3-4aac-a1ef-6ab139d67a69 admin admin] PATH_INFO: `/v3/users/1ca54b8c1dd74b45b33298aa26985ae1` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:10.054367 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f29a8-d3e3-4aac-a1ef-6ab139d67a69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ca54b8c1dd74b45b33298aa26985ae1)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:10.066989 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46828735-fc17-498d-abbd-e25acd970ee0 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:10.068284 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f29a8-d3e3-4aac-a1ef-6ab139d67a69 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:10.133417 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1002/1979] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:54:09 2022] POST /identity/v3/projects => generated 371 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:54:10.135352 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46828735-fc17-498d-abbd-e25acd970ee0 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:10.243394 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-b79f29a8-d3e3-4aac-a1ef-6ab139d67a69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ca54b8c1dd74b45b33298aa26985ae1'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:10.243866 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-b79f29a8-d3e3-4aac-a1ef-6ab139d67a69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ca54b8c1dd74b45b33298aa26985ae1'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:10.301014 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-b79f29a8-d3e3-4aac-a1ef-6ab139d67a69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ca54b8c1dd74b45b33298aa26985ae1'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:10.315776 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:10.335080 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-b79f29a8-d3e3-4aac-a1ef-6ab139d67a69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ca54b8c1dd74b45b33298aa26985ae1'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:10.336917 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-b79f29a8-d3e3-4aac-a1ef-6ab139d67a69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ca54b8c1dd74b45b33298aa26985ae1'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:10.387729 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 978/1980] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:54:09 2022] DELETE /identity/v3/users/1ca54b8c1dd74b45b33298aa26985ae1 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:54:10.406391 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46828735-fc17-498d-abbd-e25acd970ee0 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:10.516471 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:10.635727 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6147c9db-a485-459c-8820-c1ef1e20d0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:10.637599 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147c9db-a485-459c-8820-c1ef1e20d0db admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:10.638158 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147c9db-a485-459c-8820-c1ef1e20d0db admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:10.638666 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147c9db-a485-459c-8820-c1ef1e20d0db admin admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:10.640296 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6147c9db-a485-459c-8820-c1ef1e20d0db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:10.648699 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6147c9db-a485-459c-8820-c1ef1e20d0db admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:10.737682 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1003/1981] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:54:10 2022] POST /identity/v3/users => generated 286 bytes in 603 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:54:10.744467 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f29a8-d3e3-4aac-a1ef-6ab139d67a69 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:10.747596 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-b79f29a8-d3e3-4aac-a1ef-6ab139d67a69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:10.806461 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f29a8-d3e3-4aac-a1ef-6ab139d67a69 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:10.829616 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b39065-9dd4-4309-aaac-34b37c4fcd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:10.831176 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b39065-9dd4-4309-aaac-34b37c4fcd0c admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:10.832302 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b39065-9dd4-4309-aaac-34b37c4fcd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:10.832302 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b39065-9dd4-4309-aaac-34b37c4fcd0c admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:10.833315 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b39065-9dd4-4309-aaac-34b37c4fcd0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:10.843782 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b39065-9dd4-4309-aaac-34b37c4fcd0c admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:10.904117 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6147c9db-a485-459c-8820-c1ef1e20d0db admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:10.917007 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 979/1982] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:54:10.939069 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6147c9db-a485-459c-8820-c1ef1e20d0db admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:10.950572 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21215dbd-4908-4d42-8926-395c5ed73e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:10.952015 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21215dbd-4908-4d42-8926-395c5ed73e5f admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:10.952513 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21215dbd-4908-4d42-8926-395c5ed73e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:10.953202 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21215dbd-4908-4d42-8926-395c5ed73e5f admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:10.954709 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21215dbd-4908-4d42-8926-395c5ed73e5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:10.957938 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21215dbd-4908-4d42-8926-395c5ed73e5f admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:10.986843 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1004/1983] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:54:10.989999 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b39065-9dd4-4309-aaac-34b37c4fcd0c admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:11.031121 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b39065-9dd4-4309-aaac-34b37c4fcd0c admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:11.055151 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26043daa-ad13-45c5-aaca-0cad4efabefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:11.056473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26043daa-ad13-45c5-aaca-0cad4efabefc admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:11.056855 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26043daa-ad13-45c5-aaca-0cad4efabefc admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:11.057352 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26043daa-ad13-45c5-aaca-0cad4efabefc admin admin] PATH_INFO: `/v3/projects/8c80ebc5a903476187d7ea96692b4114/users/35100c17d51c4290be295901e142073c/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:11.145320 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26043daa-ad13-45c5-aaca-0cad4efabefc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c80ebc5a903476187d7ea96692b4114, user_id=35100c17d51c4290be295901e142073c, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:11.158418 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26043daa-ad13-45c5-aaca-0cad4efabefc admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:11.213797 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 980/1984] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:54:10 2022] PUT /identity/v3/projects/8c80ebc5a903476187d7ea96692b4114/users/35100c17d51c4290be295901e142073c/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:54:11.241609 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538a460-a2cf-4abc-9285-0424acce804d None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:11.254649 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538a460-a2cf-4abc-9285-0424acce804d None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:11.263815 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538a460-a2cf-4abc-9285-0424acce804d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:11.407581 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-0538a460-a2cf-4abc-9285-0424acce804d None None] MFA Rules not processed for user `35100c17d51c4290be295901e142073c`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:11.411249 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-0538a460-a2cf-4abc-9285-0424acce804d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:11.699287 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1005/1985] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:54:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:54:11.728455 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26043daa-ad13-45c5-aaca-0cad4efabefc admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:11.733088 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-26043daa-ad13-45c5-aaca-0cad4efabefc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:11.869324 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538a460-a2cf-4abc-9285-0424acce804d None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:11.873282 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-0538a460-a2cf-4abc-9285-0424acce804d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:12.082881 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26043daa-ad13-45c5-aaca-0cad4efabefc admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:12.097690 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee691fc-3d6b-423d-a7c7-81abaf169225 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:12.100616 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee691fc-3d6b-423d-a7c7-81abaf169225 service cinder] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:12.103043 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee691fc-3d6b-423d-a7c7-81abaf169225 service cinder] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:12.103814 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee691fc-3d6b-423d-a7c7-81abaf169225 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:12.131278 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee691fc-3d6b-423d-a7c7-81abaf169225 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:12.133693 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee691fc-3d6b-423d-a7c7-81abaf169225 service cinder] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:12.136232 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538a460-a2cf-4abc-9285-0424acce804d None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:12.156395 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d0782d-4056-4e91-830f-cdcca6b39e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:12.162154 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0782d-4056-4e91-830f-cdcca6b39e13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:12.162671 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0782d-4056-4e91-830f-cdcca6b39e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:12.163183 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0782d-4056-4e91-830f-cdcca6b39e13 admin admin] PATH_INFO: `/v3/projects/9a0a02eb5601402bb5f40ebe7d4bf6ec` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:12.166460 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d0782d-4056-4e91-830f-cdcca6b39e13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a0a02eb5601402bb5f40ebe7d4bf6ec)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:12.177334 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 981/1986] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:54:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:54:12.180753 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d0782d-4056-4e91-830f-cdcca6b39e13 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:12.248841 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee691fc-3d6b-423d-a7c7-81abaf169225 service cinder] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:12.278391 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee691fc-3d6b-423d-a7c7-81abaf169225 service cinder] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:12.301031 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f47f30-a206-4027-ad66-9f709cddafa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:12.301761 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f47f30-a206-4027-ad66-9f709cddafa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:12.302246 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f47f30-a206-4027-ad66-9f709cddafa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:12.302536 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f47f30-a206-4027-ad66-9f709cddafa4 admin admin] PATH_INFO: `/v3/users/35100c17d51c4290be295901e142073c` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:12.306605 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f47f30-a206-4027-ad66-9f709cddafa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35100c17d51c4290be295901e142073c)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:12.314382 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f47f30-a206-4027-ad66-9f709cddafa4 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:12.397709 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:12.412620 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-f0d0782d-4056-4e91-830f-cdcca6b39e13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a0a02eb5601402bb5f40ebe7d4bf6ec', 'request_id': 'req-f0d0782d-4056-4e91-830f-cdcca6b39e13'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:12.446665 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-f0d0782d-4056-4e91-830f-cdcca6b39e13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a0a02eb5601402bb5f40ebe7d4bf6ec', 'request_id': 'req-f0d0782d-4056-4e91-830f-cdcca6b39e13'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:12.480883 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-f0d0782d-4056-4e91-830f-cdcca6b39e13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a0a02eb5601402bb5f40ebe7d4bf6ec', 'request_id': 'req-f0d0782d-4056-4e91-830f-cdcca6b39e13'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:12.490566 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-38f47f30-a206-4027-ad66-9f709cddafa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35100c17d51c4290be295901e142073c'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:12.492944 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-38f47f30-a206-4027-ad66-9f709cddafa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35100c17d51c4290be295901e142073c'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:12.552206 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-38f47f30-a206-4027-ad66-9f709cddafa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35100c17d51c4290be295901e142073c'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:12.556977 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-f0d0782d-4056-4e91-830f-cdcca6b39e13 admin admin] The token cache is being invalidate because project 9a0a02eb5601402bb5f40ebe7d4bf6ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:54:12.556977 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-f0d0782d-4056-4e91-830f-cdcca6b39e13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:12.567898 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-f0d0782d-4056-4e91-830f-cdcca6b39e13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:12.580469 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1006/1987] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:54:11 2022] DELETE /identity/v3/projects/9a0a02eb5601402bb5f40ebe7d4bf6ec => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:54:12.586588 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d0782d-4056-4e91-830f-cdcca6b39e13 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:12.591489 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-f0d0782d-4056-4e91-830f-cdcca6b39e13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:12.628416 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-38f47f30-a206-4027-ad66-9f709cddafa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35100c17d51c4290be295901e142073c'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:12.633653 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-38f47f30-a206-4027-ad66-9f709cddafa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35100c17d51c4290be295901e142073c'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:12.716341 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 982/1988] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:54:12 2022] DELETE /identity/v3/users/35100c17d51c4290be295901e142073c => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:54:12.719102 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da26e5-a1b6-4ed1-8b98-d30cb144bf6a None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:12.723651 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da26e5-a1b6-4ed1-8b98-d30cb144bf6a None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:12.727284 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da26e5-a1b6-4ed1-8b98-d30cb144bf6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:12.833141 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-03da26e5-a1b6-4ed1-8b98-d30cb144bf6a None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:12.835459 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-03da26e5-a1b6-4ed1-8b98-d30cb144bf6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:12.913180 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:12.937453 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d0782d-4056-4e91-830f-cdcca6b39e13 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:13.112116 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 983/1989] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:54:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:54:13.141222 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da26e5-a1b6-4ed1-8b98-d30cb144bf6a None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:13.146446 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-03da26e5-a1b6-4ed1-8b98-d30cb144bf6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:13.154775 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9ab6a-54d8-488e-961b-eac4a50faf5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:13.155369 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9ab6a-54d8-488e-961b-eac4a50faf5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:13.155799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9ab6a-54d8-488e-961b-eac4a50faf5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:13.156151 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9ab6a-54d8-488e-961b-eac4a50faf5f admin admin] PATH_INFO: `/v3/users/53d2697f170446ac9ade8af0b04a3242` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:13.157795 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b9ab6a-54d8-488e-961b-eac4a50faf5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=53d2697f170446ac9ade8af0b04a3242)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:13.161703 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b9ab6a-54d8-488e-961b-eac4a50faf5f admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:13.296218 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-a4b9ab6a-54d8-488e-961b-eac4a50faf5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53d2697f170446ac9ade8af0b04a3242'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:13.297763 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-a4b9ab6a-54d8-488e-961b-eac4a50faf5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53d2697f170446ac9ade8af0b04a3242'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:13.299001 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-a4b9ab6a-54d8-488e-961b-eac4a50faf5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53d2697f170446ac9ade8af0b04a3242'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:13.328580 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-a4b9ab6a-54d8-488e-961b-eac4a50faf5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53d2697f170446ac9ade8af0b04a3242'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:13.354118 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da26e5-a1b6-4ed1-8b98-d30cb144bf6a None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:13.373552 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e77c4-08d7-468d-9253-d9b28e6f4233 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:13.374218 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e77c4-08d7-468d-9253-d9b28e6f4233 service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:13.374504 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e77c4-08d7-468d-9253-d9b28e6f4233 service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:13.374779 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e77c4-08d7-468d-9253-d9b28e6f4233 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:13.384863 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-f50e77c4-08d7-468d-9253-d9b28e6f4233 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:13.386824 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-a4b9ab6a-54d8-488e-961b-eac4a50faf5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53d2697f170446ac9ade8af0b04a3242'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:13.404706 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50e77c4-08d7-468d-9253-d9b28e6f4233 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:13.406422 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50e77c4-08d7-468d-9253-d9b28e6f4233 service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:13.420839 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 984/1990] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:54:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:54:13.434158 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:13.449460 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1007/1991] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:54:12 2022] DELETE /identity/v3/users/53d2697f170446ac9ade8af0b04a3242 => generated 0 bytes in 868 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:54:14.329148 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e77c4-08d7-468d-9253-d9b28e6f4233 service neutron] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:14.332766 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-f50e77c4-08d7-468d-9253-d9b28e6f4233 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:14.353112 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e77c4-08d7-468d-9253-d9b28e6f4233 service neutron] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:14.520444 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70235815-ebe0-44a9-89da-8a970d694890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:14.522113 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70235815-ebe0-44a9-89da-8a970d694890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:14.523016 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70235815-ebe0-44a9-89da-8a970d694890 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:14.523892 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70235815-ebe0-44a9-89da-8a970d694890 admin admin] PATH_INFO: `/v3/projects/e21667e7692040128ee40bb7bbabc767` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:14.526861 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70235815-ebe0-44a9-89da-8a970d694890 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e21667e7692040128ee40bb7bbabc767)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:14.531286 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70235815-ebe0-44a9-89da-8a970d694890 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:14.677329 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-70235815-ebe0-44a9-89da-8a970d694890 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e21667e7692040128ee40bb7bbabc767', 'request_id': 'req-70235815-ebe0-44a9-89da-8a970d694890'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:14.692759 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-70235815-ebe0-44a9-89da-8a970d694890 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e21667e7692040128ee40bb7bbabc767', 'request_id': 'req-70235815-ebe0-44a9-89da-8a970d694890'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:14.707409 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-70235815-ebe0-44a9-89da-8a970d694890 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e21667e7692040128ee40bb7bbabc767', 'request_id': 'req-70235815-ebe0-44a9-89da-8a970d694890'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:14.716918 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:14.763068 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-70235815-ebe0-44a9-89da-8a970d694890 admin admin] The token cache is being invalidate because project e21667e7692040128ee40bb7bbabc767 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:54:14.763543 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-70235815-ebe0-44a9-89da-8a970d694890 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:14.764960 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-70235815-ebe0-44a9-89da-8a970d694890 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:14.770686 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 985/1992] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:54:14 2022] DELETE /identity/v3/projects/e21667e7692040128ee40bb7bbabc767 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:54:14.780250 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345944b-34d7-47a3-9e2e-e6edd3673c93 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:14.782243 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345944b-34d7-47a3-9e2e-e6edd3673c93 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:14.783159 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345944b-34d7-47a3-9e2e-e6edd3673c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:14.836964 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-b345944b-34d7-47a3-9e2e-e6edd3673c93 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:14.843197 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-b345944b-34d7-47a3-9e2e-e6edd3673c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:14.919659 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70235815-ebe0-44a9-89da-8a970d694890 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:14.927130 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-70235815-ebe0-44a9-89da-8a970d694890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:15.005842 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1008/1993] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:54:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:54:15.021631 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9924274-ae7e-4725-adef-17c323fd71de None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:15.023188 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9924274-ae7e-4725-adef-17c323fd71de None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:15.025231 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9924274-ae7e-4725-adef-17c323fd71de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:15.124388 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-b9924274-ae7e-4725-adef-17c323fd71de None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:15.129499 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-b9924274-ae7e-4725-adef-17c323fd71de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:15.171068 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1009/1994] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:54:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:54:15.178164 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9924274-ae7e-4725-adef-17c323fd71de None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:15.180987 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70235815-ebe0-44a9-89da-8a970d694890 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:15.198438 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f069c-1b3e-4340-a98c-8b7b668838d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:15.198982 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9924274-ae7e-4725-adef-17c323fd71de None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:15.199672 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f069c-1b3e-4340-a98c-8b7b668838d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:15.200447 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f069c-1b3e-4340-a98c-8b7b668838d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:15.202073 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f069c-1b3e-4340-a98c-8b7b668838d8 admin admin] PATH_INFO: `/v3/projects/8c80ebc5a903476187d7ea96692b4114` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:15.208112 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f069c-1b3e-4340-a98c-8b7b668838d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c80ebc5a903476187d7ea96692b4114)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:15.213348 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d90ad-ac72-4309-99ac-5bb44a9cfd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:15.214601 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d90ad-ac72-4309-99ac-5bb44a9cfd4d admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:15.215776 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f069c-1b3e-4340-a98c-8b7b668838d8 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:15.215923 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d90ad-ac72-4309-99ac-5bb44a9cfd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:15.218136 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d90ad-ac72-4309-99ac-5bb44a9cfd4d admin admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:15.225345 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27d90ad-ac72-4309-99ac-5bb44a9cfd4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:54:15.227038 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27d90ad-ac72-4309-99ac-5bb44a9cfd4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:15.231250 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27d90ad-ac72-4309-99ac-5bb44a9cfd4d admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:15.265433 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1010/1995] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 13:54:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:54:15.272943 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d90ad-ac72-4309-99ac-5bb44a9cfd4d admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:15.321766 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d90ad-ac72-4309-99ac-5bb44a9cfd4d admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:15.335503 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504aa909-dafc-44e7-afc8-278ac40683fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:15.338022 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504aa909-dafc-44e7-afc8-278ac40683fb admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:15.338582 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504aa909-dafc-44e7-afc8-278ac40683fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:15.339132 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504aa909-dafc-44e7-afc8-278ac40683fb admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:15.340546 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504aa909-dafc-44e7-afc8-278ac40683fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:15.345173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504aa909-dafc-44e7-afc8-278ac40683fb admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:15.445552 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1011/1996] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:54:15 2022] POST /identity/v3/projects => generated 385 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:54:15.469574 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504aa909-dafc-44e7-afc8-278ac40683fb admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:15.473023 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-ab5f069c-1b3e-4340-a98c-8b7b668838d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c80ebc5a903476187d7ea96692b4114', 'request_id': 'req-ab5f069c-1b3e-4340-a98c-8b7b668838d8'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:15.500186 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-ab5f069c-1b3e-4340-a98c-8b7b668838d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c80ebc5a903476187d7ea96692b4114', 'request_id': 'req-ab5f069c-1b3e-4340-a98c-8b7b668838d8'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:15.515683 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-ab5f069c-1b3e-4340-a98c-8b7b668838d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c80ebc5a903476187d7ea96692b4114', 'request_id': 'req-ab5f069c-1b3e-4340-a98c-8b7b668838d8'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:15.556210 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-ab5f069c-1b3e-4340-a98c-8b7b668838d8 admin admin] The token cache is being invalidate because project 8c80ebc5a903476187d7ea96692b4114 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:54:15.556683 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-ab5f069c-1b3e-4340-a98c-8b7b668838d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:15.557983 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-ab5f069c-1b3e-4340-a98c-8b7b668838d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:15.563330 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 986/1997] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:54:14 2022] DELETE /identity/v3/projects/8c80ebc5a903476187d7ea96692b4114 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:54:15.573756 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6ab20-a19a-41c9-b94a-52558e2c89b0 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:15.574266 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6ab20-a19a-41c9-b94a-52558e2c89b0 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:15.574855 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6ab20-a19a-41c9-b94a-52558e2c89b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:15.619776 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-8ca6ab20-a19a-41c9-b94a-52558e2c89b0 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:15.621987 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-8ca6ab20-a19a-41c9-b94a-52558e2c89b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:15.668267 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504aa909-dafc-44e7-afc8-278ac40683fb admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:15.696008 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351181f7-2264-4491-ba03-daf3ba5e3336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:15.697579 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351181f7-2264-4491-ba03-daf3ba5e3336 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:15.698199 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351181f7-2264-4491-ba03-daf3ba5e3336 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:15.698767 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351181f7-2264-4491-ba03-daf3ba5e3336 admin admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:15.700095 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351181f7-2264-4491-ba03-daf3ba5e3336 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:15.708969 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351181f7-2264-4491-ba03-daf3ba5e3336 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:15.785325 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1012/1998] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:54:15 2022] POST /identity/v3/users => generated 293 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:54:15.790460 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351181f7-2264-4491-ba03-daf3ba5e3336 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:15.797571 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-351181f7-2264-4491-ba03-daf3ba5e3336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:15.809915 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 987/1999] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:54:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:54:15.819951 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82889a0-a2f9-4fc6-a822-68d04e5b5053 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:15.820447 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82889a0-a2f9-4fc6-a822-68d04e5b5053 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:15.820940 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82889a0-a2f9-4fc6-a822-68d04e5b5053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:15.826832 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351181f7-2264-4491-ba03-daf3ba5e3336 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:15.838907 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09af4ce-582d-4045-8faa-dab717cbf55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:15.840564 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09af4ce-582d-4045-8faa-dab717cbf55d admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:15.842004 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09af4ce-582d-4045-8faa-dab717cbf55d admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:15.842820 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09af4ce-582d-4045-8faa-dab717cbf55d admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:15.844253 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09af4ce-582d-4045-8faa-dab717cbf55d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:15.849692 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09af4ce-582d-4045-8faa-dab717cbf55d admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:15.880967 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1013/2000] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:54:15.888161 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09af4ce-582d-4045-8faa-dab717cbf55d admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:15.922439 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09af4ce-582d-4045-8faa-dab717cbf55d admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:15.926197 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-a82889a0-a2f9-4fc6-a822-68d04e5b5053 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:15.931031 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-a82889a0-a2f9-4fc6-a822-68d04e5b5053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:15.942068 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89698d-6204-4aaf-8946-e0e469aeff75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:15.947950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89698d-6204-4aaf-8946-e0e469aeff75 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:15.948246 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89698d-6204-4aaf-8946-e0e469aeff75 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:15.948533 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89698d-6204-4aaf-8946-e0e469aeff75 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:15.952638 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c89698d-6204-4aaf-8946-e0e469aeff75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:15.957497 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c89698d-6204-4aaf-8946-e0e469aeff75 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:15.967222 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 988/2001] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:54:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:54:15.973708 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82889a0-a2f9-4fc6-a822-68d04e5b5053 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:15.990502 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1014/2002] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:54:15.992115 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89698d-6204-4aaf-8946-e0e469aeff75 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:16.007370 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82889a0-a2f9-4fc6-a822-68d04e5b5053 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:16.009193 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89698d-6204-4aaf-8946-e0e469aeff75 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:16.015593 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f138d-3378-421f-b38d-6f3228d83248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:16.016393 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f138d-3378-421f-b38d-6f3228d83248 admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:16.016943 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f138d-3378-421f-b38d-6f3228d83248 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:16.017314 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f138d-3378-421f-b38d-6f3228d83248 admin admin] PATH_INFO: `/v3/projects/2700c7daf3654c1cb7a33e78429acba7/users/62513f478eb84f469b97219b8cc38b23/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:16.020676 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06f88f-4e92-462f-8ec1-45280f8cdbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:16.021752 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06f88f-4e92-462f-8ec1-45280f8cdbe5 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:16.022220 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06f88f-4e92-462f-8ec1-45280f8cdbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:16.022676 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06f88f-4e92-462f-8ec1-45280f8cdbe5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:16.024992 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b06f88f-4e92-462f-8ec1-45280f8cdbe5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:54:16.025542 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b06f88f-4e92-462f-8ec1-45280f8cdbe5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:16.028778 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b06f88f-4e92-462f-8ec1-45280f8cdbe5 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:16.052677 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3f138d-3378-421f-b38d-6f3228d83248 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2700c7daf3654c1cb7a33e78429acba7, user_id=62513f478eb84f469b97219b8cc38b23, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:16.057587 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3f138d-3378-421f-b38d-6f3228d83248 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:16.077523 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:16.096016 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 989/2003] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 13:54:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:54:16.100752 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06f88f-4e92-462f-8ec1-45280f8cdbe5 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:16.118257 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1015/2004] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:54:15 2022] PUT /identity/v3/projects/2700c7daf3654c1cb7a33e78429acba7/users/62513f478eb84f469b97219b8cc38b23/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:54:16.121751 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:16.128388 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9110bb-d1bd-49e8-80ab-3792b4209b64 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:16.128851 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9110bb-d1bd-49e8-80ab-3792b4209b64 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:16.129216 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9110bb-d1bd-49e8-80ab-3792b4209b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:16.140306 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06f88f-4e92-462f-8ec1-45280f8cdbe5 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:16.214951 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-1d9110bb-d1bd-49e8-80ab-3792b4209b64 None None] MFA Rules not processed for user `62513f478eb84f469b97219b8cc38b23`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:16.217272 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-1d9110bb-d1bd-49e8-80ab-3792b4209b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:16.423379 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841f8a5-53bb-4f07-96eb-0f87584180e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:16.428511 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841f8a5-53bb-4f07-96eb-0f87584180e9 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:16.430010 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841f8a5-53bb-4f07-96eb-0f87584180e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:16.432219 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841f8a5-53bb-4f07-96eb-0f87584180e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:16.433641 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c841f8a5-53bb-4f07-96eb-0f87584180e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:16.439256 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c841f8a5-53bb-4f07-96eb-0f87584180e9 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:16.458030 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1016/2005] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:54:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:54:16.460090 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9110bb-d1bd-49e8-80ab-3792b4209b64 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:16.485225 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9110bb-d1bd-49e8-80ab-3792b4209b64 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:16.496122 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd13d4b-46ee-425c-b659-7cd7e2e7e986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:16.497490 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd13d4b-46ee-425c-b659-7cd7e2e7e986 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:16.498078 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd13d4b-46ee-425c-b659-7cd7e2e7e986 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:16.498964 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd13d4b-46ee-425c-b659-7cd7e2e7e986 admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:16.500470 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd13d4b-46ee-425c-b659-7cd7e2e7e986 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:16.506361 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd13d4b-46ee-425c-b659-7cd7e2e7e986 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:16.535728 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 990/2006] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:54:16 2022] POST /identity/v3/projects => generated 383 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:54:16.542838 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841f8a5-53bb-4f07-96eb-0f87584180e9 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:16.605863 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1017/2007] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:54:16 2022] POST /identity/v3/projects => generated 383 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:54:16.612969 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd13d4b-46ee-425c-b659-7cd7e2e7e986 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:16.752384 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841f8a5-53bb-4f07-96eb-0f87584180e9 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:16.862980 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd13d4b-46ee-425c-b659-7cd7e2e7e986 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:16.875751 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d96ec-cd84-4824-be7c-42e5a0daab4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:16.879139 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d96ec-cd84-4824-be7c-42e5a0daab4f admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:16.880043 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d96ec-cd84-4824-be7c-42e5a0daab4f admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:16.880323 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d96ec-cd84-4824-be7c-42e5a0daab4f admin admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:16.881071 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d96ec-cd84-4824-be7c-42e5a0daab4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:16.883872 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d96ec-cd84-4824-be7c-42e5a0daab4f admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:16.949081 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1018/2008] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:54:16 2022] POST /identity/v3/users => generated 298 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:54:16.950675 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d96ec-cd84-4824-be7c-42e5a0daab4f admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:16.953072 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b6a23-b6d8-42d5-a045-149d00630334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:16.953798 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b6a23-b6d8-42d5-a045-149d00630334 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:16.954106 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b6a23-b6d8-42d5-a045-149d00630334 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:16.954359 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b6a23-b6d8-42d5-a045-149d00630334 admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:16.955702 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b6a23-b6d8-42d5-a045-149d00630334 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:16.963733 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07b6a23-b6d8-42d5-a045-149d00630334 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:16.974113 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d96ec-cd84-4824-be7c-42e5a0daab4f admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:16.991982 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27781b50-9456-4168-8f76-2ca7ea1d0650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:16.993494 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27781b50-9456-4168-8f76-2ca7ea1d0650 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:16.993494 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27781b50-9456-4168-8f76-2ca7ea1d0650 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:16.993803 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27781b50-9456-4168-8f76-2ca7ea1d0650 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:16.994533 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27781b50-9456-4168-8f76-2ca7ea1d0650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:16.996896 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27781b50-9456-4168-8f76-2ca7ea1d0650 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:17.031898 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1019/2009] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:54:17.041354 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27781b50-9456-4168-8f76-2ca7ea1d0650 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:17.059009 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 991/2010] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:54:16 2022] POST /identity/v3/users => generated 292 bytes in 519 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:54:17.060835 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b6a23-b6d8-42d5-a045-149d00630334 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:17.066448 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27781b50-9456-4168-8f76-2ca7ea1d0650 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:17.075874 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f2928-3bb1-46a1-8901-64e9d1efb686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:17.077237 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f2928-3bb1-46a1-8901-64e9d1efb686 admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:17.077858 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f2928-3bb1-46a1-8901-64e9d1efb686 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:17.078236 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f2928-3bb1-46a1-8901-64e9d1efb686 admin admin] PATH_INFO: `/v3/projects/48f2ada135f542f693b2fc61384ec2fe/users/ffcfe4b7247041cf8449f397618010e7/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:17.092510 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b6a23-b6d8-42d5-a045-149d00630334 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:17.118079 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5fef22-8df6-4923-b46a-a30d0d038986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:17.121128 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fef22-8df6-4923-b46a-a30d0d038986 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:17.121904 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fef22-8df6-4923-b46a-a30d0d038986 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:17.122581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fef22-8df6-4923-b46a-a30d0d038986 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:17.124002 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5fef22-8df6-4923-b46a-a30d0d038986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:17.124470 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f2928-3bb1-46a1-8901-64e9d1efb686 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48f2ada135f542f693b2fc61384ec2fe, user_id=ffcfe4b7247041cf8449f397618010e7, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:17.133095 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f2928-3bb1-46a1-8901-64e9d1efb686 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:17.136421 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5fef22-8df6-4923-b46a-a30d0d038986 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:17.168171 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1020/2011] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:54:17 2022] PUT /identity/v3/projects/48f2ada135f542f693b2fc61384ec2fe/users/ffcfe4b7247041cf8449f397618010e7/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:54:17.169802 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f2928-3bb1-46a1-8901-64e9d1efb686 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:17.175545 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-883f2928-3bb1-46a1-8901-64e9d1efb686 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:17.196617 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 992/2012] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:54:17.196617 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5fef22-8df6-4923-b46a-a30d0d038986 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:17.234050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5fef22-8df6-4923-b46a-a30d0d038986 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:17.264653 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:17.268400 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:17.357138 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f2928-3bb1-46a1-8901-64e9d1efb686 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:17.371801 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab8077-8956-4147-8dbd-12a96bbbb41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:17.372936 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab8077-8956-4147-8dbd-12a96bbbb41b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:17.374081 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab8077-8956-4147-8dbd-12a96bbbb41b admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:17.374081 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab8077-8956-4147-8dbd-12a96bbbb41b admin admin] PATH_INFO: `/v3/users/edeb5d6700094c70a69c79c9d442b10c` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:17.376377 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab8077-8956-4147-8dbd-12a96bbbb41b admin admin] RBAC: Authorizing `identity:delete_user(user_id=edeb5d6700094c70a69c79c9d442b10c)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:17.381193 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab8077-8956-4147-8dbd-12a96bbbb41b admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:17.392018 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc9047-530e-445c-93f4-340df06d6a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:17.393808 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc9047-530e-445c-93f4-340df06d6a4d admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:17.394601 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc9047-530e-445c-93f4-340df06d6a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:17.395111 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc9047-530e-445c-93f4-340df06d6a4d admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:17.396660 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc9047-530e-445c-93f4-340df06d6a4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:17.400122 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc9047-530e-445c-93f4-340df06d6a4d admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:17.425004 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 993/2013] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:54:17.427326 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc9047-530e-445c-93f4-340df06d6a4d admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:17.466432 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc9047-530e-445c-93f4-340df06d6a4d admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:17.480194 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783edb94-db67-4048-9233-4ce1d3f9918d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:17.481765 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783edb94-db67-4048-9233-4ce1d3f9918d admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:17.482208 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783edb94-db67-4048-9233-4ce1d3f9918d admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:17.482668 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783edb94-db67-4048-9233-4ce1d3f9918d admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:17.483849 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783edb94-db67-4048-9233-4ce1d3f9918d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:17.486957 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783edb94-db67-4048-9233-4ce1d3f9918d admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:17.506204 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-c3ab8077-8956-4147-8dbd-12a96bbbb41b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edeb5d6700094c70a69c79c9d442b10c'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:17.507442 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 994/2014] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:54:17.508160 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-c3ab8077-8956-4147-8dbd-12a96bbbb41b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edeb5d6700094c70a69c79c9d442b10c'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:17.508366 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783edb94-db67-4048-9233-4ce1d3f9918d admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:17.509155 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-c3ab8077-8956-4147-8dbd-12a96bbbb41b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edeb5d6700094c70a69c79c9d442b10c'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:17.518425 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-783edb94-db67-4048-9233-4ce1d3f9918d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:17.540705 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783edb94-db67-4048-9233-4ce1d3f9918d admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:17.545097 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-c3ab8077-8956-4147-8dbd-12a96bbbb41b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edeb5d6700094c70a69c79c9d442b10c'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:17.556635 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a0f67-2315-4d2d-8d90-2fe200342f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:17.558600 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a0f67-2315-4d2d-8d90-2fe200342f7b admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:17.559840 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a0f67-2315-4d2d-8d90-2fe200342f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:17.561085 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a0f67-2315-4d2d-8d90-2fe200342f7b admin admin] PATH_INFO: `/v3/projects/48f2ada135f542f693b2fc61384ec2fe/users/ffcfe4b7247041cf8449f397618010e7/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:17.568486 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a0f67-2315-4d2d-8d90-2fe200342f7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=48f2ada135f542f693b2fc61384ec2fe, user_id=ffcfe4b7247041cf8449f397618010e7, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:17.582735 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a0f67-2315-4d2d-8d90-2fe200342f7b admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:17.595558 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-c3ab8077-8956-4147-8dbd-12a96bbbb41b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edeb5d6700094c70a69c79c9d442b10c'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:17.605859 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 995/2015] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:54:17 2022] PUT /identity/v3/projects/48f2ada135f542f693b2fc61384ec2fe/users/ffcfe4b7247041cf8449f397618010e7/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:54:17.607424 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a0f67-2315-4d2d-8d90-2fe200342f7b admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:17.610210 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-814a0f67-2315-4d2d-8d90-2fe200342f7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:17.654566 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1021/2016] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:54:17 2022] DELETE /identity/v3/users/edeb5d6700094c70a69c79c9d442b10c => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:54:17.656664 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2263f-0443-478e-be33-19687af8783b None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:17.656881 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2263f-0443-478e-be33-19687af8783b None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:17.657060 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2263f-0443-478e-be33-19687af8783b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:17.702733 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-f0b2263f-0443-478e-be33-19687af8783b None None] MFA Rules not processed for user `ffcfe4b7247041cf8449f397618010e7`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:17.704932 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-f0b2263f-0443-478e-be33-19687af8783b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:17.761712 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a0f67-2315-4d2d-8d90-2fe200342f7b admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:17.856028 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1022/2017] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:54:17 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:54:17.856028 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec575da-1230-4466-8df6-2bc9750105b9 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:17.856338 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec575da-1230-4466-8df6-2bc9750105b9 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:17.856573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec575da-1230-4466-8df6-2bc9750105b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:17.871584 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d8505-50e6-47e3-a016-baf52bafd54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:17.872334 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d8505-50e6-47e3-a016-baf52bafd54e admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:17.872685 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d8505-50e6-47e3-a016-baf52bafd54e admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:17.872910 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d8505-50e6-47e3-a016-baf52bafd54e admin admin] PATH_INFO: `/v3/projects/cc8a5f7d4d3346afada6c8e4e5c88a43/users/cfe716e6e4fe4b82bcecd0e701e8a012/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:17.891760 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-3ec575da-1230-4466-8df6-2bc9750105b9 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:17.893107 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-3ec575da-1230-4466-8df6-2bc9750105b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:17.895829 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d8505-50e6-47e3-a016-baf52bafd54e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc8a5f7d4d3346afada6c8e4e5c88a43, user_id=cfe716e6e4fe4b82bcecd0e701e8a012, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:17.898663 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d8505-50e6-47e3-a016-baf52bafd54e admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:17.906661 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1023/2018] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:54:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:54:17.909774 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec575da-1230-4466-8df6-2bc9750105b9 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:17.914103 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-3ec575da-1230-4466-8df6-2bc9750105b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:17.927514 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 996/2019] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:54:17 2022] PUT /identity/v3/projects/cc8a5f7d4d3346afada6c8e4e5c88a43/users/cfe716e6e4fe4b82bcecd0e701e8a012/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:54:17.929144 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d8505-50e6-47e3-a016-baf52bafd54e admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:17.934361 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-196d8505-50e6-47e3-a016-baf52bafd54e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:17.959610 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:17.971957 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:18.042921 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec575da-1230-4466-8df6-2bc9750105b9 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:18.074777 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d8505-50e6-47e3-a016-baf52bafd54e admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:18.085926 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279fa164-28cf-4587-bbe1-47b9b5f0cee1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:18.086522 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279fa164-28cf-4587-bbe1-47b9b5f0cee1 service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:18.086786 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279fa164-28cf-4587-bbe1-47b9b5f0cee1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:18.087054 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279fa164-28cf-4587-bbe1-47b9b5f0cee1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:18.147967 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09325dcc-7158-4462-bb29-8845f44c832d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:18.148984 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09325dcc-7158-4462-bb29-8845f44c832d service cinder] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:18.149592 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09325dcc-7158-4462-bb29-8845f44c832d service cinder] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:18.150150 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09325dcc-7158-4462-bb29-8845f44c832d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:18.160268 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-09325dcc-7158-4462-bb29-8845f44c832d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:18.322551 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279fa164-28cf-4587-bbe1-47b9b5f0cee1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:18.324328 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279fa164-28cf-4587-bbe1-47b9b5f0cee1 service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:18.375160 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09325dcc-7158-4462-bb29-8845f44c832d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:18.380980 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 997/2020] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:54:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:54:18.387393 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bc30d-5c62-4b5f-85fd-0267b3e34164 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:18.391244 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09325dcc-7158-4462-bb29-8845f44c832d service cinder] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:18.398219 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bc30d-5c62-4b5f-85fd-0267b3e34164 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:18.398765 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bc30d-5c62-4b5f-85fd-0267b3e34164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:18.434652 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1024/2021] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:54:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:54:18.468318 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-f45bc30d-5c62-4b5f-85fd-0267b3e34164 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:18.469828 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-f45bc30d-5c62-4b5f-85fd-0267b3e34164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:18.494032 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 998/2022] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:54:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:54:18.498033 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09325dcc-7158-4462-bb29-8845f44c832d service cinder] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:18.501187 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-09325dcc-7158-4462-bb29-8845f44c832d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:18.533925 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09325dcc-7158-4462-bb29-8845f44c832d service cinder] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:18.543117 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d28459e-f350-4486-9b3e-3f4c9ec0068c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:18.544319 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28459e-f350-4486-9b3e-3f4c9ec0068c service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:18.545007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28459e-f350-4486-9b3e-3f4c9ec0068c service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:18.545530 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28459e-f350-4486-9b3e-3f4c9ec0068c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:18.564302 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d28459e-f350-4486-9b3e-3f4c9ec0068c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:18.568433 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d28459e-f350-4486-9b3e-3f4c9ec0068c service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:18.622695 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1025/2023] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:54:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:54:20.130425 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45bc30d-5c62-4b5f-85fd-0267b3e34164 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:20.138679 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-f45bc30d-5c62-4b5f-85fd-0267b3e34164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:20.176313 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45bc30d-5c62-4b5f-85fd-0267b3e34164 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:20.204537 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6711f7aa-62e8-4e8c-ac7e-52c36b18da8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:20.206140 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711f7aa-62e8-4e8c-ac7e-52c36b18da8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:20.208384 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711f7aa-62e8-4e8c-ac7e-52c36b18da8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:20.209194 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6711f7aa-62e8-4e8c-ac7e-52c36b18da8f admin admin] PATH_INFO: `/v3/projects/17ed7d5e06614f6c8a7a35dd498f282b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:20.216775 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6711f7aa-62e8-4e8c-ac7e-52c36b18da8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=17ed7d5e06614f6c8a7a35dd498f282b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:20.227822 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6711f7aa-62e8-4e8c-ac7e-52c36b18da8f admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:20.456119 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-6711f7aa-62e8-4e8c-ac7e-52c36b18da8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17ed7d5e06614f6c8a7a35dd498f282b', 'request_id': 'req-6711f7aa-62e8-4e8c-ac7e-52c36b18da8f'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:20.486601 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-6711f7aa-62e8-4e8c-ac7e-52c36b18da8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17ed7d5e06614f6c8a7a35dd498f282b', 'request_id': 'req-6711f7aa-62e8-4e8c-ac7e-52c36b18da8f'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:20.508892 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-6711f7aa-62e8-4e8c-ac7e-52c36b18da8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17ed7d5e06614f6c8a7a35dd498f282b', 'request_id': 'req-6711f7aa-62e8-4e8c-ac7e-52c36b18da8f'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:20.541074 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b112da-3c6b-45f8-9da0-02839fbb8fe2 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:20.541968 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b112da-3c6b-45f8-9da0-02839fbb8fe2 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:20.542326 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b112da-3c6b-45f8-9da0-02839fbb8fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:20.591397 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-6711f7aa-62e8-4e8c-ac7e-52c36b18da8f admin admin] The token cache is being invalidate because project 17ed7d5e06614f6c8a7a35dd498f282b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:54:20.592302 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-6711f7aa-62e8-4e8c-ac7e-52c36b18da8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:20.594529 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-6711f7aa-62e8-4e8c-ac7e-52c36b18da8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:20.599305 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 999/2024] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:54:20 2022] DELETE /identity/v3/projects/17ed7d5e06614f6c8a7a35dd498f282b => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:54:20.606239 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b016aa-5f43-4e03-a2ca-d24b1cdb2c5b None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:20.606810 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b016aa-5f43-4e03-a2ca-d24b1cdb2c5b None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:20.607537 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b016aa-5f43-4e03-a2ca-d24b1cdb2c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:20.667196 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-19b112da-3c6b-45f8-9da0-02839fbb8fe2 None None] MFA Rules not processed for user `cfe716e6e4fe4b82bcecd0e701e8a012`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:20.673087 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-19b112da-3c6b-45f8-9da0-02839fbb8fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:20.678323 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-23b016aa-5f43-4e03-a2ca-d24b1cdb2c5b None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:20.680245 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-23b016aa-5f43-4e03-a2ca-d24b1cdb2c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:20.802506 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:20.865577 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1000/2025] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:54:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:54:20.880346 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72983566-f52c-4459-8a87-74878c431a2c None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:20.880695 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72983566-f52c-4459-8a87-74878c431a2c None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:20.880910 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72983566-f52c-4459-8a87-74878c431a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:20.896205 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1026/2026] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:54:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:54:20.958665 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-72983566-f52c-4459-8a87-74878c431a2c None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:20.974690 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-72983566-f52c-4459-8a87-74878c431a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:21.012158 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1001/2027] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:54:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:54:21.022554 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b112da-3c6b-45f8-9da0-02839fbb8fe2 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:21.023917 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72983566-f52c-4459-8a87-74878c431a2c None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:21.025279 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-19b112da-3c6b-45f8-9da0-02839fbb8fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:21.051414 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72983566-f52c-4459-8a87-74878c431a2c None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:21.063452 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c93fb4-2076-4446-afb4-ddb506a72488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:21.065017 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c93fb4-2076-4446-afb4-ddb506a72488 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:21.065631 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c93fb4-2076-4446-afb4-ddb506a72488 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:21.066184 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c93fb4-2076-4446-afb4-ddb506a72488 admin admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:21.067441 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c93fb4-2076-4446-afb4-ddb506a72488 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:54:21.068087 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c93fb4-2076-4446-afb4-ddb506a72488 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:21.072202 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c93fb4-2076-4446-afb4-ddb506a72488 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:21.101123 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:21.111841 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1002/2028] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 13:54:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:54:21.117633 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c93fb4-2076-4446-afb4-ddb506a72488 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:21.151755 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c93fb4-2076-4446-afb4-ddb506a72488 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:21.168496 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9302d587-ce6c-4160-a0dc-97d89a98cd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:21.170514 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9302d587-ce6c-4160-a0dc-97d89a98cd38 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:21.171200 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9302d587-ce6c-4160-a0dc-97d89a98cd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:21.176385 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9302d587-ce6c-4160-a0dc-97d89a98cd38 admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:21.178315 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9302d587-ce6c-4160-a0dc-97d89a98cd38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:21.184106 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9302d587-ce6c-4160-a0dc-97d89a98cd38 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:21.268896 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1003/2029] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:54:21 2022] POST /identity/v3/projects => generated 385 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:54:21.275611 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9302d587-ce6c-4160-a0dc-97d89a98cd38 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:21.318241 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b112da-3c6b-45f8-9da0-02839fbb8fe2 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:21.466590 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9302d587-ce6c-4160-a0dc-97d89a98cd38 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:21.472279 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f3c13-c807-40da-8aba-8b292a784f81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:21.472913 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f3c13-c807-40da-8aba-8b292a784f81 service cinder] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:21.473191 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f3c13-c807-40da-8aba-8b292a784f81 service cinder] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:21.474134 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f3c13-c807-40da-8aba-8b292a784f81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:21.477770 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215dae8d-ac13-4951-8fb4-e7deeafacf32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:21.479458 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215dae8d-ac13-4951-8fb4-e7deeafacf32 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:21.480585 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215dae8d-ac13-4951-8fb4-e7deeafacf32 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:21.481804 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215dae8d-ac13-4951-8fb4-e7deeafacf32 admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:21.483986 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215dae8d-ac13-4951-8fb4-e7deeafacf32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:21.491673 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215dae8d-ac13-4951-8fb4-e7deeafacf32 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:21.577445 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1004/2030] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:54:21 2022] POST /identity/v3/users => generated 293 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:54:21.580619 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7d00a-a135-4d66-b12f-f6734ca5c9cc None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:21.581178 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f3c13-c807-40da-8aba-8b292a784f81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:21.581665 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7d00a-a135-4d66-b12f-f6734ca5c9cc None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:21.582176 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7d00a-a135-4d66-b12f-f6734ca5c9cc None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:21.584581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1005/2031] 10.222.0.69 () {54 vars in 921 bytes} [Thu Sep 8 13:54:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:54:21.585075 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f3c13-c807-40da-8aba-8b292a784f81 service cinder] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:21.586299 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7d00a-a135-4d66-b12f-f6734ca5c9cc None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:21.631076 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7d00a-a135-4d66-b12f-f6734ca5c9cc None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:21.631257 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1027/2032] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:54:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 609 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:54:21.641863 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f3c13-c807-40da-8aba-8b292a784f81 service cinder] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:21.646933 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a720f9-48db-4bfc-afc2-9059be019974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:21.651245 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a720f9-48db-4bfc-afc2-9059be019974 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:21.651851 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-884f3c13-c807-40da-8aba-8b292a784f81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:21.652154 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a720f9-48db-4bfc-afc2-9059be019974 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:21.653024 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a720f9-48db-4bfc-afc2-9059be019974 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:21.656533 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a720f9-48db-4bfc-afc2-9059be019974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:21.662139 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a720f9-48db-4bfc-afc2-9059be019974 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:21.687634 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1006/2033] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:54:21 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:54:21.690095 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc051ca8-5b29-4ed3-9590-8a65520c40c1 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:21.690840 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc051ca8-5b29-4ed3-9590-8a65520c40c1 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:21.691737 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc051ca8-5b29-4ed3-9590-8a65520c40c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:21.708237 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f3c13-c807-40da-8aba-8b292a784f81 service cinder] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:21.724512 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73870df3-c587-4d6d-9dd9-cced1750de57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:21.726268 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73870df3-c587-4d6d-9dd9-cced1750de57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:21.726925 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73870df3-c587-4d6d-9dd9-cced1750de57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:21.727691 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73870df3-c587-4d6d-9dd9-cced1750de57 admin admin] PATH_INFO: `/v3/users/8395ea674036465b8a5c62622b4faf92` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:21.731321 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73870df3-c587-4d6d-9dd9-cced1750de57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8395ea674036465b8a5c62622b4faf92)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:21.737173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73870df3-c587-4d6d-9dd9-cced1750de57 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:21.796433 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-cc051ca8-5b29-4ed3-9590-8a65520c40c1 None None] MFA Rules not processed for user `733797f12a1741e1a55332991e867aab`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:21.799703 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-cc051ca8-5b29-4ed3-9590-8a65520c40c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:21.886975 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-73870df3-c587-4d6d-9dd9-cced1750de57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8395ea674036465b8a5c62622b4faf92'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:21.887861 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-73870df3-c587-4d6d-9dd9-cced1750de57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8395ea674036465b8a5c62622b4faf92'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:21.889440 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-73870df3-c587-4d6d-9dd9-cced1750de57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8395ea674036465b8a5c62622b4faf92'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:21.906423 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-73870df3-c587-4d6d-9dd9-cced1750de57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8395ea674036465b8a5c62622b4faf92'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:21.931823 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:21.934710 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-73870df3-c587-4d6d-9dd9-cced1750de57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8395ea674036465b8a5c62622b4faf92'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:21.952829 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1007/2034] 10.222.0.69 () {58 vars in 1018 bytes} [Thu Sep 8 13:54:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:54:21.955882 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc051ca8-5b29-4ed3-9590-8a65520c40c1 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:21.958568 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-cc051ca8-5b29-4ed3-9590-8a65520c40c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:21.960804 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1028/2035] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:54:21 2022] DELETE /identity/v3/users/8395ea674036465b8a5c62622b4faf92 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:54:21.983126 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73870df3-c587-4d6d-9dd9-cced1750de57 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:21.985701 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc051ca8-5b29-4ed3-9590-8a65520c40c1 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:21.985958 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-73870df3-c587-4d6d-9dd9-cced1750de57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:22.015000 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:22.120768 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249e793-d23c-4a38-9d64-14f68d6e0eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:22.121943 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249e793-d23c-4a38-9d64-14f68d6e0eef admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:22.122971 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249e793-d23c-4a38-9d64-14f68d6e0eef admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:22.123575 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249e793-d23c-4a38-9d64-14f68d6e0eef admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:22.125143 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7249e793-d23c-4a38-9d64-14f68d6e0eef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:22.129457 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7249e793-d23c-4a38-9d64-14f68d6e0eef admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:22.157557 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1008/2036] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:54:21 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:54:22.160987 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249e793-d23c-4a38-9d64-14f68d6e0eef admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:22.178754 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73870df3-c587-4d6d-9dd9-cced1750de57 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:22.190127 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249e793-d23c-4a38-9d64-14f68d6e0eef admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:22.193468 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37bfd2b-f182-4c5a-9d43-6590cf5a1efa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733797f12a1741e1a55332991e867aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:22.194702 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bfd2b-f182-4c5a-9d43-6590cf5a1efa service placement] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:22.195288 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bfd2b-f182-4c5a-9d43-6590cf5a1efa service placement] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:22.195762 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37bfd2b-f182-4c5a-9d43-6590cf5a1efa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:22.198568 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1f1efb-5dda-4d15-8683-c0d24fe49d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:22.199725 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f1efb-5dda-4d15-8683-c0d24fe49d77 admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:22.200220 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f1efb-5dda-4d15-8683-c0d24fe49d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:22.200708 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f1efb-5dda-4d15-8683-c0d24fe49d77 admin admin] PATH_INFO: `/v3/projects/37cc1647d3db48afb5c1fdea0f15a630/users/5d4f11a98f39401183a1317c92d3d3af/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:22.225547 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37bfd2b-f182-4c5a-9d43-6590cf5a1efa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:22.230489 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37bfd2b-f182-4c5a-9d43-6590cf5a1efa service placement] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:22.262595 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1f1efb-5dda-4d15-8683-c0d24fe49d77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37cc1647d3db48afb5c1fdea0f15a630, user_id=5d4f11a98f39401183a1317c92d3d3af, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:22.265417 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1029/2037] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:54:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:54:22.282629 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1f1efb-5dda-4d15-8683-c0d24fe49d77 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:22.317938 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1009/2038] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:54:22 2022] PUT /identity/v3/projects/37cc1647d3db48afb5c1fdea0f15a630/users/5d4f11a98f39401183a1317c92d3d3af/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:54:22.321041 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491fe10-015c-442c-a315-02c640892486 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:22.321687 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491fe10-015c-442c-a315-02c640892486 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:22.322334 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491fe10-015c-442c-a315-02c640892486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:22.381786 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-2491fe10-015c-442c-a315-02c640892486 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:22.384256 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-2491fe10-015c-442c-a315-02c640892486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:22.415286 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1f1efb-5dda-4d15-8683-c0d24fe49d77 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:22.418272 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-db1f1efb-5dda-4d15-8683-c0d24fe49d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:22.525734 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1030/2039] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:54:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:54:22.540579 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491fe10-015c-442c-a315-02c640892486 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:22.542967 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-2491fe10-015c-442c-a315-02c640892486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:22.554198 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1f1efb-5dda-4d15-8683-c0d24fe49d77 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:22.562672 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2f27c-ac3e-4806-8d54-389e46363264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:22.563487 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2f27c-ac3e-4806-8d54-389e46363264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:22.563899 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2f27c-ac3e-4806-8d54-389e46363264 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:22.565175 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2f27c-ac3e-4806-8d54-389e46363264 admin admin] PATH_INFO: `/v3/projects/065a5e32a243489a9e199b7c167b5acd` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:22.566685 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d2f27c-ac3e-4806-8d54-389e46363264 admin admin] RBAC: Authorizing `identity:delete_project(project_id=065a5e32a243489a9e199b7c167b5acd)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:22.569523 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d2f27c-ac3e-4806-8d54-389e46363264 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:22.640515 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491fe10-015c-442c-a315-02c640892486 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:22.657952 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-61d2f27c-ac3e-4806-8d54-389e46363264 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '065a5e32a243489a9e199b7c167b5acd', 'request_id': 'req-61d2f27c-ac3e-4806-8d54-389e46363264'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:22.671442 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-61d2f27c-ac3e-4806-8d54-389e46363264 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '065a5e32a243489a9e199b7c167b5acd', 'request_id': 'req-61d2f27c-ac3e-4806-8d54-389e46363264'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:22.683775 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-61d2f27c-ac3e-4806-8d54-389e46363264 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '065a5e32a243489a9e199b7c167b5acd', 'request_id': 'req-61d2f27c-ac3e-4806-8d54-389e46363264'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:22.711737 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-61d2f27c-ac3e-4806-8d54-389e46363264 admin admin] The token cache is being invalidate because project 065a5e32a243489a9e199b7c167b5acd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:54:22.712400 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-61d2f27c-ac3e-4806-8d54-389e46363264 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:22.713167 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:22.713975 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-61d2f27c-ac3e-4806-8d54-389e46363264 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:22.717727 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1010/2040] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:54:22 2022] DELETE /identity/v3/projects/065a5e32a243489a9e199b7c167b5acd => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:54:22.728982 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fcb0d-85fb-4440-bb5a-1a8ff445ce38 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:22.730150 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fcb0d-85fb-4440-bb5a-1a8ff445ce38 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:22.730862 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fcb0d-85fb-4440-bb5a-1a8ff445ce38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:22.746679 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d5786c-a31f-427f-b834-7478945fd536 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:22.747852 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d5786c-a31f-427f-b834-7478945fd536 service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:22.748650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d5786c-a31f-427f-b834-7478945fd536 service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:22.749229 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d5786c-a31f-427f-b834-7478945fd536 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:22.754400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-58d5786c-a31f-427f-b834-7478945fd536 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:22.772008 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-9c3fcb0d-85fb-4440-bb5a-1a8ff445ce38 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:22.776030 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-9c3fcb0d-85fb-4440-bb5a-1a8ff445ce38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:22.808323 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:22.904970 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d5786c-a31f-427f-b834-7478945fd536 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:22.908383 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d5786c-a31f-427f-b834-7478945fd536 service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:22.928489 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1011/2041] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:54:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:54:22.938600 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1031/2042] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:54:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:54:22.944133 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df108de-7e59-4f83-80b7-089f9c3eb75b None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:22.944638 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df108de-7e59-4f83-80b7-089f9c3eb75b None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:22.945137 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df108de-7e59-4f83-80b7-089f9c3eb75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:22.990132 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-3df108de-7e59-4f83-80b7-089f9c3eb75b None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:22.993060 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-3df108de-7e59-4f83-80b7-089f9c3eb75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:23.015249 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1012/2043] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:54:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:54:23.021840 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d5786c-a31f-427f-b834-7478945fd536 service neutron] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:23.042823 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d5786c-a31f-427f-b834-7478945fd536 service neutron] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:23.051691 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7fb5eb-ffa4-437f-987b-c13d8f1b22ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:23.052720 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7fb5eb-ffa4-437f-987b-c13d8f1b22ac admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:23.053307 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7fb5eb-ffa4-437f-987b-c13d8f1b22ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:23.053833 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7fb5eb-ffa4-437f-987b-c13d8f1b22ac admin admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:23.055033 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7fb5eb-ffa4-437f-987b-c13d8f1b22ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:54:23.055594 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7fb5eb-ffa4-437f-987b-c13d8f1b22ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:23.059535 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7fb5eb-ffa4-437f-987b-c13d8f1b22ac admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:23.092696 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1032/2044] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 13:54:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:54:23.094812 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df108de-7e59-4f83-80b7-089f9c3eb75b None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:23.117097 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df108de-7e59-4f83-80b7-089f9c3eb75b None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:23.130141 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca7a269-7c83-4b72-b8e3-029534c822c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:23.131528 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7a269-7c83-4b72-b8e3-029534c822c0 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:23.132307 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7a269-7c83-4b72-b8e3-029534c822c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:23.133070 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7a269-7c83-4b72-b8e3-029534c822c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:23.135067 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca7a269-7c83-4b72-b8e3-029534c822c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:23.139445 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca7a269-7c83-4b72-b8e3-029534c822c0 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:23.225201 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1013/2045] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:54:23 2022] POST /identity/v3/projects => generated 363 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:54:23.231924 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7fb5eb-ffa4-437f-987b-c13d8f1b22ac admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:23.261339 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7fb5eb-ffa4-437f-987b-c13d8f1b22ac admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:23.385836 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0a83c-e43c-4a6a-90b9-70ce50901d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:23.387360 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0a83c-e43c-4a6a-90b9-70ce50901d38 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:23.388131 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0a83c-e43c-4a6a-90b9-70ce50901d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:23.388544 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0a83c-e43c-4a6a-90b9-70ce50901d38 admin admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:23.390091 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f0a83c-e43c-4a6a-90b9-70ce50901d38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:23.393816 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f0a83c-e43c-4a6a-90b9-70ce50901d38 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:23.445316 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1033/2046] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:54:23 2022] POST /identity/v3/users => generated 282 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:54:23.448172 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca7a269-7c83-4b72-b8e3-029534c822c0 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:23.486281 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca7a269-7c83-4b72-b8e3-029534c822c0 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:23.498383 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f01dee-2e14-4a1c-9060-cee253fbc426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:23.499621 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f01dee-2e14-4a1c-9060-cee253fbc426 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:23.500451 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f01dee-2e14-4a1c-9060-cee253fbc426 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:23.501056 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f01dee-2e14-4a1c-9060-cee253fbc426 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:23.503354 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f01dee-2e14-4a1c-9060-cee253fbc426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:23.507011 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f01dee-2e14-4a1c-9060-cee253fbc426 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:23.521136 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1767605-28b6-42df-8937-c8df69a87954 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:23.522013 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1767605-28b6-42df-8937-c8df69a87954 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:23.522482 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1767605-28b6-42df-8937-c8df69a87954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:23.541037 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1014/2047] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 13:54:23.542842 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f01dee-2e14-4a1c-9060-cee253fbc426 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:23.580991 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f01dee-2e14-4a1c-9060-cee253fbc426 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:23.586820 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-d1767605-28b6-42df-8937-c8df69a87954 None None] MFA Rules not processed for user `cfe716e6e4fe4b82bcecd0e701e8a012`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:23.589539 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-d1767605-28b6-42df-8937-c8df69a87954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:23.592964 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d5f28-9b4d-43c8-9fab-f09610eedae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:23.594029 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d5f28-9b4d-43c8-9fab-f09610eedae2 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:23.594802 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d5f28-9b4d-43c8-9fab-f09610eedae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:23.595373 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d5f28-9b4d-43c8-9fab-f09610eedae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:23.596962 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d5f28-9b4d-43c8-9fab-f09610eedae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:23.600667 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d5f28-9b4d-43c8-9fab-f09610eedae2 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:23.622837 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1015/2048] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:54:23.637357 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d5f28-9b4d-43c8-9fab-f09610eedae2 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:23.674489 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d5f28-9b4d-43c8-9fab-f09610eedae2 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:23.696439 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4b71d-a3cb-4f44-8217-b3645e799974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:23.697574 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4b71d-a3cb-4f44-8217-b3645e799974 admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:23.698075 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4b71d-a3cb-4f44-8217-b3645e799974 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:23.698519 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4b71d-a3cb-4f44-8217-b3645e799974 admin admin] PATH_INFO: `/v3/projects/91d71e0858414093a2e065563453454d/users/c21b4601642c42528d0e4123e8c8bcc0/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:23.742676 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f4b71d-a3cb-4f44-8217-b3645e799974 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91d71e0858414093a2e065563453454d, user_id=c21b4601642c42528d0e4123e8c8bcc0, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:23.748234 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f4b71d-a3cb-4f44-8217-b3645e799974 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:23.815903 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1034/2049] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:54:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:54:23.837179 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1016/2050] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:54:23 2022] PUT /identity/v3/projects/91d71e0858414093a2e065563453454d/users/c21b4601642c42528d0e4123e8c8bcc0/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:54:23.841018 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80400a0-0b74-41f1-bf52-bd22574df6c4 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:23.841880 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80400a0-0b74-41f1-bf52-bd22574df6c4 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:23.843265 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80400a0-0b74-41f1-bf52-bd22574df6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:23.885858 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:23.924520 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-b80400a0-0b74-41f1-bf52-bd22574df6c4 None None] MFA Rules not processed for user `c21b4601642c42528d0e4123e8c8bcc0`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:23.927362 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-b80400a0-0b74-41f1-bf52-bd22574df6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:24.118870 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1035/2051] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:54:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:54:24.124357 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4b71d-a3cb-4f44-8217-b3645e799974 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:24.231316 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4b71d-a3cb-4f44-8217-b3645e799974 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:24.252720 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d67d29-2707-4697-8bf5-50b50d1953ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:24.254303 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d67d29-2707-4697-8bf5-50b50d1953ef admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:24.254623 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d67d29-2707-4697-8bf5-50b50d1953ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:24.254921 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d67d29-2707-4697-8bf5-50b50d1953ef admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:24.255706 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d67d29-2707-4697-8bf5-50b50d1953ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:24.259073 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d67d29-2707-4697-8bf5-50b50d1953ef admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:24.356156 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1017/2052] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:54:24 2022] POST /identity/v3/projects => generated 365 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:54:24.362083 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80400a0-0b74-41f1-bf52-bd22574df6c4 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:24.382656 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80400a0-0b74-41f1-bf52-bd22574df6c4 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:24.601642 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2fdc73-0c29-40f2-bd79-e4fd8a58023e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:24.603420 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fdc73-0c29-40f2-bd79-e4fd8a58023e admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:24.604446 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fdc73-0c29-40f2-bd79-e4fd8a58023e admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:24.605476 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fdc73-0c29-40f2-bd79-e4fd8a58023e admin admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:24.607343 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2fdc73-0c29-40f2-bd79-e4fd8a58023e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:24.611712 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2fdc73-0c29-40f2-bd79-e4fd8a58023e admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:24.679056 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1036/2053] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:54:24 2022] POST /identity/v3/users => generated 289 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:54:24.681259 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d67d29-2707-4697-8bf5-50b50d1953ef admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:24.706567 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d67d29-2707-4697-8bf5-50b50d1953ef admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:24.735560 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20643f-fc5f-489f-8d58-a1b22f7adb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:24.736863 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20643f-fc5f-489f-8d58-a1b22f7adb54 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:24.737553 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20643f-fc5f-489f-8d58-a1b22f7adb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:24.738765 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20643f-fc5f-489f-8d58-a1b22f7adb54 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:24.740187 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20643f-fc5f-489f-8d58-a1b22f7adb54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:24.745122 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20643f-fc5f-489f-8d58-a1b22f7adb54 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:24.782118 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1018/2054] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:54:24.787127 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2fdc73-0c29-40f2-bd79-e4fd8a58023e admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:24.822105 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2fdc73-0c29-40f2-bd79-e4fd8a58023e admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:24.844630 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb7674-c580-48c5-89d3-77cfd8d2a05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:24.845143 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb7674-c580-48c5-89d3-77cfd8d2a05c admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:24.851044 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb7674-c580-48c5-89d3-77cfd8d2a05c admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:24.851715 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb7674-c580-48c5-89d3-77cfd8d2a05c admin admin] PATH_INFO: `/v3/projects/0c00b3627a69475fb041d612d85c93c0/users/547fbde7f4034eacaaa5fec66dcc87e2/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:24.913083 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfb7674-c580-48c5-89d3-77cfd8d2a05c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c00b3627a69475fb041d612d85c93c0, user_id=547fbde7f4034eacaaa5fec66dcc87e2, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:24.919536 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfb7674-c580-48c5-89d3-77cfd8d2a05c admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:24.952589 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1037/2055] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:54:24 2022] PUT /identity/v3/projects/0c00b3627a69475fb041d612d85c93c0/users/547fbde7f4034eacaaa5fec66dcc87e2/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:54:24.958278 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20643f-fc5f-489f-8d58-a1b22f7adb54 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:24.991050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20643f-fc5f-489f-8d58-a1b22f7adb54 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:25.091220 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb7674-c580-48c5-89d3-77cfd8d2a05c admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:25.094186 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-fdfb7674-c580-48c5-89d3-77cfd8d2a05c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:25.103854 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:25.216848 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc69a5-f1cd-4547-b8a4-09a6cc096541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:25.218912 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc69a5-f1cd-4547-b8a4-09a6cc096541 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:25.219877 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc69a5-f1cd-4547-b8a4-09a6cc096541 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:25.221266 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc69a5-f1cd-4547-b8a4-09a6cc096541 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:25.223074 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fc69a5-f1cd-4547-b8a4-09a6cc096541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:25.226830 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fc69a5-f1cd-4547-b8a4-09a6cc096541 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:25.269074 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1019/2056] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:54:25.272574 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc69a5-f1cd-4547-b8a4-09a6cc096541 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:25.305889 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc69a5-f1cd-4547-b8a4-09a6cc096541 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:25.327468 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f820989-e1ec-4fd0-ba42-5fde7adda623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:25.328278 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f820989-e1ec-4fd0-ba42-5fde7adda623 admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:25.328767 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f820989-e1ec-4fd0-ba42-5fde7adda623 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:25.329265 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f820989-e1ec-4fd0-ba42-5fde7adda623 admin admin] PATH_INFO: `/v3/projects/0c00b3627a69475fb041d612d85c93c0/users/547fbde7f4034eacaaa5fec66dcc87e2/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:25.338681 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f820989-e1ec-4fd0-ba42-5fde7adda623 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c00b3627a69475fb041d612d85c93c0, user_id=547fbde7f4034eacaaa5fec66dcc87e2, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:25.352801 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f820989-e1ec-4fd0-ba42-5fde7adda623 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:25.386781 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1020/2057] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:54:25 2022] PUT /identity/v3/projects/0c00b3627a69475fb041d612d85c93c0/users/547fbde7f4034eacaaa5fec66dcc87e2/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:54:25.404487 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35bcdc-58ef-4c8a-8755-a9d4b3c3bf41 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:25.404841 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35bcdc-58ef-4c8a-8755-a9d4b3c3bf41 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:25.405021 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35bcdc-58ef-4c8a-8755-a9d4b3c3bf41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:25.537878 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb7674-c580-48c5-89d3-77cfd8d2a05c admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:25.552843 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-2f35bcdc-58ef-4c8a-8755-a9d4b3c3bf41 None None] MFA Rules not processed for user `547fbde7f4034eacaaa5fec66dcc87e2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:25.555119 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-2f35bcdc-58ef-4c8a-8755-a9d4b3c3bf41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:25.575702 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:25.715847 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2bf8d-a698-42de-9ff7-171b8e516e4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:25.719010 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2bf8d-a698-42de-9ff7-171b8e516e4f service cinder] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:25.719501 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2bf8d-a698-42de-9ff7-171b8e516e4f service cinder] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:25.721310 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2bf8d-a698-42de-9ff7-171b8e516e4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:25.729084 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-f6a2bf8d-a698-42de-9ff7-171b8e516e4f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:25.901033 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1021/2058] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:54:25 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 499 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:54:25.999983 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35bcdc-58ef-4c8a-8755-a9d4b3c3bf41 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:26.003651 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-2f35bcdc-58ef-4c8a-8755-a9d4b3c3bf41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:26.015072 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a2bf8d-a698-42de-9ff7-171b8e516e4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:26.018053 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a2bf8d-a698-42de-9ff7-171b8e516e4f service cinder] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:26.030617 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1038/2059] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:54:25 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 940 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:54:26.059834 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35bcdc-58ef-4c8a-8755-a9d4b3c3bf41 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:26.099470 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c3925-3bce-4777-aa5c-354c397ae319 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:26.100590 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c3925-3bce-4777-aa5c-354c397ae319 service cinder] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:26.101100 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c3925-3bce-4777-aa5c-354c397ae319 service cinder] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:26.115957 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c3925-3bce-4777-aa5c-354c397ae319 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:26.150334 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c3925-3bce-4777-aa5c-354c397ae319 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:26.154232 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614c3925-3bce-4777-aa5c-354c397ae319 service cinder] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:26.206204 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1022/2060] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:54:25 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:54:26.942407 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2bf8d-a698-42de-9ff7-171b8e516e4f service cinder] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:26.961595 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2bf8d-a698-42de-9ff7-171b8e516e4f service cinder] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:26.978493 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0899ec-dd44-40b0-8999-6b5bcd614140 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:26.981050 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0899ec-dd44-40b0-8999-6b5bcd614140 service cinder] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:26.981982 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0899ec-dd44-40b0-8999-6b5bcd614140 service cinder] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:26.982721 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0899ec-dd44-40b0-8999-6b5bcd614140 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:27.258439 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0899ec-dd44-40b0-8999-6b5bcd614140 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:27.272508 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0899ec-dd44-40b0-8999-6b5bcd614140 service cinder] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:27.350163 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1039/2061] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:54:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:54:29.333480 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c3925-3bce-4777-aa5c-354c397ae319 service cinder] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:29.335152 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-614c3925-3bce-4777-aa5c-354c397ae319 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:29.595598 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c3925-3bce-4777-aa5c-354c397ae319 service cinder] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:29.609280 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37914cd9-7c6b-4e13-83f9-67b1cfa17bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:29.610442 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37914cd9-7c6b-4e13-83f9-67b1cfa17bf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:29.611657 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37914cd9-7c6b-4e13-83f9-67b1cfa17bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:29.612391 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37914cd9-7c6b-4e13-83f9-67b1cfa17bf8 admin admin] PATH_INFO: `/v3/users/86a08a4fb9b442a0b0a48d0d2db7e5fe` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:29.620738 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37914cd9-7c6b-4e13-83f9-67b1cfa17bf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86a08a4fb9b442a0b0a48d0d2db7e5fe)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:29.625348 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37914cd9-7c6b-4e13-83f9-67b1cfa17bf8 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:29.730462 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:29.840306 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-37914cd9-7c6b-4e13-83f9-67b1cfa17bf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86a08a4fb9b442a0b0a48d0d2db7e5fe'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:29.844761 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-37914cd9-7c6b-4e13-83f9-67b1cfa17bf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86a08a4fb9b442a0b0a48d0d2db7e5fe'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:29.886145 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-37914cd9-7c6b-4e13-83f9-67b1cfa17bf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86a08a4fb9b442a0b0a48d0d2db7e5fe'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:29.944477 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-37914cd9-7c6b-4e13-83f9-67b1cfa17bf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86a08a4fb9b442a0b0a48d0d2db7e5fe'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:29.947296 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-37914cd9-7c6b-4e13-83f9-67b1cfa17bf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86a08a4fb9b442a0b0a48d0d2db7e5fe'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:30.020486 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1023/2062] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:54:29 2022] DELETE /identity/v3/users/86a08a4fb9b442a0b0a48d0d2db7e5fe => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:54:30.023554 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c67f2f3-e48b-4e80-afab-e4b96f414a5a None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:30.024310 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c67f2f3-e48b-4e80-afab-e4b96f414a5a None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:30.024563 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c67f2f3-e48b-4e80-afab-e4b96f414a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:30.163510 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-3c67f2f3-e48b-4e80-afab-e4b96f414a5a None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:30.169088 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-3c67f2f3-e48b-4e80-afab-e4b96f414a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:30.515675 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1040/2063] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:54:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 489 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:54:30.624366 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37914cd9-7c6b-4e13-83f9-67b1cfa17bf8 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:30.632897 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-37914cd9-7c6b-4e13-83f9-67b1cfa17bf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:30.967775 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37914cd9-7c6b-4e13-83f9-67b1cfa17bf8 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:30.982232 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089af9e-3973-4f21-b9d3-c21776882f15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:30.986919 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089af9e-3973-4f21-b9d3-c21776882f15 service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:30.988438 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089af9e-3973-4f21-b9d3-c21776882f15 service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:30.992933 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0089af9e-3973-4f21-b9d3-c21776882f15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:31.031478 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0089af9e-3973-4f21-b9d3-c21776882f15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:31.036277 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0089af9e-3973-4f21-b9d3-c21776882f15 service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:31.112174 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1024/2064] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:54:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:54:32.545775 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c67f2f3-e48b-4e80-afab-e4b96f414a5a None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:32.548396 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-3c67f2f3-e48b-4e80-afab-e4b96f414a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:32.600066 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c67f2f3-e48b-4e80-afab-e4b96f414a5a None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:32.620909 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f0e96-ff55-4361-8cb0-85caa783ab65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:32.622436 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f0e96-ff55-4361-8cb0-85caa783ab65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:32.623013 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f0e96-ff55-4361-8cb0-85caa783ab65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:32.630144 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f0e96-ff55-4361-8cb0-85caa783ab65 admin admin] PATH_INFO: `/v3/projects/ca6aa1918c6944b3b389f4c251f29ab5` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:32.633453 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f0e96-ff55-4361-8cb0-85caa783ab65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca6aa1918c6944b3b389f4c251f29ab5)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:32.654225 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f0e96-ff55-4361-8cb0-85caa783ab65 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:32.659202 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:32.847114 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-1f2f0e96-ff55-4361-8cb0-85caa783ab65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca6aa1918c6944b3b389f4c251f29ab5', 'request_id': 'req-1f2f0e96-ff55-4361-8cb0-85caa783ab65'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:32.873715 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-1f2f0e96-ff55-4361-8cb0-85caa783ab65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca6aa1918c6944b3b389f4c251f29ab5', 'request_id': 'req-1f2f0e96-ff55-4361-8cb0-85caa783ab65'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:32.890658 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-1f2f0e96-ff55-4361-8cb0-85caa783ab65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca6aa1918c6944b3b389f4c251f29ab5', 'request_id': 'req-1f2f0e96-ff55-4361-8cb0-85caa783ab65'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:32.922152 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-1f2f0e96-ff55-4361-8cb0-85caa783ab65 admin admin] The token cache is being invalidate because project ca6aa1918c6944b3b389f4c251f29ab5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:54:32.925184 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-1f2f0e96-ff55-4361-8cb0-85caa783ab65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:32.926793 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-1f2f0e96-ff55-4361-8cb0-85caa783ab65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:32.935757 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1041/2065] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:54:32 2022] DELETE /identity/v3/projects/ca6aa1918c6944b3b389f4c251f29ab5 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:54:32.936793 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089af9e-3973-4f21-b9d3-c21776882f15 service neutron] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:32.963913 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0089af9e-3973-4f21-b9d3-c21776882f15 service neutron] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:33.112577 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122db2a-350b-4f85-9103-abe15310e297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:33.114446 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122db2a-350b-4f85-9103-abe15310e297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:33.114814 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122db2a-350b-4f85-9103-abe15310e297 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:33.115149 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122db2a-350b-4f85-9103-abe15310e297 admin admin] PATH_INFO: `/v3/users/f2a2c5592032495db95fb8b6eed375f2` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:33.124491 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5122db2a-350b-4f85-9103-abe15310e297 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2a2c5592032495db95fb8b6eed375f2)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:33.128542 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5122db2a-350b-4f85-9103-abe15310e297 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:33.314855 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:33.368173 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-5122db2a-350b-4f85-9103-abe15310e297 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2a2c5592032495db95fb8b6eed375f2'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:33.370084 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-5122db2a-350b-4f85-9103-abe15310e297 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2a2c5592032495db95fb8b6eed375f2'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:33.405305 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-5122db2a-350b-4f85-9103-abe15310e297 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2a2c5592032495db95fb8b6eed375f2'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:33.461332 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-5122db2a-350b-4f85-9103-abe15310e297 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2a2c5592032495db95fb8b6eed375f2'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:33.464973 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-5122db2a-350b-4f85-9103-abe15310e297 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2a2c5592032495db95fb8b6eed375f2'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:33.517985 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1025/2066] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:54:32 2022] DELETE /identity/v3/users/f2a2c5592032495db95fb8b6eed375f2 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:54:33.754960 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f0e96-ff55-4361-8cb0-85caa783ab65 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:33.756808 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-1f2f0e96-ff55-4361-8cb0-85caa783ab65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:33.807365 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f0e96-ff55-4361-8cb0-85caa783ab65 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:34.032830 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad3b5f-bc7f-4d92-8fe5-c3af5b6bf7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:34.033900 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad3b5f-bc7f-4d92-8fe5-c3af5b6bf7ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:34.035204 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad3b5f-bc7f-4d92-8fe5-c3af5b6bf7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:34.035901 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad3b5f-bc7f-4d92-8fe5-c3af5b6bf7ae admin admin] PATH_INFO: `/v3/users/62513f478eb84f469b97219b8cc38b23` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:34.037641 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad3b5f-bc7f-4d92-8fe5-c3af5b6bf7ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=62513f478eb84f469b97219b8cc38b23)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:34.040430 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad3b5f-bc7f-4d92-8fe5-c3af5b6bf7ae admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:34.119016 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70dcfff-9c30-4340-abc9-303039d207c8 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:34.120660 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70dcfff-9c30-4340-abc9-303039d207c8 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:34.121151 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70dcfff-9c30-4340-abc9-303039d207c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:34.186544 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-f0ad3b5f-bc7f-4d92-8fe5-c3af5b6bf7ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62513f478eb84f469b97219b8cc38b23'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:34.188350 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-f0ad3b5f-bc7f-4d92-8fe5-c3af5b6bf7ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62513f478eb84f469b97219b8cc38b23'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:34.190367 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-f0ad3b5f-bc7f-4d92-8fe5-c3af5b6bf7ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62513f478eb84f469b97219b8cc38b23'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:34.213675 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-f0ad3b5f-bc7f-4d92-8fe5-c3af5b6bf7ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62513f478eb84f469b97219b8cc38b23'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:34.263150 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-f0ad3b5f-bc7f-4d92-8fe5-c3af5b6bf7ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62513f478eb84f469b97219b8cc38b23'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:34.279087 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-f70dcfff-9c30-4340-abc9-303039d207c8 None None] MFA Rules not processed for user `5d4f11a98f39401183a1317c92d3d3af`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:34.281218 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-f70dcfff-9c30-4340-abc9-303039d207c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:34.315287 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1042/2067] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:54:33 2022] DELETE /identity/v3/users/62513f478eb84f469b97219b8cc38b23 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:54:34.319805 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86666ac0-a16a-400e-add0-f7ed44fb4230 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:34.320081 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86666ac0-a16a-400e-add0-f7ed44fb4230 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:34.320346 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86666ac0-a16a-400e-add0-f7ed44fb4230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:34.416336 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-86666ac0-a16a-400e-add0-f7ed44fb4230 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:34.424461 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-86666ac0-a16a-400e-add0-f7ed44fb4230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:34.452214 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:34.561845 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1026/2068] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:54:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 445 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:54:34.582150 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70dcfff-9c30-4340-abc9-303039d207c8 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:34.586907 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-f70dcfff-9c30-4340-abc9-303039d207c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:34.647967 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70dcfff-9c30-4340-abc9-303039d207c8 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:34.702885 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1043/2069] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:54:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:54:34.732478 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86666ac0-a16a-400e-add0-f7ed44fb4230 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:34.737342 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-86666ac0-a16a-400e-add0-f7ed44fb4230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:34.872466 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d59414-76fa-416d-8e15-181e38fb9a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:34.873752 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d59414-76fa-416d-8e15-181e38fb9a49 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:34.874179 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d59414-76fa-416d-8e15-181e38fb9a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:34.874592 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d59414-76fa-416d-8e15-181e38fb9a49 admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:34.877665 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d59414-76fa-416d-8e15-181e38fb9a49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:34.883010 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d59414-76fa-416d-8e15-181e38fb9a49 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:34.925533 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86666ac0-a16a-400e-add0-f7ed44fb4230 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:34.938457 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904df0e-6fe0-4dff-b1ce-59f03e7018c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:34.942418 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904df0e-6fe0-4dff-b1ce-59f03e7018c9 service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:34.944363 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904df0e-6fe0-4dff-b1ce-59f03e7018c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:34.946171 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904df0e-6fe0-4dff-b1ce-59f03e7018c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:34.954011 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1027/2070] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:54:34 2022] POST /identity/v3/projects => generated 383 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:54:34.957997 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d59414-76fa-416d-8e15-181e38fb9a49 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:34.965306 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-43d59414-76fa-416d-8e15-181e38fb9a49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:34.979808 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2904df0e-6fe0-4dff-b1ce-59f03e7018c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:34.983970 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2904df0e-6fe0-4dff-b1ce-59f03e7018c9 service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:35.029562 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1044/2071] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:54:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:54:35.030933 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904df0e-6fe0-4dff-b1ce-59f03e7018c9 service neutron] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:35.087564 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904df0e-6fe0-4dff-b1ce-59f03e7018c9 service neutron] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:35.098098 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:35.253683 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d59414-76fa-416d-8e15-181e38fb9a49 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:35.280210 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e10b710-2688-4954-a72e-3ccaf4d0ceec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:35.300191 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10b710-2688-4954-a72e-3ccaf4d0ceec admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:35.300740 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10b710-2688-4954-a72e-3ccaf4d0ceec admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:35.322889 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e10b710-2688-4954-a72e-3ccaf4d0ceec admin admin] PATH_INFO: `/v3/projects/710a6e313487430389c9ab09f99af584` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:35.342024 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e10b710-2688-4954-a72e-3ccaf4d0ceec admin admin] RBAC: Authorizing `identity:delete_project(project_id=710a6e313487430389c9ab09f99af584)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:35.365665 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e10b710-2688-4954-a72e-3ccaf4d0ceec admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:35.474443 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b4863-8112-4e25-81e2-4c4d292393dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:35.478857 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b4863-8112-4e25-81e2-4c4d292393dc admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:35.480258 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b4863-8112-4e25-81e2-4c4d292393dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:35.482439 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b4863-8112-4e25-81e2-4c4d292393dc admin admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:35.483613 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b4863-8112-4e25-81e2-4c4d292393dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:35.492939 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b4863-8112-4e25-81e2-4c4d292393dc admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:35.545629 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1045/2072] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:54:35 2022] POST /identity/v3/users => generated 298 bytes in 515 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:54:35.552826 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b4863-8112-4e25-81e2-4c4d292393dc admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:35.558246 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-5e10b710-2688-4954-a72e-3ccaf4d0ceec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '710a6e313487430389c9ab09f99af584', 'request_id': 'req-5e10b710-2688-4954-a72e-3ccaf4d0ceec'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:35.583557 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b4863-8112-4e25-81e2-4c4d292393dc admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:35.584192 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-5e10b710-2688-4954-a72e-3ccaf4d0ceec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '710a6e313487430389c9ab09f99af584', 'request_id': 'req-5e10b710-2688-4954-a72e-3ccaf4d0ceec'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:35.606496 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-5e10b710-2688-4954-a72e-3ccaf4d0ceec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '710a6e313487430389c9ab09f99af584', 'request_id': 'req-5e10b710-2688-4954-a72e-3ccaf4d0ceec'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:35.635447 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-5e10b710-2688-4954-a72e-3ccaf4d0ceec admin admin] The token cache is being invalidate because project 710a6e313487430389c9ab09f99af584 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:54:35.635926 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-5e10b710-2688-4954-a72e-3ccaf4d0ceec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:35.636763 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-5e10b710-2688-4954-a72e-3ccaf4d0ceec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:35.640776 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1028/2073] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:54:34 2022] DELETE /identity/v3/projects/710a6e313487430389c9ab09f99af584 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:54:35.647922 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc3df7-775d-454e-9652-c9d74b979091 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:35.648336 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc3df7-775d-454e-9652-c9d74b979091 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:35.648715 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc3df7-775d-454e-9652-c9d74b979091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:35.713175 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-3abc3df7-775d-454e-9652-c9d74b979091 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:35.729016 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-3abc3df7-775d-454e-9652-c9d74b979091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:35.744856 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:35.847580 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ae07b-229b-46c4-953a-2925708067ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:35.851218 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ae07b-229b-46c4-953a-2925708067ed admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:35.852341 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ae07b-229b-46c4-953a-2925708067ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:35.852990 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ae07b-229b-46c4-953a-2925708067ed admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:35.854218 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20ae07b-229b-46c4-953a-2925708067ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:35.857558 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20ae07b-229b-46c4-953a-2925708067ed admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:35.904354 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1046/2074] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:54:35.906386 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ae07b-229b-46c4-953a-2925708067ed admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:35.910008 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-b20ae07b-229b-46c4-953a-2925708067ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:35.943013 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ae07b-229b-46c4-953a-2925708067ed admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:35.968114 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de900e-353f-4934-aa6d-bd6ed0ce6b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:35.969264 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de900e-353f-4934-aa6d-bd6ed0ce6b49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:35.969790 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de900e-353f-4934-aa6d-bd6ed0ce6b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:35.971165 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de900e-353f-4934-aa6d-bd6ed0ce6b49 admin admin] PATH_INFO: `/v3/projects/2700c7daf3654c1cb7a33e78429acba7` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:35.974373 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2de900e-353f-4934-aa6d-bd6ed0ce6b49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2700c7daf3654c1cb7a33e78429acba7)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:35.978032 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2de900e-353f-4934-aa6d-bd6ed0ce6b49 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:35.995401 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1029/2075] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:54:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:54:35.997667 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc3df7-775d-454e-9652-c9d74b979091 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:36.001017 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-3abc3df7-775d-454e-9652-c9d74b979091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:36.038762 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc3df7-775d-454e-9652-c9d74b979091 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:36.047638 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c3afe-8998-44d1-8e07-6ff6995a7a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:36.048971 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c3afe-8998-44d1-8e07-6ff6995a7a65 admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:36.051004 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c3afe-8998-44d1-8e07-6ff6995a7a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:36.051684 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c3afe-8998-44d1-8e07-6ff6995a7a65 admin admin] PATH_INFO: `/v3/projects/2716321b31b649e9804894352702f6fc/users/35b5ae01a4894129a2029fd6aa78ddc3/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:36.114920 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-c2de900e-353f-4934-aa6d-bd6ed0ce6b49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2700c7daf3654c1cb7a33e78429acba7', 'request_id': 'req-c2de900e-353f-4934-aa6d-bd6ed0ce6b49'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:36.120248 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c3afe-8998-44d1-8e07-6ff6995a7a65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2716321b31b649e9804894352702f6fc, user_id=35b5ae01a4894129a2029fd6aa78ddc3, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:36.128399 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c3afe-8998-44d1-8e07-6ff6995a7a65 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:36.134365 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-c2de900e-353f-4934-aa6d-bd6ed0ce6b49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2700c7daf3654c1cb7a33e78429acba7', 'request_id': 'req-c2de900e-353f-4934-aa6d-bd6ed0ce6b49'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:36.163100 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-c2de900e-353f-4934-aa6d-bd6ed0ce6b49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2700c7daf3654c1cb7a33e78429acba7', 'request_id': 'req-c2de900e-353f-4934-aa6d-bd6ed0ce6b49'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:36.175684 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1030/2076] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:54:35 2022] PUT /identity/v3/projects/2716321b31b649e9804894352702f6fc/users/35b5ae01a4894129a2029fd6aa78ddc3/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:54:36.180283 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d5294-2072-4c14-a313-f505006b5129 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:36.181554 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d5294-2072-4c14-a313-f505006b5129 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:36.181900 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d5294-2072-4c14-a313-f505006b5129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:36.220694 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-c2de900e-353f-4934-aa6d-bd6ed0ce6b49 admin admin] The token cache is being invalidate because project 2700c7daf3654c1cb7a33e78429acba7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:54:36.221855 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-c2de900e-353f-4934-aa6d-bd6ed0ce6b49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:36.226609 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-c2de900e-353f-4934-aa6d-bd6ed0ce6b49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:36.232765 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1047/2077] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:54:35 2022] DELETE /identity/v3/projects/2700c7daf3654c1cb7a33e78429acba7 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:54:36.235227 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de900e-353f-4934-aa6d-bd6ed0ce6b49 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:36.241568 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-bd9d5294-2072-4c14-a313-f505006b5129 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:36.243437 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-bd9d5294-2072-4c14-a313-f505006b5129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:36.244969 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-c2de900e-353f-4934-aa6d-bd6ed0ce6b49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:36.402016 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:36.475476 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de900e-353f-4934-aa6d-bd6ed0ce6b49 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:36.498796 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1031/2078] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:54:36.500255 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d5294-2072-4c14-a313-f505006b5129 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:36.502898 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-bd9d5294-2072-4c14-a313-f505006b5129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:36.520556 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d5294-2072-4c14-a313-f505006b5129 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:36.530651 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3745d1-34ad-4c98-8fc9-e9bd46796c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:36.531467 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3745d1-34ad-4c98-8fc9-e9bd46796c43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:36.531749 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3745d1-34ad-4c98-8fc9-e9bd46796c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:36.532033 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3745d1-34ad-4c98-8fc9-e9bd46796c43 admin admin] PATH_INFO: `/v3/users/ffcfe4b7247041cf8449f397618010e7` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:36.533772 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3745d1-34ad-4c98-8fc9-e9bd46796c43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffcfe4b7247041cf8449f397618010e7)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:36.535993 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3745d1-34ad-4c98-8fc9-e9bd46796c43 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:36.628855 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78f77c-00ee-4331-a3f7-5af54f8036c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:36.630012 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78f77c-00ee-4331-a3f7-5af54f8036c7 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:36.630513 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78f77c-00ee-4331-a3f7-5af54f8036c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:36.630984 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78f77c-00ee-4331-a3f7-5af54f8036c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:36.631973 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e78f77c-00ee-4331-a3f7-5af54f8036c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:36.634815 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e78f77c-00ee-4331-a3f7-5af54f8036c7 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:36.659562 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1048/2079] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:54:36.659562 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78f77c-00ee-4331-a3f7-5af54f8036c7 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:36.669982 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:36.689932 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78f77c-00ee-4331-a3f7-5af54f8036c7 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:36.699825 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e261baa-4482-4ca7-b124-1ee341af2a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:36.700854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e261baa-4482-4ca7-b124-1ee341af2a00 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:36.701345 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e261baa-4482-4ca7-b124-1ee341af2a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:36.701958 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e261baa-4482-4ca7-b124-1ee341af2a00 admin admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:36.703215 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e261baa-4482-4ca7-b124-1ee341af2a00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:54:36.703768 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e261baa-4482-4ca7-b124-1ee341af2a00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:36.708449 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e261baa-4482-4ca7-b124-1ee341af2a00 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:36.730357 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-8c3745d1-34ad-4c98-8fc9-e9bd46796c43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffcfe4b7247041cf8449f397618010e7'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:36.731436 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-8c3745d1-34ad-4c98-8fc9-e9bd46796c43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffcfe4b7247041cf8449f397618010e7'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:36.738890 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1049/2080] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 13:54:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:54:36.740905 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e261baa-4482-4ca7-b124-1ee341af2a00 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:36.744074 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-6e261baa-4482-4ca7-b124-1ee341af2a00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:36.777911 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-8c3745d1-34ad-4c98-8fc9-e9bd46796c43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffcfe4b7247041cf8449f397618010e7'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:36.786297 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e261baa-4482-4ca7-b124-1ee341af2a00 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:36.805411 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91623b73-a2a3-44bc-8b06-d19cf0b9fbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:36.807124 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91623b73-a2a3-44bc-8b06-d19cf0b9fbc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:36.807818 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91623b73-a2a3-44bc-8b06-d19cf0b9fbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:36.808508 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91623b73-a2a3-44bc-8b06-d19cf0b9fbc1 admin admin] PATH_INFO: `/v3/projects/2716321b31b649e9804894352702f6fc/users/35b5ae01a4894129a2029fd6aa78ddc3/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:36.817346 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91623b73-a2a3-44bc-8b06-d19cf0b9fbc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2716321b31b649e9804894352702f6fc, user_id=35b5ae01a4894129a2029fd6aa78ddc3, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:36.824336 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91623b73-a2a3-44bc-8b06-d19cf0b9fbc1 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:36.849764 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-8c3745d1-34ad-4c98-8fc9-e9bd46796c43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffcfe4b7247041cf8449f397618010e7'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:36.852370 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-8c3745d1-34ad-4c98-8fc9-e9bd46796c43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffcfe4b7247041cf8449f397618010e7'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:36.866363 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1050/2081] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:54:36 2022] PUT /identity/v3/projects/2716321b31b649e9804894352702f6fc/users/35b5ae01a4894129a2029fd6aa78ddc3/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:54:36.900195 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91623b73-a2a3-44bc-8b06-d19cf0b9fbc1 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:36.903749 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1032/2082] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:54:36 2022] DELETE /identity/v3/users/ffcfe4b7247041cf8449f397618010e7 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:54:36.906100 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-91623b73-a2a3-44bc-8b06-d19cf0b9fbc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:37.115548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91623b73-a2a3-44bc-8b06-d19cf0b9fbc1 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:37.304884 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b4f36-6f38-4b50-b430-4084b0ce8e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:37.305983 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b4f36-6f38-4b50-b430-4084b0ce8e8f admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:37.306398 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b4f36-6f38-4b50-b430-4084b0ce8e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:37.306961 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b4f36-6f38-4b50-b430-4084b0ce8e8f admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:37.308179 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b4f36-6f38-4b50-b430-4084b0ce8e8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:37.313172 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b4f36-6f38-4b50-b430-4084b0ce8e8f admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:37.438185 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1051/2083] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:54:36 2022] POST /identity/v3/projects => generated 369 bytes in 571 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:54:37.446772 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3745d1-34ad-4c98-8fc9-e9bd46796c43 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:37.490676 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3745d1-34ad-4c98-8fc9-e9bd46796c43 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:37.716393 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d943e7e-4254-49c5-9e3d-62400bc1c680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:37.718101 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d943e7e-4254-49c5-9e3d-62400bc1c680 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:37.718966 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d943e7e-4254-49c5-9e3d-62400bc1c680 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:37.719750 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d943e7e-4254-49c5-9e3d-62400bc1c680 admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:37.721791 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d943e7e-4254-49c5-9e3d-62400bc1c680 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:37.729141 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d943e7e-4254-49c5-9e3d-62400bc1c680 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:37.783964 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1033/2084] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:54:37 2022] POST /identity/v3/users => generated 285 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:54:37.790377 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b4f36-6f38-4b50-b430-4084b0ce8e8f admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:37.822448 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b4f36-6f38-4b50-b430-4084b0ce8e8f admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:37.833118 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d39362-ea66-4566-8d06-3a859e2b4d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:37.834254 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d39362-ea66-4566-8d06-3a859e2b4d28 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:37.834753 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d39362-ea66-4566-8d06-3a859e2b4d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:37.835558 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d39362-ea66-4566-8d06-3a859e2b4d28 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:37.836831 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d39362-ea66-4566-8d06-3a859e2b4d28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:37.840236 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d39362-ea66-4566-8d06-3a859e2b4d28 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:37.897257 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1052/2085] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:54:37.903361 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d943e7e-4254-49c5-9e3d-62400bc1c680 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:37.936619 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d943e7e-4254-49c5-9e3d-62400bc1c680 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:37.953950 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ab9ea-4dd4-4c1f-b657-fa0177f17d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:37.955720 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ab9ea-4dd4-4c1f-b657-fa0177f17d62 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:37.956222 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ab9ea-4dd4-4c1f-b657-fa0177f17d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:37.956705 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ab9ea-4dd4-4c1f-b657-fa0177f17d62 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:37.957957 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ab9ea-4dd4-4c1f-b657-fa0177f17d62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:37.961034 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ab9ea-4dd4-4c1f-b657-fa0177f17d62 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:38.074517 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1034/2086] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:54:38.079093 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d39362-ea66-4566-8d06-3a859e2b4d28 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:38.127796 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d39362-ea66-4566-8d06-3a859e2b4d28 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:38.137868 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906fe276-6de9-4eb7-aa4c-160b5b851464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:38.139133 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fe276-6de9-4eb7-aa4c-160b5b851464 admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:38.139732 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fe276-6de9-4eb7-aa4c-160b5b851464 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:38.140314 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fe276-6de9-4eb7-aa4c-160b5b851464 admin admin] PATH_INFO: `/v3/projects/2e11d4c55c4140cfa93d2e041491c899/users/28fef03284724efeb5d7521a6282b8b5/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:38.188512 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906fe276-6de9-4eb7-aa4c-160b5b851464 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e11d4c55c4140cfa93d2e041491c899, user_id=28fef03284724efeb5d7521a6282b8b5, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:38.205344 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906fe276-6de9-4eb7-aa4c-160b5b851464 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:38.285855 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1053/2087] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:54:38 2022] PUT /identity/v3/projects/2e11d4c55c4140cfa93d2e041491c899/users/28fef03284724efeb5d7521a6282b8b5/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:54:38.316880 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce9a59-06ac-447f-aa34-ec6db66b4af6 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:38.317797 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce9a59-06ac-447f-aa34-ec6db66b4af6 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:38.319397 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce9a59-06ac-447f-aa34-ec6db66b4af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:38.384757 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-a2ce9a59-06ac-447f-aa34-ec6db66b4af6 None None] MFA Rules not processed for user `28fef03284724efeb5d7521a6282b8b5`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:38.390507 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-a2ce9a59-06ac-447f-aa34-ec6db66b4af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:38.453844 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:38.716982 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1035/2088] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:54:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:54:38.722283 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906fe276-6de9-4eb7-aa4c-160b5b851464 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:38.840460 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:38.922591 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906fe276-6de9-4eb7-aa4c-160b5b851464 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:38.934501 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79388204-0e09-480c-aecc-b49a8dc497d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:38.935566 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79388204-0e09-480c-aecc-b49a8dc497d1 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:38.936007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79388204-0e09-480c-aecc-b49a8dc497d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:38.936599 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79388204-0e09-480c-aecc-b49a8dc497d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:38.939935 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79388204-0e09-480c-aecc-b49a8dc497d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:38.943724 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79388204-0e09-480c-aecc-b49a8dc497d1 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:39.012377 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1054/2089] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:54:38 2022] POST /identity/v3/projects => generated 369 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:54:39.018517 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce9a59-06ac-447f-aa34-ec6db66b4af6 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:39.064936 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce9a59-06ac-447f-aa34-ec6db66b4af6 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:39.301302 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79388204-0e09-480c-aecc-b49a8dc497d1 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:39.309190 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-79388204-0e09-480c-aecc-b49a8dc497d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:39.357763 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4dc869-82f7-4659-bd4b-09e14583e4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:39.359962 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4dc869-82f7-4659-bd4b-09e14583e4b8 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:39.361534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4dc869-82f7-4659-bd4b-09e14583e4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:39.362500 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4dc869-82f7-4659-bd4b-09e14583e4b8 admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:39.365230 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4dc869-82f7-4659-bd4b-09e14583e4b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:39.371616 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4dc869-82f7-4659-bd4b-09e14583e4b8 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:39.469240 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1036/2090] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:54:39 2022] POST /identity/v3/users => generated 291 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:54:39.473698 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4dc869-82f7-4659-bd4b-09e14583e4b8 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:39.496365 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4dc869-82f7-4659-bd4b-09e14583e4b8 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:39.500218 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79388204-0e09-480c-aecc-b49a8dc497d1 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:39.507648 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21053e-6961-4766-ac33-b5e174c45fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:39.511355 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21053e-6961-4766-ac33-b5e174c45fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:39.511876 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21053e-6961-4766-ac33-b5e174c45fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:39.512148 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469bc14-78ed-4fe6-966b-1612fda1e371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:39.512424 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21053e-6961-4766-ac33-b5e174c45fb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:39.513304 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469bc14-78ed-4fe6-966b-1612fda1e371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:39.513827 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469bc14-78ed-4fe6-966b-1612fda1e371 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:39.514881 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469bc14-78ed-4fe6-966b-1612fda1e371 admin admin] PATH_INFO: `/v3/projects/48f2ada135f542f693b2fc61384ec2fe` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:39.516016 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae21053e-6961-4766-ac33-b5e174c45fb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:39.519210 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7469bc14-78ed-4fe6-966b-1612fda1e371 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48f2ada135f542f693b2fc61384ec2fe)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:39.521278 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae21053e-6961-4766-ac33-b5e174c45fb3 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:39.523361 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7469bc14-78ed-4fe6-966b-1612fda1e371 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:39.554481 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1037/2091] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:54:39.557017 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21053e-6961-4766-ac33-b5e174c45fb3 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:39.585236 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21053e-6961-4766-ac33-b5e174c45fb3 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:39.605097 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a267f10-3754-44da-b75b-614710791fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:39.607759 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a267f10-3754-44da-b75b-614710791fe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:39.608027 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a267f10-3754-44da-b75b-614710791fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:39.608446 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a267f10-3754-44da-b75b-614710791fe4 admin admin] PATH_INFO: `/v3/projects/145909cdd1bf41edb4ba896b2d3fadc2/users/70f6b72a6bcd4e338289cee78112056a/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:39.648099 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-7469bc14-78ed-4fe6-966b-1612fda1e371 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48f2ada135f542f693b2fc61384ec2fe', 'request_id': 'req-7469bc14-78ed-4fe6-966b-1612fda1e371'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:39.658937 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a267f10-3754-44da-b75b-614710791fe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=145909cdd1bf41edb4ba896b2d3fadc2, user_id=70f6b72a6bcd4e338289cee78112056a, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:39.670353 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a267f10-3754-44da-b75b-614710791fe4 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:39.673791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-7469bc14-78ed-4fe6-966b-1612fda1e371 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48f2ada135f542f693b2fc61384ec2fe', 'request_id': 'req-7469bc14-78ed-4fe6-966b-1612fda1e371'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:39.689925 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-7469bc14-78ed-4fe6-966b-1612fda1e371 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48f2ada135f542f693b2fc61384ec2fe', 'request_id': 'req-7469bc14-78ed-4fe6-966b-1612fda1e371'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:39.711767 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1038/2092] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:54:39 2022] PUT /identity/v3/projects/145909cdd1bf41edb4ba896b2d3fadc2/users/70f6b72a6bcd4e338289cee78112056a/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:54:39.718346 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a267f10-3754-44da-b75b-614710791fe4 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:39.737017 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-7469bc14-78ed-4fe6-966b-1612fda1e371 admin admin] The token cache is being invalidate because project 48f2ada135f542f693b2fc61384ec2fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:54:39.737712 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-7469bc14-78ed-4fe6-966b-1612fda1e371 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:39.740854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-7469bc14-78ed-4fe6-966b-1612fda1e371 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:39.747854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1055/2093] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:54:39 2022] DELETE /identity/v3/projects/48f2ada135f542f693b2fc61384ec2fe => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:54:39.757934 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290afa1c-b9e2-4a53-801b-259827329bc7 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:39.758452 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290afa1c-b9e2-4a53-801b-259827329bc7 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:39.758945 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290afa1c-b9e2-4a53-801b-259827329bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:39.836588 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-290afa1c-b9e2-4a53-801b-259827329bc7 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:39.840973 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-290afa1c-b9e2-4a53-801b-259827329bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:39.975402 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a267f10-3754-44da-b75b-614710791fe4 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:39.999765 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234ecfb-2b4e-4415-b98e-729df636a77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:40.001527 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234ecfb-2b4e-4415-b98e-729df636a77b admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:40.003904 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234ecfb-2b4e-4415-b98e-729df636a77b admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:40.004340 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234ecfb-2b4e-4415-b98e-729df636a77b admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:40.005201 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234ecfb-2b4e-4415-b98e-729df636a77b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:40.014678 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234ecfb-2b4e-4415-b98e-729df636a77b admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:40.018678 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:40.063884 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1039/2094] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:54:40.068377 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234ecfb-2b4e-4415-b98e-729df636a77b admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:40.074303 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-1234ecfb-2b4e-4415-b98e-729df636a77b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:40.086749 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1056/2095] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:54:40.099604 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f6716-6a49-471d-b7e8-dfd3df6bdf3a None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:40.100072 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f6716-6a49-471d-b7e8-dfd3df6bdf3a None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:40.100535 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f6716-6a49-471d-b7e8-dfd3df6bdf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:40.144908 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234ecfb-2b4e-4415-b98e-729df636a77b admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:40.168532 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58076d3-4d6a-47a3-af5f-801bbc324484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:40.168532 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58076d3-4d6a-47a3-af5f-801bbc324484 admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:40.168532 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58076d3-4d6a-47a3-af5f-801bbc324484 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:40.171309 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58076d3-4d6a-47a3-af5f-801bbc324484 admin admin] PATH_INFO: `/v3/projects/145909cdd1bf41edb4ba896b2d3fadc2/users/70f6b72a6bcd4e338289cee78112056a/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:40.181831 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58076d3-4d6a-47a3-af5f-801bbc324484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=145909cdd1bf41edb4ba896b2d3fadc2, user_id=70f6b72a6bcd4e338289cee78112056a, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:40.187724 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-8f1f6716-6a49-471d-b7e8-dfd3df6bdf3a None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:40.190136 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58076d3-4d6a-47a3-af5f-801bbc324484 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:40.193059 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-8f1f6716-6a49-471d-b7e8-dfd3df6bdf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:40.199300 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:40.221436 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1040/2096] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:54:40 2022] PUT /identity/v3/projects/145909cdd1bf41edb4ba896b2d3fadc2/users/70f6b72a6bcd4e338289cee78112056a/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:54:40.244348 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf020849-88f4-42be-b0af-4188eab4f996 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:40.245583 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf020849-88f4-42be-b0af-4188eab4f996 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:40.246231 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf020849-88f4-42be-b0af-4188eab4f996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:40.263051 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1057/2097] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:54:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:54:40.264787 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f6716-6a49-471d-b7e8-dfd3df6bdf3a None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:40.267923 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-8f1f6716-6a49-471d-b7e8-dfd3df6bdf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:40.297818 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f6716-6a49-471d-b7e8-dfd3df6bdf3a None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:40.375490 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-bf020849-88f4-42be-b0af-4188eab4f996 None None] MFA Rules not processed for user `70f6b72a6bcd4e338289cee78112056a`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:40.380805 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-bf020849-88f4-42be-b0af-4188eab4f996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:40.580415 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718e66f-7ed2-4e52-9da1-deab2edd4f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:40.582412 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718e66f-7ed2-4e52-9da1-deab2edd4f45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:40.584278 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718e66f-7ed2-4e52-9da1-deab2edd4f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:40.586029 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e718e66f-7ed2-4e52-9da1-deab2edd4f45 admin admin] PATH_INFO: `/v3/users/c21b4601642c42528d0e4123e8c8bcc0` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:40.591173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e718e66f-7ed2-4e52-9da1-deab2edd4f45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c21b4601642c42528d0e4123e8c8bcc0)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:40.603685 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e718e66f-7ed2-4e52-9da1-deab2edd4f45 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:40.728653 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1041/2098] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:54:40 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 486 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:54:40.733565 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf020849-88f4-42be-b0af-4188eab4f996 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:40.818710 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf020849-88f4-42be-b0af-4188eab4f996 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:40.838634 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-e718e66f-7ed2-4e52-9da1-deab2edd4f45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c21b4601642c42528d0e4123e8c8bcc0'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:40.840649 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17e0eb-bc61-49af-a56b-66e22a169132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:40.843083 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-e718e66f-7ed2-4e52-9da1-deab2edd4f45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c21b4601642c42528d0e4123e8c8bcc0'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:40.845412 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17e0eb-bc61-49af-a56b-66e22a169132 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:40.845880 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17e0eb-bc61-49af-a56b-66e22a169132 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:40.846374 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad17e0eb-bc61-49af-a56b-66e22a169132 admin admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:40.848131 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-e718e66f-7ed2-4e52-9da1-deab2edd4f45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c21b4601642c42528d0e4123e8c8bcc0'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:40.851135 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17e0eb-bc61-49af-a56b-66e22a169132 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:54:40.851725 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17e0eb-bc61-49af-a56b-66e22a169132 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:40.869857 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-e718e66f-7ed2-4e52-9da1-deab2edd4f45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c21b4601642c42528d0e4123e8c8bcc0'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:40.874312 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad17e0eb-bc61-49af-a56b-66e22a169132 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:40.909890 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-e718e66f-7ed2-4e52-9da1-deab2edd4f45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c21b4601642c42528d0e4123e8c8bcc0'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:40.930584 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1042/2099] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 13:54:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:54:40.932073 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17e0eb-bc61-49af-a56b-66e22a169132 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:40.945148 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-ad17e0eb-bc61-49af-a56b-66e22a169132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:40.962172 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1058/2100] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:54:40 2022] DELETE /identity/v3/users/c21b4601642c42528d0e4123e8c8bcc0 => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:54:40.964218 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718e66f-7ed2-4e52-9da1-deab2edd4f45 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:40.966910 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-e718e66f-7ed2-4e52-9da1-deab2edd4f45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:41.163188 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad17e0eb-bc61-49af-a56b-66e22a169132 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:41.184496 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e718e66f-7ed2-4e52-9da1-deab2edd4f45 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:41.206814 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58a660-a075-4306-9b6c-9c8e2c8e5f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:41.211387 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58a660-a075-4306-9b6c-9c8e2c8e5f10 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:41.212817 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58a660-a075-4306-9b6c-9c8e2c8e5f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:41.218492 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58a660-a075-4306-9b6c-9c8e2c8e5f10 admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:41.218492 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c58a660-a075-4306-9b6c-9c8e2c8e5f10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:41.218492 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c58a660-a075-4306-9b6c-9c8e2c8e5f10 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:41.287621 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:41.293589 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca10a87-985e-4d99-9e4f-c3325132c8cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:41.294701 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca10a87-985e-4d99-9e4f-c3325132c8cf service cinder] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:41.295189 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca10a87-985e-4d99-9e4f-c3325132c8cf service cinder] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:41.295805 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca10a87-985e-4d99-9e4f-c3325132c8cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:41.300182 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-7ca10a87-985e-4d99-9e4f-c3325132c8cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:41.351408 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1059/2101] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:54:40 2022] POST /identity/v3/projects => generated 377 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:54:41.358646 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898b1b6-b26a-4951-a994-bc19d1403902 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:41.359175 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898b1b6-b26a-4951-a994-bc19d1403902 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:41.359649 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898b1b6-b26a-4951-a994-bc19d1403902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:41.442573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-7898b1b6-b26a-4951-a994-bc19d1403902 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:41.446976 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-7898b1b6-b26a-4951-a994-bc19d1403902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:41.448027 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:41.550064 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca10a87-985e-4d99-9e4f-c3325132c8cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:41.553856 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca10a87-985e-4d99-9e4f-c3325132c8cf service cinder] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:41.584718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1043/2102] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:54:40 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 653 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:54:41.585969 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca10a87-985e-4d99-9e4f-c3325132c8cf service cinder] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:41.623458 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca10a87-985e-4d99-9e4f-c3325132c8cf service cinder] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:41.676225 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1060/2103] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:54:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:54:41.694673 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7898b1b6-b26a-4951-a994-bc19d1403902 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:41.697138 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-7898b1b6-b26a-4951-a994-bc19d1403902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:41.854141 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc22468-65ee-4160-91fa-59cdaff9f96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:41.855130 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc22468-65ee-4160-91fa-59cdaff9f96d admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:41.855469 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc22468-65ee-4160-91fa-59cdaff9f96d admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:41.855867 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc22468-65ee-4160-91fa-59cdaff9f96d admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:41.856598 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc22468-65ee-4160-91fa-59cdaff9f96d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:41.859123 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc22468-65ee-4160-91fa-59cdaff9f96d admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:41.947393 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1044/2104] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:54:41 2022] POST /identity/v3/users => generated 289 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:54:41.951537 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc22468-65ee-4160-91fa-59cdaff9f96d admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:41.961428 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-0cc22468-65ee-4160-91fa-59cdaff9f96d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:42.005939 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7898b1b6-b26a-4951-a994-bc19d1403902 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:42.027676 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed61869-2c60-422f-9f14-f1696be46006 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:42.042097 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed61869-2c60-422f-9f14-f1696be46006 service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:42.046496 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed61869-2c60-422f-9f14-f1696be46006 service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:42.046967 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed61869-2c60-422f-9f14-f1696be46006 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:42.091252 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed61869-2c60-422f-9f14-f1696be46006 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:42.095310 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed61869-2c60-422f-9f14-f1696be46006 service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:42.136240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1061/2105] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:54:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:54:42.137277 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed61869-2c60-422f-9f14-f1696be46006 service neutron] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:42.185426 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed61869-2c60-422f-9f14-f1696be46006 service neutron] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:42.192152 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc22468-65ee-4160-91fa-59cdaff9f96d admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:42.206810 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9522ce-2c11-42b1-b2c4-641e42243299 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:42.207909 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9522ce-2c11-42b1-b2c4-641e42243299 service cinder] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:42.208499 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9522ce-2c11-42b1-b2c4-641e42243299 service cinder] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:42.209223 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9522ce-2c11-42b1-b2c4-641e42243299 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:42.218888 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-6f9522ce-2c11-42b1-b2c4-641e42243299 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:42.224526 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7eb21b-910c-4c3d-a424-4e131769da35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:42.225998 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7eb21b-910c-4c3d-a424-4e131769da35 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:42.226687 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7eb21b-910c-4c3d-a424-4e131769da35 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:42.227322 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7eb21b-910c-4c3d-a424-4e131769da35 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:42.228791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7eb21b-910c-4c3d-a424-4e131769da35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:42.237854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7eb21b-910c-4c3d-a424-4e131769da35 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:42.298399 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1062/2106] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:54:42 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:54:42.302475 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7eb21b-910c-4c3d-a424-4e131769da35 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:42.336700 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7eb21b-910c-4c3d-a424-4e131769da35 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:42.351263 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444801c9-207c-4fc8-bc5a-8018333bcd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:42.352536 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444801c9-207c-4fc8-bc5a-8018333bcd7d admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:42.353160 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444801c9-207c-4fc8-bc5a-8018333bcd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:42.353870 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444801c9-207c-4fc8-bc5a-8018333bcd7d admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:42.355285 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444801c9-207c-4fc8-bc5a-8018333bcd7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:42.361927 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444801c9-207c-4fc8-bc5a-8018333bcd7d admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:42.394070 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1063/2107] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:54:42 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:54:42.399084 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444801c9-207c-4fc8-bc5a-8018333bcd7d admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:42.457069 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444801c9-207c-4fc8-bc5a-8018333bcd7d admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:42.489191 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99b8b2-4743-4af0-b400-187659dd424f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:42.490297 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99b8b2-4743-4af0-b400-187659dd424f admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:42.490758 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99b8b2-4743-4af0-b400-187659dd424f admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:42.491182 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99b8b2-4743-4af0-b400-187659dd424f admin admin] PATH_INFO: `/v3/projects/67263b933a124d059be167e71e466cc5/users/585813988a8c456bb3d41b9587c65801/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:42.505941 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9522ce-2c11-42b1-b2c4-641e42243299 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:42.511150 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9522ce-2c11-42b1-b2c4-641e42243299 service cinder] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:42.550464 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1045/2108] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:54:41 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:54:42.581830 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99b8b2-4743-4af0-b400-187659dd424f admin admin] RBAC: Authorizing `identity:create_grant(project_id=67263b933a124d059be167e71e466cc5, user_id=585813988a8c456bb3d41b9587c65801, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:42.595075 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99b8b2-4743-4af0-b400-187659dd424f admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:42.677024 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1064/2109] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:54:42 2022] PUT /identity/v3/projects/67263b933a124d059be167e71e466cc5/users/585813988a8c456bb3d41b9587c65801/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:54:42.704781 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e5d82-dac1-446e-b6cc-ab97df267d25 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:42.705266 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e5d82-dac1-446e-b6cc-ab97df267d25 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:42.705987 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e5d82-dac1-446e-b6cc-ab97df267d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:42.866935 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-af6e5d82-dac1-446e-b6cc-ab97df267d25 None None] MFA Rules not processed for user `585813988a8c456bb3d41b9587c65801`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:42.870363 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-af6e5d82-dac1-446e-b6cc-ab97df267d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:42.892678 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:43.136171 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99b8b2-4743-4af0-b400-187659dd424f admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:43.139876 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-6f99b8b2-4743-4af0-b400-187659dd424f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:43.262786 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1046/2110] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:54:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 560 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:54:43.272866 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e5d82-dac1-446e-b6cc-ab97df267d25 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:43.472392 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:43.549827 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99b8b2-4743-4af0-b400-187659dd424f admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:43.569267 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcfd485-febb-46e8-80c5-64e5279ad1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:43.571597 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfd485-febb-46e8-80c5-64e5279ad1c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:43.571999 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfd485-febb-46e8-80c5-64e5279ad1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:43.574472 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfd485-febb-46e8-80c5-64e5279ad1c3 admin admin] PATH_INFO: `/v3/projects/91d71e0858414093a2e065563453454d` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:43.576977 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcfd485-febb-46e8-80c5-64e5279ad1c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91d71e0858414093a2e065563453454d)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:43.583510 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcfd485-febb-46e8-80c5-64e5279ad1c3 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:43.600573 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e5d82-dac1-446e-b6cc-ab97df267d25 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:43.634556 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b93a0-7834-445e-be27-942e99ff65c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:43.638374 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b93a0-7834-445e-be27-942e99ff65c9 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:43.639201 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b93a0-7834-445e-be27-942e99ff65c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:43.642452 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b93a0-7834-445e-be27-942e99ff65c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:43.647194 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b93a0-7834-445e-be27-942e99ff65c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:43.666238 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b93a0-7834-445e-be27-942e99ff65c9 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:43.799650 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1047/2111] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:54:43 2022] POST /identity/v3/projects => generated 377 bytes in 531 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:54:43.816177 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b93a0-7834-445e-be27-942e99ff65c9 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:43.892284 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-0fcfd485-febb-46e8-80c5-64e5279ad1c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91d71e0858414093a2e065563453454d', 'request_id': 'req-0fcfd485-febb-46e8-80c5-64e5279ad1c3'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:43.942581 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-0fcfd485-febb-46e8-80c5-64e5279ad1c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91d71e0858414093a2e065563453454d', 'request_id': 'req-0fcfd485-febb-46e8-80c5-64e5279ad1c3'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:44.006206 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-0fcfd485-febb-46e8-80c5-64e5279ad1c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91d71e0858414093a2e065563453454d', 'request_id': 'req-0fcfd485-febb-46e8-80c5-64e5279ad1c3'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:44.066262 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-0fcfd485-febb-46e8-80c5-64e5279ad1c3 admin admin] The token cache is being invalidate because project 91d71e0858414093a2e065563453454d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:54:44.077648 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-0fcfd485-febb-46e8-80c5-64e5279ad1c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:44.077648 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-0fcfd485-febb-46e8-80c5-64e5279ad1c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:44.093422 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1065/2112] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:54:43 2022] DELETE /identity/v3/projects/91d71e0858414093a2e065563453454d => generated 0 bytes in 947 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:54:44.093422 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcfd485-febb-46e8-80c5-64e5279ad1c3 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:44.093422 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-0fcfd485-febb-46e8-80c5-64e5279ad1c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:44.148570 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b93a0-7834-445e-be27-942e99ff65c9 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:44.285751 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:44.328213 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2faa7d6-b1dc-487b-ae6e-8ae6cfada1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:44.329525 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2faa7d6-b1dc-487b-ae6e-8ae6cfada1e5 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:44.330673 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2faa7d6-b1dc-487b-ae6e-8ae6cfada1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:44.331082 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcfd485-febb-46e8-80c5-64e5279ad1c3 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:44.332207 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2faa7d6-b1dc-487b-ae6e-8ae6cfada1e5 admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:44.335392 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2faa7d6-b1dc-487b-ae6e-8ae6cfada1e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:44.339758 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2faa7d6-b1dc-487b-ae6e-8ae6cfada1e5 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:44.340392 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f573f243-4dde-4275-ac6a-01d0079d63ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:44.341427 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573f243-4dde-4275-ac6a-01d0079d63ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:44.341960 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573f243-4dde-4275-ac6a-01d0079d63ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:44.342545 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573f243-4dde-4275-ac6a-01d0079d63ba admin admin] PATH_INFO: `/v3/users/547fbde7f4034eacaaa5fec66dcc87e2` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:44.345478 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f573f243-4dde-4275-ac6a-01d0079d63ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=547fbde7f4034eacaaa5fec66dcc87e2)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:44.349497 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f573f243-4dde-4275-ac6a-01d0079d63ba admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:44.443913 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1048/2113] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:54:43 2022] POST /identity/v3/users => generated 289 bytes in 637 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:54:44.447575 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2faa7d6-b1dc-487b-ae6e-8ae6cfada1e5 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:44.451087 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-c2faa7d6-b1dc-487b-ae6e-8ae6cfada1e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:44.482970 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-f573f243-4dde-4275-ac6a-01d0079d63ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '547fbde7f4034eacaaa5fec66dcc87e2'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:44.484591 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-f573f243-4dde-4275-ac6a-01d0079d63ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '547fbde7f4034eacaaa5fec66dcc87e2'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:44.486892 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2faa7d6-b1dc-487b-ae6e-8ae6cfada1e5 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:44.487593 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-f573f243-4dde-4275-ac6a-01d0079d63ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '547fbde7f4034eacaaa5fec66dcc87e2'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:44.495498 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf45de-49d9-44c8-8ed5-c752b5e52a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:44.496863 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf45de-49d9-44c8-8ed5-c752b5e52a55 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:44.497401 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf45de-49d9-44c8-8ed5-c752b5e52a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:44.498118 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf45de-49d9-44c8-8ed5-c752b5e52a55 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:44.499381 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf45de-49d9-44c8-8ed5-c752b5e52a55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:44.503294 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf45de-49d9-44c8-8ed5-c752b5e52a55 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:44.506148 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-f573f243-4dde-4275-ac6a-01d0079d63ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '547fbde7f4034eacaaa5fec66dcc87e2'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:44.527311 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1049/2114] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:54:44.540661 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf45de-49d9-44c8-8ed5-c752b5e52a55 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:44.545124 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-f0cf45de-49d9-44c8-8ed5-c752b5e52a55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:44.558142 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-f573f243-4dde-4275-ac6a-01d0079d63ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '547fbde7f4034eacaaa5fec66dcc87e2'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:44.567534 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:44.586512 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf45de-49d9-44c8-8ed5-c752b5e52a55 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:44.592392 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1066/2115] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:54:44 2022] DELETE /identity/v3/users/547fbde7f4034eacaaa5fec66dcc87e2 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:54:44.601914 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fa24cb-df1c-44c2-ac3b-a4fedeea63ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:44.602536 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa24cb-df1c-44c2-ac3b-a4fedeea63ea admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:44.603180 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa24cb-df1c-44c2-ac3b-a4fedeea63ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:44.604882 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa24cb-df1c-44c2-ac3b-a4fedeea63ea admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:44.605803 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fa24cb-df1c-44c2-ac3b-a4fedeea63ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:44.609178 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fa24cb-df1c-44c2-ac3b-a4fedeea63ea admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:44.648561 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1050/2116] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:54:44.649523 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f573f243-4dde-4275-ac6a-01d0079d63ba admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:44.869809 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f573f243-4dde-4275-ac6a-01d0079d63ba admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:44.887085 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f67880-570c-4b76-9508-ff85433b8547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:44.889250 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f67880-570c-4b76-9508-ff85433b8547 admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:44.889250 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f67880-570c-4b76-9508-ff85433b8547 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:44.889719 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f67880-570c-4b76-9508-ff85433b8547 admin admin] PATH_INFO: `/v3/projects/ea06c8e214ac4a828a868fe79f5a50d3/users/e9d34616c67642e68b8bda2da4cb06c9/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:44.957259 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f67880-570c-4b76-9508-ff85433b8547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea06c8e214ac4a828a868fe79f5a50d3, user_id=e9d34616c67642e68b8bda2da4cb06c9, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:44.963159 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f67880-570c-4b76-9508-ff85433b8547 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:45.009401 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1067/2117] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:54:44 2022] PUT /identity/v3/projects/ea06c8e214ac4a828a868fe79f5a50d3/users/e9d34616c67642e68b8bda2da4cb06c9/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:54:45.014760 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf2bb8-2c42-4285-b4cd-92088f2da84a None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:45.015654 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf2bb8-2c42-4285-b4cd-92088f2da84a None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:45.016409 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf2bb8-2c42-4285-b4cd-92088f2da84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:45.167569 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-a7bf2bb8-2c42-4285-b4cd-92088f2da84a None None] MFA Rules not processed for user `e9d34616c67642e68b8bda2da4cb06c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:45.177310 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-a7bf2bb8-2c42-4285-b4cd-92088f2da84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:45.523045 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1051/2118] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:54:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 506 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:54:45.525572 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f67880-570c-4b76-9508-ff85433b8547 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:45.692764 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf2bb8-2c42-4285-b4cd-92088f2da84a None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:45.697495 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-a7bf2bb8-2c42-4285-b4cd-92088f2da84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:45.787894 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f67880-570c-4b76-9508-ff85433b8547 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:45.796758 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72325fdf-b01c-4a57-9f40-18b355543633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:45.798612 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72325fdf-b01c-4a57-9f40-18b355543633 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:45.799229 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72325fdf-b01c-4a57-9f40-18b355543633 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:45.799783 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72325fdf-b01c-4a57-9f40-18b355543633 admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:45.802563 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72325fdf-b01c-4a57-9f40-18b355543633 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:45.806150 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72325fdf-b01c-4a57-9f40-18b355543633 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:45.926996 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1068/2119] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:54:45 2022] POST /identity/v3/projects => generated 375 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:54:45.930582 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72325fdf-b01c-4a57-9f40-18b355543633 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:46.065332 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf2bb8-2c42-4285-b4cd-92088f2da84a None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:46.159528 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72325fdf-b01c-4a57-9f40-18b355543633 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:46.190890 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69973ec5-3d96-426c-8e99-209feda5cba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:46.192086 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69973ec5-3d96-426c-8e99-209feda5cba1 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:46.192585 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69973ec5-3d96-426c-8e99-209feda5cba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:46.193059 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69973ec5-3d96-426c-8e99-209feda5cba1 admin admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:46.195746 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69973ec5-3d96-426c-8e99-209feda5cba1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:46.202194 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69973ec5-3d96-426c-8e99-209feda5cba1 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:46.246453 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:46.254149 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:46.290950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1069/2120] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:54:45 2022] POST /identity/v3/users => generated 294 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:54:46.293871 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69973ec5-3d96-426c-8e99-209feda5cba1 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:46.326236 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69973ec5-3d96-426c-8e99-209feda5cba1 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:46.335716 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab62a885-4d51-41f4-b6b0-c4367b566f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:46.338056 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62a885-4d51-41f4-b6b0-c4367b566f8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:46.339935 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62a885-4d51-41f4-b6b0-c4367b566f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:46.339935 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab62a885-4d51-41f4-b6b0-c4367b566f8d admin admin] PATH_INFO: `/v3/projects/0c00b3627a69475fb041d612d85c93c0` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:46.345403 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d84bf9-7a7c-4d2d-935c-bfd39c944d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:46.347317 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d84bf9-7a7c-4d2d-935c-bfd39c944d20 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:46.348101 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab62a885-4d51-41f4-b6b0-c4367b566f8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c00b3627a69475fb041d612d85c93c0)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:46.350072 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d84bf9-7a7c-4d2d-935c-bfd39c944d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:46.350551 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d84bf9-7a7c-4d2d-935c-bfd39c944d20 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:46.355865 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d84bf9-7a7c-4d2d-935c-bfd39c944d20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:46.363701 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab62a885-4d51-41f4-b6b0-c4367b566f8d admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:46.367880 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d84bf9-7a7c-4d2d-935c-bfd39c944d20 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:46.417743 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1070/2121] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:54:46.419992 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d84bf9-7a7c-4d2d-935c-bfd39c944d20 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:46.472989 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d84bf9-7a7c-4d2d-935c-bfd39c944d20 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:46.495525 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec93a46-8ff1-42f5-a8c0-bd96fce55516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:46.496554 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec93a46-8ff1-42f5-a8c0-bd96fce55516 admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:46.496927 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec93a46-8ff1-42f5-a8c0-bd96fce55516 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:46.497320 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec93a46-8ff1-42f5-a8c0-bd96fce55516 admin admin] PATH_INFO: `/v3/projects/5f1e8485f1b549f5ad1f24b58c13038e/users/3574f6db486d4ca19cd6fe14e49efdde/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:46.569955 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec93a46-8ff1-42f5-a8c0-bd96fce55516 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f1e8485f1b549f5ad1f24b58c13038e, user_id=3574f6db486d4ca19cd6fe14e49efdde, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:46.578749 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec93a46-8ff1-42f5-a8c0-bd96fce55516 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:46.602058 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-ab62a885-4d51-41f4-b6b0-c4367b566f8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c00b3627a69475fb041d612d85c93c0', 'request_id': 'req-ab62a885-4d51-41f4-b6b0-c4367b566f8d'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:46.615461 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1071/2122] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:54:46 2022] PUT /identity/v3/projects/5f1e8485f1b549f5ad1f24b58c13038e/users/3574f6db486d4ca19cd6fe14e49efdde/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:54:46.620555 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-ab62a885-4d51-41f4-b6b0-c4367b566f8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c00b3627a69475fb041d612d85c93c0', 'request_id': 'req-ab62a885-4d51-41f4-b6b0-c4367b566f8d'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:46.630716 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec93a46-8ff1-42f5-a8c0-bd96fce55516 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:46.682532 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-ab62a885-4d51-41f4-b6b0-c4367b566f8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c00b3627a69475fb041d612d85c93c0', 'request_id': 'req-ab62a885-4d51-41f4-b6b0-c4367b566f8d'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:46.735024 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-ab62a885-4d51-41f4-b6b0-c4367b566f8d admin admin] The token cache is being invalidate because project 0c00b3627a69475fb041d612d85c93c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:54:46.736542 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-ab62a885-4d51-41f4-b6b0-c4367b566f8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:46.741114 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-ab62a885-4d51-41f4-b6b0-c4367b566f8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:46.747894 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1052/2123] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:54:45 2022] DELETE /identity/v3/projects/0c00b3627a69475fb041d612d85c93c0 => generated 0 bytes in 1056 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:54:46.755804 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeedc401-33d4-4c03-ac02-3ef954c8e323 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:46.756305 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeedc401-33d4-4c03-ac02-3ef954c8e323 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:46.757437 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeedc401-33d4-4c03-ac02-3ef954c8e323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:46.832487 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-aeedc401-33d4-4c03-ac02-3ef954c8e323 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:46.865959 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-aeedc401-33d4-4c03-ac02-3ef954c8e323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:46.888433 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1053/2124] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:54:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:54:46.893848 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec93a46-8ff1-42f5-a8c0-bd96fce55516 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:46.900393 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69ff61-882c-4192-bdae-6f3cabee0db9 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:46.901702 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69ff61-882c-4192-bdae-6f3cabee0db9 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:46.902439 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69ff61-882c-4192-bdae-6f3cabee0db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:46.902663 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c7c0b-55b3-43ee-a67c-c9922c61f704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:46.904316 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c7c0b-55b3-43ee-a67c-c9922c61f704 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:46.904984 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c7c0b-55b3-43ee-a67c-c9922c61f704 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:46.905631 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c7c0b-55b3-43ee-a67c-c9922c61f704 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:46.907994 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1c7c0b-55b3-43ee-a67c-c9922c61f704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:46.911786 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1c7c0b-55b3-43ee-a67c-c9922c61f704 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:46.940077 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1072/2125] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:54:46.955880 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-0c69ff61-882c-4192-bdae-6f3cabee0db9 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:46.956552 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c7c0b-55b3-43ee-a67c-c9922c61f704 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:46.958083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-0c69ff61-882c-4192-bdae-6f3cabee0db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:46.965000 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-5f1c7c0b-55b3-43ee-a67c-c9922c61f704 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:46.981057 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1054/2126] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:54:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:54:46.984474 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69ff61-882c-4192-bdae-6f3cabee0db9 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:47.006535 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c7c0b-55b3-43ee-a67c-c9922c61f704 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:47.013648 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69ff61-882c-4192-bdae-6f3cabee0db9 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:47.019671 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74617e1-951f-49fa-ae98-dadf34056a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:47.020920 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74617e1-951f-49fa-ae98-dadf34056a63 admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:47.021451 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74617e1-951f-49fa-ae98-dadf34056a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:47.022258 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74617e1-951f-49fa-ae98-dadf34056a63 admin admin] PATH_INFO: `/v3/projects/5f1e8485f1b549f5ad1f24b58c13038e/users/3574f6db486d4ca19cd6fe14e49efdde/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:47.026140 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b123ce4-25f6-40dd-bc31-fc49aac28235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:47.026453 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74617e1-951f-49fa-ae98-dadf34056a63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f1e8485f1b549f5ad1f24b58c13038e, user_id=3574f6db486d4ca19cd6fe14e49efdde, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:47.027513 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b123ce4-25f6-40dd-bc31-fc49aac28235 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:47.028356 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b123ce4-25f6-40dd-bc31-fc49aac28235 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:47.029264 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b123ce4-25f6-40dd-bc31-fc49aac28235 admin admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:47.030959 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b123ce4-25f6-40dd-bc31-fc49aac28235 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:54:47.031625 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b123ce4-25f6-40dd-bc31-fc49aac28235 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:47.031794 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74617e1-951f-49fa-ae98-dadf34056a63 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:47.035693 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b123ce4-25f6-40dd-bc31-fc49aac28235 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:47.065867 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1073/2127] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:54:46 2022] PUT /identity/v3/projects/5f1e8485f1b549f5ad1f24b58c13038e/users/3574f6db486d4ca19cd6fe14e49efdde/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:54:47.072416 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1055/2128] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 13:54:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:54:47.088575 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a1d9e-9540-42a6-9ded-af5115a85fdf None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:47.088911 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b123ce4-25f6-40dd-bc31-fc49aac28235 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:47.089197 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a1d9e-9540-42a6-9ded-af5115a85fdf None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:47.089696 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a1d9e-9540-42a6-9ded-af5115a85fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:47.109769 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b123ce4-25f6-40dd-bc31-fc49aac28235 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:47.155218 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-e98a1d9e-9540-42a6-9ded-af5115a85fdf None None] MFA Rules not processed for user `3574f6db486d4ca19cd6fe14e49efdde`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:47.160446 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-e98a1d9e-9540-42a6-9ded-af5115a85fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:47.297462 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a76ff9-74e9-40b6-b43c-9943185719a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:47.299943 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a76ff9-74e9-40b6-b43c-9943185719a1 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:47.301030 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a76ff9-74e9-40b6-b43c-9943185719a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:47.301030 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a76ff9-74e9-40b6-b43c-9943185719a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:47.302619 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a76ff9-74e9-40b6-b43c-9943185719a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:47.307638 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a76ff9-74e9-40b6-b43c-9943185719a1 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:47.396155 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1056/2129] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:54:47 2022] POST /identity/v3/projects => generated 375 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:54:47.401700 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a76ff9-74e9-40b6-b43c-9943185719a1 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:47.417623 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1074/2130] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:54:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:54:47.474981 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a1d9e-9540-42a6-9ded-af5115a85fdf None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:47.477628 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-e98a1d9e-9540-42a6-9ded-af5115a85fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:47.552432 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:47.632225 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:47.693943 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a76ff9-74e9-40b6-b43c-9943185719a1 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:47.713905 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ea592-f20d-46fb-b47e-a26169dfb6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:47.715281 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ea592-f20d-46fb-b47e-a26169dfb6d0 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:47.715743 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ea592-f20d-46fb-b47e-a26169dfb6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:47.716206 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ea592-f20d-46fb-b47e-a26169dfb6d0 admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:47.717428 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ea592-f20d-46fb-b47e-a26169dfb6d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:47.730192 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ea592-f20d-46fb-b47e-a26169dfb6d0 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:47.746915 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a1d9e-9540-42a6-9ded-af5115a85fdf None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:47.812868 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1057/2131] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:54:47 2022] POST /identity/v3/users => generated 288 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:54:47.820180 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ea592-f20d-46fb-b47e-a26169dfb6d0 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:47.869702 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ea592-f20d-46fb-b47e-a26169dfb6d0 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:47.905814 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c1efd-ba48-4b47-99cd-89c4a6dc3528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:47.907957 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c1efd-ba48-4b47-99cd-89c4a6dc3528 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:47.908808 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c1efd-ba48-4b47-99cd-89c4a6dc3528 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:47.909639 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c1efd-ba48-4b47-99cd-89c4a6dc3528 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:47.914197 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79c1efd-ba48-4b47-99cd-89c4a6dc3528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:47.921718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79c1efd-ba48-4b47-99cd-89c4a6dc3528 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:47.955076 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1058/2132] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 13:54:47.959295 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c1efd-ba48-4b47-99cd-89c4a6dc3528 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:47.969235 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f2820-5d12-4757-a0b1-9c6306060832 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:47.970679 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f2820-5d12-4757-a0b1-9c6306060832 service cinder] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:47.971210 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f2820-5d12-4757-a0b1-9c6306060832 service cinder] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:47.971659 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f2820-5d12-4757-a0b1-9c6306060832 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:47.981788 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-c38f2820-5d12-4757-a0b1-9c6306060832 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:47.995595 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c1efd-ba48-4b47-99cd-89c4a6dc3528 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:48.023513 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b604ee44-998e-489e-9a37-4d164aaba5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:48.024632 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604ee44-998e-489e-9a37-4d164aaba5ca admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:48.025147 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604ee44-998e-489e-9a37-4d164aaba5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:48.025710 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604ee44-998e-489e-9a37-4d164aaba5ca admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:48.028511 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b604ee44-998e-489e-9a37-4d164aaba5ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:48.033077 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b604ee44-998e-489e-9a37-4d164aaba5ca admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:48.084310 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1059/2133] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:54:48.087784 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b604ee44-998e-489e-9a37-4d164aaba5ca admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:48.123608 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b604ee44-998e-489e-9a37-4d164aaba5ca admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:48.136076 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad126cf1-8de2-4815-b489-350282c4d1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:48.138576 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad126cf1-8de2-4815-b489-350282c4d1be admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:48.139216 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad126cf1-8de2-4815-b489-350282c4d1be admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:48.139746 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad126cf1-8de2-4815-b489-350282c4d1be admin admin] PATH_INFO: `/v3/projects/7191d7b713374f90b510f9d8a8e56bcf/users/336c88348b7441efba0e0fe0318a23b5/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:48.176025 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad126cf1-8de2-4815-b489-350282c4d1be admin admin] RBAC: Authorizing `identity:create_grant(project_id=7191d7b713374f90b510f9d8a8e56bcf, user_id=336c88348b7441efba0e0fe0318a23b5, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:48.182451 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad126cf1-8de2-4815-b489-350282c4d1be admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:48.234785 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1060/2134] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:54:48 2022] PUT /identity/v3/projects/7191d7b713374f90b510f9d8a8e56bcf/users/336c88348b7441efba0e0fe0318a23b5/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:54:48.247283 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456423a-fa29-4ffc-a58e-be0eaf9c0f49 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:48.248888 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456423a-fa29-4ffc-a58e-be0eaf9c0f49 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:48.248888 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456423a-fa29-4ffc-a58e-be0eaf9c0f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:48.277139 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38f2820-5d12-4757-a0b1-9c6306060832 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:48.280376 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38f2820-5d12-4757-a0b1-9c6306060832 service cinder] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:48.317220 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1075/2135] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:54:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 844 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:54:48.336995 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-1456423a-fa29-4ffc-a58e-be0eaf9c0f49 None None] MFA Rules not processed for user `336c88348b7441efba0e0fe0318a23b5`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:48.340050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-1456423a-fa29-4ffc-a58e-be0eaf9c0f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:48.592462 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1061/2136] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:54:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:54:48.597291 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f2820-5d12-4757-a0b1-9c6306060832 service cinder] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:48.623851 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f2820-5d12-4757-a0b1-9c6306060832 service cinder] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:48.835691 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c71005-262c-422f-aa1d-ea0b42dd75a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:48.836870 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c71005-262c-422f-aa1d-ea0b42dd75a6 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:48.837521 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c71005-262c-422f-aa1d-ea0b42dd75a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:48.841050 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c71005-262c-422f-aa1d-ea0b42dd75a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:48.842657 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c71005-262c-422f-aa1d-ea0b42dd75a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:48.852348 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c71005-262c-422f-aa1d-ea0b42dd75a6 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:48.977237 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456423a-fa29-4ffc-a58e-be0eaf9c0f49 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:48.988069 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1076/2137] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:54:48 2022] POST /identity/v3/projects => generated 377 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:54:49.021548 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456423a-fa29-4ffc-a58e-be0eaf9c0f49 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:49.324540 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0997cda8-7868-4623-9932-e09d9a645e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:49.327710 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997cda8-7868-4623-9932-e09d9a645e98 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:49.328148 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997cda8-7868-4623-9932-e09d9a645e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:49.328564 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997cda8-7868-4623-9932-e09d9a645e98 admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:49.333043 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0997cda8-7868-4623-9932-e09d9a645e98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:49.345564 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0997cda8-7868-4623-9932-e09d9a645e98 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:49.392670 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:49.426771 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1062/2138] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:54:48 2022] POST /identity/v3/users => generated 295 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:54:49.430306 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c71005-262c-422f-aa1d-ea0b42dd75a6 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:49.501471 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c71005-262c-422f-aa1d-ea0b42dd75a6 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:49.511718 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad35f85-b2cd-4f5b-a971-916f094ef330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:49.513160 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad35f85-b2cd-4f5b-a971-916f094ef330 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:49.514094 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad35f85-b2cd-4f5b-a971-916f094ef330 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:49.514805 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad35f85-b2cd-4f5b-a971-916f094ef330 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:49.516317 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad35f85-b2cd-4f5b-a971-916f094ef330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:49.520534 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad35f85-b2cd-4f5b-a971-916f094ef330 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:49.586265 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1077/2139] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:54:49.591953 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0997cda8-7868-4623-9932-e09d9a645e98 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:49.615531 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0997cda8-7868-4623-9932-e09d9a645e98 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:49.639220 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c184c64-a481-45cc-9aa7-ead423a7574b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:49.645171 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c184c64-a481-45cc-9aa7-ead423a7574b admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:49.645743 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c184c64-a481-45cc-9aa7-ead423a7574b admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:49.648946 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c184c64-a481-45cc-9aa7-ead423a7574b admin admin] PATH_INFO: `/v3/projects/ed7455dbd038451993303440ebf3959d/users/1f40444358af4352afdcffffaa1772c4/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:49.712278 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c184c64-a481-45cc-9aa7-ead423a7574b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed7455dbd038451993303440ebf3959d, user_id=1f40444358af4352afdcffffaa1772c4, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:49.718312 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c184c64-a481-45cc-9aa7-ead423a7574b admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:49.803281 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1063/2140] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:54:49 2022] PUT /identity/v3/projects/ed7455dbd038451993303440ebf3959d/users/1f40444358af4352afdcffffaa1772c4/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:54:49.806180 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad35f85-b2cd-4f5b-a971-916f094ef330 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:49.815895 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c184c64-a481-45cc-9aa7-ead423a7574b admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:49.818676 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-2c184c64-a481-45cc-9aa7-ead423a7574b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:49.857309 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad35f85-b2cd-4f5b-a971-916f094ef330 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:49.929724 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:50.139376 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c184c64-a481-45cc-9aa7-ead423a7574b admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:50.179415 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec698f7b-bac5-4ec2-b5be-443997f6f6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:50.180365 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec698f7b-bac5-4ec2-b5be-443997f6f6b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:50.180365 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec698f7b-bac5-4ec2-b5be-443997f6f6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:50.180646 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec698f7b-bac5-4ec2-b5be-443997f6f6b7 admin admin] PATH_INFO: `/v3/users/28fef03284724efeb5d7521a6282b8b5` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:50.185855 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec698f7b-bac5-4ec2-b5be-443997f6f6b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28fef03284724efeb5d7521a6282b8b5)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:50.190645 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec698f7b-bac5-4ec2-b5be-443997f6f6b7 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:50.203658 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46433452-36a1-48e3-a538-5cd81ab0726c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:50.209500 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46433452-36a1-48e3-a538-5cd81ab0726c admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:50.209921 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46433452-36a1-48e3-a538-5cd81ab0726c admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:50.210442 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46433452-36a1-48e3-a538-5cd81ab0726c admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:50.212031 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46433452-36a1-48e3-a538-5cd81ab0726c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:50.220328 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46433452-36a1-48e3-a538-5cd81ab0726c admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:50.309639 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1078/2141] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 493 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:54:50.316303 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46433452-36a1-48e3-a538-5cd81ab0726c admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:50.358763 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46433452-36a1-48e3-a538-5cd81ab0726c admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:50.377649 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19efb0e-05b7-46b3-aab1-85a66bf1dcb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:50.379095 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19efb0e-05b7-46b3-aab1-85a66bf1dcb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:50.379649 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19efb0e-05b7-46b3-aab1-85a66bf1dcb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:50.380878 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19efb0e-05b7-46b3-aab1-85a66bf1dcb8 admin admin] PATH_INFO: `/v3/projects/ed7455dbd038451993303440ebf3959d/users/1f40444358af4352afdcffffaa1772c4/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:50.385773 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-ec698f7b-bac5-4ec2-b5be-443997f6f6b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28fef03284724efeb5d7521a6282b8b5'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:50.387309 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-ec698f7b-bac5-4ec2-b5be-443997f6f6b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28fef03284724efeb5d7521a6282b8b5'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:50.390646 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19efb0e-05b7-46b3-aab1-85a66bf1dcb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed7455dbd038451993303440ebf3959d, user_id=1f40444358af4352afdcffffaa1772c4, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:50.403774 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19efb0e-05b7-46b3-aab1-85a66bf1dcb8 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:50.422685 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-ec698f7b-bac5-4ec2-b5be-443997f6f6b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28fef03284724efeb5d7521a6282b8b5'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:50.448517 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1079/2142] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:54:50 2022] PUT /identity/v3/projects/ed7455dbd038451993303440ebf3959d/users/1f40444358af4352afdcffffaa1772c4/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:54:50.467968 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338d008-8fed-4300-a95b-e475c1b09f1e None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:50.468312 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338d008-8fed-4300-a95b-e475c1b09f1e None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:50.469991 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338d008-8fed-4300-a95b-e475c1b09f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:50.481265 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-ec698f7b-bac5-4ec2-b5be-443997f6f6b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28fef03284724efeb5d7521a6282b8b5'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:50.488651 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-ec698f7b-bac5-4ec2-b5be-443997f6f6b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28fef03284724efeb5d7521a6282b8b5'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:50.547527 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1064/2143] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:54:49 2022] DELETE /identity/v3/users/28fef03284724efeb5d7521a6282b8b5 => generated 0 bytes in 732 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:54:50.560634 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-6338d008-8fed-4300-a95b-e475c1b09f1e None None] MFA Rules not processed for user `1f40444358af4352afdcffffaa1772c4`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:50.564098 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84608ed-8a40-4cce-a126-3266641a025e None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:50.564508 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84608ed-8a40-4cce-a126-3266641a025e None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:50.564908 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84608ed-8a40-4cce-a126-3266641a025e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:50.579180 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-6338d008-8fed-4300-a95b-e475c1b09f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:50.680304 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-e84608ed-8a40-4cce-a126-3266641a025e None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:50.692376 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-e84608ed-8a40-4cce-a126-3266641a025e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:50.909467 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1080/2144] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:54:50 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 445 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:54:50.934723 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:50.953746 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338d008-8fed-4300-a95b-e475c1b09f1e None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:50.956851 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-6338d008-8fed-4300-a95b-e475c1b09f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:51.031217 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1065/2145] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:54:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:54:51.041940 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84608ed-8a40-4cce-a126-3266641a025e None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:51.045300 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-e84608ed-8a40-4cce-a126-3266641a025e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:51.229189 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338d008-8fed-4300-a95b-e475c1b09f1e None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:51.249009 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38609c-9a88-4b5b-9395-1f43fdbe385a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:51.251577 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38609c-9a88-4b5b-9395-1f43fdbe385a service cinder] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:51.252109 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38609c-9a88-4b5b-9395-1f43fdbe385a service cinder] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:51.257010 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38609c-9a88-4b5b-9395-1f43fdbe385a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:51.264451 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-ce38609c-9a88-4b5b-9395-1f43fdbe385a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:51.330354 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84608ed-8a40-4cce-a126-3266641a025e None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:51.347667 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb196fd7-97dd-4335-afa8-01c27b4bdc18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:51.348737 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb196fd7-97dd-4335-afa8-01c27b4bdc18 service cinder] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:51.349588 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb196fd7-97dd-4335-afa8-01c27b4bdc18 service cinder] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:51.350078 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb196fd7-97dd-4335-afa8-01c27b4bdc18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:51.359610 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-eb196fd7-97dd-4335-afa8-01c27b4bdc18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:51.418376 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:51.547401 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb196fd7-97dd-4335-afa8-01c27b4bdc18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:51.550207 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb196fd7-97dd-4335-afa8-01c27b4bdc18 service cinder] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:51.562181 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce38609c-9a88-4b5b-9395-1f43fdbe385a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:51.565794 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce38609c-9a88-4b5b-9395-1f43fdbe385a service cinder] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:51.567397 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1066/2146] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:54:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:54:51.568695 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb196fd7-97dd-4335-afa8-01c27b4bdc18 service cinder] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:51.570620 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-eb196fd7-97dd-4335-afa8-01c27b4bdc18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:51.637169 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1081/2147] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:54:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 681 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:54:51.816889 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb196fd7-97dd-4335-afa8-01c27b4bdc18 service cinder] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:51.830064 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb30cd5-f9b2-4c90-8173-f1fe350f0201 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:51.831513 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb30cd5-f9b2-4c90-8173-f1fe350f0201 service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:51.832057 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb30cd5-f9b2-4c90-8173-f1fe350f0201 service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:51.833942 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb30cd5-f9b2-4c90-8173-f1fe350f0201 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:51.898509 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb30cd5-f9b2-4c90-8173-f1fe350f0201 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:51.901132 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb30cd5-f9b2-4c90-8173-f1fe350f0201 service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:51.968094 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1067/2148] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:54:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:54:52.768724 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e1f6e-696f-495d-baa5-2b6c2e88f616 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:52.769661 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e1f6e-696f-495d-baa5-2b6c2e88f616 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:52.770149 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e1f6e-696f-495d-baa5-2b6c2e88f616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:52.880190 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-6b5e1f6e-696f-495d-baa5-2b6c2e88f616 None None] MFA Rules not processed for user `35b5ae01a4894129a2029fd6aa78ddc3`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:52.884090 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-6b5e1f6e-696f-495d-baa5-2b6c2e88f616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:53.161858 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1082/2149] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:54:52 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:54:53.188891 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb30cd5-f9b2-4c90-8173-f1fe350f0201 service neutron] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:53.192237 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-7bb30cd5-f9b2-4c90-8173-f1fe350f0201 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:53.427197 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:53.441537 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb30cd5-f9b2-4c90-8173-f1fe350f0201 service neutron] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:53.463137 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d24d83-bce8-4985-80d8-15fdebaa6de6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6677b4518c094636bc8ed7b588103390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:53.465418 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d24d83-bce8-4985-80d8-15fdebaa6de6 service glance] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:53.466646 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d24d83-bce8-4985-80d8-15fdebaa6de6 service glance] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:53.470086 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d24d83-bce8-4985-80d8-15fdebaa6de6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:53.486359 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-c7d24d83-bce8-4985-80d8-15fdebaa6de6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:53.680909 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e1f6e-696f-495d-baa5-2b6c2e88f616 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:53.683695 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-6b5e1f6e-696f-495d-baa5-2b6c2e88f616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:53.744224 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d24d83-bce8-4985-80d8-15fdebaa6de6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:53.748201 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d24d83-bce8-4985-80d8-15fdebaa6de6 service glance] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:53.777517 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e1f6e-696f-495d-baa5-2b6c2e88f616 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:53.796759 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1068/2150] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:54:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:54:53.815085 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7d12e-6aa6-41d0-8bb3-db33d5eb0606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:53.822301 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7d12e-6aa6-41d0-8bb3-db33d5eb0606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:53.823772 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7d12e-6aa6-41d0-8bb3-db33d5eb0606 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:53.825888 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7d12e-6aa6-41d0-8bb3-db33d5eb0606 admin admin] PATH_INFO: `/v3/projects/2e11d4c55c4140cfa93d2e041491c899` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:53.851933 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7d12e-6aa6-41d0-8bb3-db33d5eb0606 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e11d4c55c4140cfa93d2e041491c899)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:53.865412 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7d12e-6aa6-41d0-8bb3-db33d5eb0606 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:54.168021 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-08c7d12e-6aa6-41d0-8bb3-db33d5eb0606 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e11d4c55c4140cfa93d2e041491c899', 'request_id': 'req-08c7d12e-6aa6-41d0-8bb3-db33d5eb0606'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:54.187145 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-08c7d12e-6aa6-41d0-8bb3-db33d5eb0606 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e11d4c55c4140cfa93d2e041491c899', 'request_id': 'req-08c7d12e-6aa6-41d0-8bb3-db33d5eb0606'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:54.236344 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-08c7d12e-6aa6-41d0-8bb3-db33d5eb0606 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e11d4c55c4140cfa93d2e041491c899', 'request_id': 'req-08c7d12e-6aa6-41d0-8bb3-db33d5eb0606'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:54.275140 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-08c7d12e-6aa6-41d0-8bb3-db33d5eb0606 admin admin] The token cache is being invalidate because project 2e11d4c55c4140cfa93d2e041491c899 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:54:54.277241 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-08c7d12e-6aa6-41d0-8bb3-db33d5eb0606 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:54.279401 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-08c7d12e-6aa6-41d0-8bb3-db33d5eb0606 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:54.283518 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1083/2151] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:54:53 2022] DELETE /identity/v3/projects/2e11d4c55c4140cfa93d2e041491c899 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:54:54.289948 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d24d83-bce8-4985-80d8-15fdebaa6de6 service glance] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:54.343043 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d24d83-bce8-4985-80d8-15fdebaa6de6 service glance] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:54.385480 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8b469-6dd4-4791-bc9d-d3f5b9968030 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:54.386781 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8b469-6dd4-4791-bc9d-d3f5b9968030 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:54.387370 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8b469-6dd4-4791-bc9d-d3f5b9968030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:54.542330 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-24d8b469-6dd4-4791-bc9d-d3f5b9968030 None None] MFA Rules not processed for user `6d2dd101d1a14e5ab95f272ab1bbeb94`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:54.544693 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-24d8b469-6dd4-4791-bc9d-d3f5b9968030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:54.677657 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6733d2-b620-4f68-8103-0cae11d9fac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:54.683394 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6733d2-b620-4f68-8103-0cae11d9fac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:54.683882 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6733d2-b620-4f68-8103-0cae11d9fac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:54.684379 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6733d2-b620-4f68-8103-0cae11d9fac6 admin admin] PATH_INFO: `/v3/users/70f6b72a6bcd4e338289cee78112056a` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:54.707032 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6733d2-b620-4f68-8103-0cae11d9fac6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70f6b72a6bcd4e338289cee78112056a)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:54.716717 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6733d2-b620-4f68-8103-0cae11d9fac6 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:54.831620 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:54.898388 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1084/2152] 10.222.0.69 () {58 vars in 1009 bytes} [Thu Sep 8 13:54:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 524 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:54:54.924757 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d8b469-6dd4-4791-bc9d-d3f5b9968030 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:54.928155 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-24d8b469-6dd4-4791-bc9d-d3f5b9968030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:54.950668 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-3f6733d2-b620-4f68-8103-0cae11d9fac6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70f6b72a6bcd4e338289cee78112056a'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:54.966398 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-3f6733d2-b620-4f68-8103-0cae11d9fac6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70f6b72a6bcd4e338289cee78112056a'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:55.020194 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-3f6733d2-b620-4f68-8103-0cae11d9fac6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70f6b72a6bcd4e338289cee78112056a'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:55.084242 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-3f6733d2-b620-4f68-8103-0cae11d9fac6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70f6b72a6bcd4e338289cee78112056a'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:55.085353 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-3f6733d2-b620-4f68-8103-0cae11d9fac6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70f6b72a6bcd4e338289cee78112056a'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:55.169110 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d8b469-6dd4-4791-bc9d-d3f5b9968030 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:55.179240 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1069/2153] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:54:54 2022] DELETE /identity/v3/users/70f6b72a6bcd4e338289cee78112056a => generated 0 bytes in 891 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:54:55.180802 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6733d2-b620-4f68-8103-0cae11d9fac6 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:55.194624 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-3f6733d2-b620-4f68-8103-0cae11d9fac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:55.486511 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:55.488954 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc55c6-271b-44ae-9f43-ace5696c0d14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:55.495688 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc55c6-271b-44ae-9f43-ace5696c0d14 service cinder] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:55.496208 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc55c6-271b-44ae-9f43-ace5696c0d14 service cinder] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:55.496694 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc55c6-271b-44ae-9f43-ace5696c0d14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:55.529587 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-44cc55c6-271b-44ae-9f43-ace5696c0d14 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:55.718995 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6733d2-b620-4f68-8103-0cae11d9fac6 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:55.754267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3569f-9322-4659-a5ac-b13537cd78e0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9b97592a6840c3865d7dcf886221e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:55.755626 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3569f-9322-4659-a5ac-b13537cd78e0 service swift] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:55.755813 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3569f-9322-4659-a5ac-b13537cd78e0 service swift] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:55.758821 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3569f-9322-4659-a5ac-b13537cd78e0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:55.766591 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-cbf3569f-9322-4659-a5ac-b13537cd78e0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:55.893479 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cc55c6-271b-44ae-9f43-ace5696c0d14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:55.906015 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cc55c6-271b-44ae-9f43-ace5696c0d14 service cinder] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:55.943205 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf3569f-9322-4659-a5ac-b13537cd78e0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:55.949460 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf3569f-9322-4659-a5ac-b13537cd78e0 service swift] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:55.958337 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1085/2154] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:54:54 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 1051 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:54:55.984968 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1070/2155] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Sep 8 13:54:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 805 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 13:54:56.277680 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc55c6-271b-44ae-9f43-ace5696c0d14 service cinder] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:56.284031 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-44cc55c6-271b-44ae-9f43-ace5696c0d14 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:56.600163 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:56.669683 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc55c6-271b-44ae-9f43-ace5696c0d14 service cinder] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:56.693482 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ee1b4-bb8f-48cd-a22a-bc0439439a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:56.694642 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ee1b4-bb8f-48cd-a22a-bc0439439a97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:56.695113 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ee1b4-bb8f-48cd-a22a-bc0439439a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:56.697331 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ee1b4-bb8f-48cd-a22a-bc0439439a97 admin admin] PATH_INFO: `/v3/projects/145909cdd1bf41edb4ba896b2d3fadc2` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:56.704396 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ee1b4-bb8f-48cd-a22a-bc0439439a97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=145909cdd1bf41edb4ba896b2d3fadc2)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:56.708275 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ee1b4-bb8f-48cd-a22a-bc0439439a97 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:56.934799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-750ee1b4-bb8f-48cd-a22a-bc0439439a97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '145909cdd1bf41edb4ba896b2d3fadc2', 'request_id': 'req-750ee1b4-bb8f-48cd-a22a-bc0439439a97'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:56.970429 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-750ee1b4-bb8f-48cd-a22a-bc0439439a97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '145909cdd1bf41edb4ba896b2d3fadc2', 'request_id': 'req-750ee1b4-bb8f-48cd-a22a-bc0439439a97'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:56.989169 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3569f-9322-4659-a5ac-b13537cd78e0 service swift] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:56.992151 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-cbf3569f-9322-4659-a5ac-b13537cd78e0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:57.006656 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-750ee1b4-bb8f-48cd-a22a-bc0439439a97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '145909cdd1bf41edb4ba896b2d3fadc2', 'request_id': 'req-750ee1b4-bb8f-48cd-a22a-bc0439439a97'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:57.039080 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf3569f-9322-4659-a5ac-b13537cd78e0 service swift] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:57.069699 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-750ee1b4-bb8f-48cd-a22a-bc0439439a97 admin admin] The token cache is being invalidate because project 145909cdd1bf41edb4ba896b2d3fadc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:54:57.072545 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-750ee1b4-bb8f-48cd-a22a-bc0439439a97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:57.075881 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-750ee1b4-bb8f-48cd-a22a-bc0439439a97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:54:57.082840 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1086/2156] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:54:56 2022] DELETE /identity/v3/projects/145909cdd1bf41edb4ba896b2d3fadc2 => generated 0 bytes in 807 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:54:57.090821 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1744b47-75a0-4f0e-80ea-123211d528fb None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:57.093665 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1744b47-75a0-4f0e-80ea-123211d528fb None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:57.095034 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1744b47-75a0-4f0e-80ea-123211d528fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:57.168946 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-f1744b47-75a0-4f0e-80ea-123211d528fb None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:57.171882 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-f1744b47-75a0-4f0e-80ea-123211d528fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:57.374152 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413edca4-b858-46ab-bbc7-91b1c45d8f3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:57.375592 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413edca4-b858-46ab-bbc7-91b1c45d8f3f service cinder] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:57.377919 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413edca4-b858-46ab-bbc7-91b1c45d8f3f service cinder] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:57.379683 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413edca4-b858-46ab-bbc7-91b1c45d8f3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:57.389869 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-413edca4-b858-46ab-bbc7-91b1c45d8f3f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:57.514650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1087/2157] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:54:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:54:57.528394 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d22ab-a307-43c4-b0ac-cc1b5d3ce75d None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:57.528809 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d22ab-a307-43c4-b0ac-cc1b5d3ce75d None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:57.530858 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d22ab-a307-43c4-b0ac-cc1b5d3ce75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:57.609804 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-dd2d22ab-a307-43c4-b0ac-cc1b5d3ce75d None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:57.626229 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-dd2d22ab-a307-43c4-b0ac-cc1b5d3ce75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:57.654943 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413edca4-b858-46ab-bbc7-91b1c45d8f3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:57.660762 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413edca4-b858-46ab-bbc7-91b1c45d8f3f service cinder] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:57.671841 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1088/2158] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:54:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:54:57.678651 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d22ab-a307-43c4-b0ac-cc1b5d3ce75d None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:57.690131 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1071/2159] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:54:56 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 702 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:54:57.751794 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d22ab-a307-43c4-b0ac-cc1b5d3ce75d None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:57.795701 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03a530-c3d9-48e2-8bfa-80e01d823ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:57.796778 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03a530-c3d9-48e2-8bfa-80e01d823ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:57.797275 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03a530-c3d9-48e2-8bfa-80e01d823ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:57.805954 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03a530-c3d9-48e2-8bfa-80e01d823ec8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:57.807118 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03a530-c3d9-48e2-8bfa-80e01d823ec8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:54:57.807597 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03a530-c3d9-48e2-8bfa-80e01d823ec8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:57.810409 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03a530-c3d9-48e2-8bfa-80e01d823ec8 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:57.871338 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1089/2160] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 13:54:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:54:57.879282 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413edca4-b858-46ab-bbc7-91b1c45d8f3f service cinder] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:57.923982 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413edca4-b858-46ab-bbc7-91b1c45d8f3f service cinder] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:57.941347 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36c565-36ad-46b0-9a46-ec848c20c55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:57.942942 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36c565-36ad-46b0-9a46-ec848c20c55c admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:57.944427 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36c565-36ad-46b0-9a46-ec848c20c55c admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:57.944956 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36c565-36ad-46b0-9a46-ec848c20c55c admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:57.946416 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c36c565-36ad-46b0-9a46-ec848c20c55c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:57.952564 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c36c565-36ad-46b0-9a46-ec848c20c55c admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:57.993390 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:58.067300 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1072/2161] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:54:57 2022] POST /identity/v3/projects => generated 379 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:54:58.073650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03a530-c3d9-48e2-8bfa-80e01d823ec8 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:58.115209 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03a530-c3d9-48e2-8bfa-80e01d823ec8 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:58.258158 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841af7f1-9dec-4dd7-a41f-f5c2393ab119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:58.259145 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841af7f1-9dec-4dd7-a41f-f5c2393ab119 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:58.259754 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841af7f1-9dec-4dd7-a41f-f5c2393ab119 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:58.260224 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841af7f1-9dec-4dd7-a41f-f5c2393ab119 admin admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:58.263705 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841af7f1-9dec-4dd7-a41f-f5c2393ab119 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:58.268008 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841af7f1-9dec-4dd7-a41f-f5c2393ab119 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:58.291236 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:58.350426 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1090/2162] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:54:58 2022] POST /identity/v3/users => generated 290 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:54:58.356901 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36c565-36ad-46b0-9a46-ec848c20c55c admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:58.421838 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36c565-36ad-46b0-9a46-ec848c20c55c admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:58.446192 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef4fa5-b56a-473e-9fb1-2570c82f68c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:58.447434 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef4fa5-b56a-473e-9fb1-2570c82f68c1 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:58.448380 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef4fa5-b56a-473e-9fb1-2570c82f68c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:58.449043 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef4fa5-b56a-473e-9fb1-2570c82f68c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:58.463558 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ef4fa5-b56a-473e-9fb1-2570c82f68c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:58.471527 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ef4fa5-b56a-473e-9fb1-2570c82f68c1 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:58.520246 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1073/2163] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:54:58.525153 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841af7f1-9dec-4dd7-a41f-f5c2393ab119 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:58.550957 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841af7f1-9dec-4dd7-a41f-f5c2393ab119 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:58.566569 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4dcf6-e976-4961-8af0-27786691065d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:58.567382 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4dcf6-e976-4961-8af0-27786691065d admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:58.567772 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4dcf6-e976-4961-8af0-27786691065d admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:58.568160 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4dcf6-e976-4961-8af0-27786691065d admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:58.570591 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4dcf6-e976-4961-8af0-27786691065d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:58.594604 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4dcf6-e976-4961-8af0-27786691065d admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:58.651179 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1091/2164] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:54:58.656387 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef4fa5-b56a-473e-9fb1-2570c82f68c1 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:58.694403 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef4fa5-b56a-473e-9fb1-2570c82f68c1 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:58.720051 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97abd7c1-85d8-42fa-81aa-1463e31fce82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:58.733835 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abd7c1-85d8-42fa-81aa-1463e31fce82 admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:58.735102 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abd7c1-85d8-42fa-81aa-1463e31fce82 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:58.735978 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97abd7c1-85d8-42fa-81aa-1463e31fce82 admin admin] PATH_INFO: `/v3/projects/8f937642c30d466f9f2e60c4b43e9923/users/aadb2bdb48fe48f6a9d8693b22a35b35/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:58.804064 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97abd7c1-85d8-42fa-81aa-1463e31fce82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f937642c30d466f9f2e60c4b43e9923, user_id=aadb2bdb48fe48f6a9d8693b22a35b35, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:58.812555 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97abd7c1-85d8-42fa-81aa-1463e31fce82 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:58.879246 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1074/2165] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:54:58 2022] PUT /identity/v3/projects/8f937642c30d466f9f2e60c4b43e9923/users/aadb2bdb48fe48f6a9d8693b22a35b35/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:54:58.882873 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafe23e-c678-494c-b873-1ce9272255a0 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:58.883342 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafe23e-c678-494c-b873-1ce9272255a0 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:58.883828 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafe23e-c678-494c-b873-1ce9272255a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:59.017254 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-ccafe23e-c678-494c-b873-1ce9272255a0 None None] MFA Rules not processed for user `aadb2bdb48fe48f6a9d8693b22a35b35`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:54:59.024125 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-ccafe23e-c678-494c-b873-1ce9272255a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:54:59.365947 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1092/2166] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:54:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 484 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:54:59.373849 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97abd7c1-85d8-42fa-81aa-1463e31fce82 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:59.538729 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97abd7c1-85d8-42fa-81aa-1463e31fce82 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:54:59.545688 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9e712-f93d-49e0-bab6-f0deeabd9379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:54:59.547070 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9e712-f93d-49e0-bab6-f0deeabd9379 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:54:59.548357 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9e712-f93d-49e0-bab6-f0deeabd9379 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:54:59.549288 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9e712-f93d-49e0-bab6-f0deeabd9379 admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:54:59.550343 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a9e712-f93d-49e0-bab6-f0deeabd9379 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:54:59.555549 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a9e712-f93d-49e0-bab6-f0deeabd9379 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:54:59.620469 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1075/2167] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:54:59 2022] POST /identity/v3/projects => generated 379 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:54:59.628401 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccafe23e-c678-494c-b873-1ce9272255a0 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:54:59.684433 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccafe23e-c678-494c-b873-1ce9272255a0 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:00.101148 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fdbf51-d114-434c-8a3a-4a6ec70e41d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:00.102677 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fdbf51-d114-434c-8a3a-4a6ec70e41d3 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:00.105163 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fdbf51-d114-434c-8a3a-4a6ec70e41d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:00.106837 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fdbf51-d114-434c-8a3a-4a6ec70e41d3 admin admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:00.110838 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fdbf51-d114-434c-8a3a-4a6ec70e41d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:00.119283 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fdbf51-d114-434c-8a3a-4a6ec70e41d3 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:00.208900 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1093/2168] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:54:59 2022] POST /identity/v3/users => generated 296 bytes in 584 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:55:00.215503 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9e712-f93d-49e0-bab6-f0deeabd9379 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:00.291739 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9e712-f93d-49e0-bab6-f0deeabd9379 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:00.321028 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c736e0e-0870-4c7e-b7c0-c56e892acaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:00.322989 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c736e0e-0870-4c7e-b7c0-c56e892acaca admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:00.324086 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c736e0e-0870-4c7e-b7c0-c56e892acaca admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:00.324980 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c736e0e-0870-4c7e-b7c0-c56e892acaca admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:00.326538 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c736e0e-0870-4c7e-b7c0-c56e892acaca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:00.338228 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c736e0e-0870-4c7e-b7c0-c56e892acaca admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:00.395381 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1076/2169] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:55:00.401117 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fdbf51-d114-434c-8a3a-4a6ec70e41d3 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:00.472018 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fdbf51-d114-434c-8a3a-4a6ec70e41d3 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:00.516837 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5778f1c-bb3d-4594-800b-afa146a151f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:00.518095 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5778f1c-bb3d-4594-800b-afa146a151f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:00.518681 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5778f1c-bb3d-4594-800b-afa146a151f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:00.519171 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5778f1c-bb3d-4594-800b-afa146a151f8 admin admin] PATH_INFO: `/v3/projects/581166a3d4e747cc988f06920bf2fd43/users/aa6db98d3a11410099356ca6c719ce4e/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:00.566954 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5778f1c-bb3d-4594-800b-afa146a151f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=581166a3d4e747cc988f06920bf2fd43, user_id=aa6db98d3a11410099356ca6c719ce4e, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:00.576121 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5778f1c-bb3d-4594-800b-afa146a151f8 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:00.642183 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1094/2170] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:55:00 2022] PUT /identity/v3/projects/581166a3d4e747cc988f06920bf2fd43/users/aa6db98d3a11410099356ca6c719ce4e/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:55:00.648715 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c736e0e-0870-4c7e-b7c0-c56e892acaca admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:00.702147 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c736e0e-0870-4c7e-b7c0-c56e892acaca admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:01.121190 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420460c-d4fe-44da-a18c-a1d84f379a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:01.122310 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420460c-d4fe-44da-a18c-a1d84f379a04 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:01.122813 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420460c-d4fe-44da-a18c-a1d84f379a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:01.123532 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420460c-d4fe-44da-a18c-a1d84f379a04 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:01.124904 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3420460c-d4fe-44da-a18c-a1d84f379a04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:01.131116 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3420460c-d4fe-44da-a18c-a1d84f379a04 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:01.220838 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1077/2171] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 573 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:55:01.222267 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5778f1c-bb3d-4594-800b-afa146a151f8 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:01.256546 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5778f1c-bb3d-4594-800b-afa146a151f8 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:01.274284 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42fc0a5-0d67-4711-8417-90d676c29133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:01.275456 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fc0a5-0d67-4711-8417-90d676c29133 admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:01.275912 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fc0a5-0d67-4711-8417-90d676c29133 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:01.276694 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fc0a5-0d67-4711-8417-90d676c29133 admin admin] PATH_INFO: `/v3/projects/581166a3d4e747cc988f06920bf2fd43/users/aa6db98d3a11410099356ca6c719ce4e/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:01.289014 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42fc0a5-0d67-4711-8417-90d676c29133 admin admin] RBAC: Authorizing `identity:create_grant(project_id=581166a3d4e747cc988f06920bf2fd43, user_id=aa6db98d3a11410099356ca6c719ce4e, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:01.312965 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42fc0a5-0d67-4711-8417-90d676c29133 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:01.367340 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1095/2172] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:55:01 2022] PUT /identity/v3/projects/581166a3d4e747cc988f06920bf2fd43/users/aa6db98d3a11410099356ca6c719ce4e/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:55:01.393293 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651beb82-0fc2-49a2-98e4-70453a4523d5 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:01.394721 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651beb82-0fc2-49a2-98e4-70453a4523d5 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:01.395218 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651beb82-0fc2-49a2-98e4-70453a4523d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:01.574663 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-651beb82-0fc2-49a2-98e4-70453a4523d5 None None] MFA Rules not processed for user `aa6db98d3a11410099356ca6c719ce4e`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:01.577970 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-651beb82-0fc2-49a2-98e4-70453a4523d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:01.699195 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:02.078448 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1078/2173] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:55:01 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 688 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:55:02.106742 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42fc0a5-0d67-4711-8417-90d676c29133 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:02.112473 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-c42fc0a5-0d67-4711-8417-90d676c29133 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:02.313933 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:02.507075 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42fc0a5-0d67-4711-8417-90d676c29133 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:02.518840 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0149bf-022a-4058-86ae-4df3933f720b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:02.521151 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0149bf-022a-4058-86ae-4df3933f720b service cinder] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:02.522736 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0149bf-022a-4058-86ae-4df3933f720b service cinder] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:02.523811 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0149bf-022a-4058-86ae-4df3933f720b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:02.847713 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0149bf-022a-4058-86ae-4df3933f720b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:02.862984 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0149bf-022a-4058-86ae-4df3933f720b service cinder] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:02.897104 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1096/2174] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:55:02 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 791 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:55:03.230602 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651beb82-0fc2-49a2-98e4-70453a4523d5 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:03.234095 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-651beb82-0fc2-49a2-98e4-70453a4523d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:03.675449 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651beb82-0fc2-49a2-98e4-70453a4523d5 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:03.689890 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069bb614-ac3c-4f19-94af-4cd3eb32bdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:03.690929 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069bb614-ac3c-4f19-94af-4cd3eb32bdcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:03.691350 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069bb614-ac3c-4f19-94af-4cd3eb32bdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:03.691722 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069bb614-ac3c-4f19-94af-4cd3eb32bdcd admin admin] PATH_INFO: `/v3/users/585813988a8c456bb3d41b9587c65801` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:03.696228 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069bb614-ac3c-4f19-94af-4cd3eb32bdcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=585813988a8c456bb3d41b9587c65801)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:03.700139 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069bb614-ac3c-4f19-94af-4cd3eb32bdcd admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:03.994262 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-069bb614-ac3c-4f19-94af-4cd3eb32bdcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '585813988a8c456bb3d41b9587c65801'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:03.996319 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-069bb614-ac3c-4f19-94af-4cd3eb32bdcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '585813988a8c456bb3d41b9587c65801'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:04.070553 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-069bb614-ac3c-4f19-94af-4cd3eb32bdcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '585813988a8c456bb3d41b9587c65801'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:04.241885 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-069bb614-ac3c-4f19-94af-4cd3eb32bdcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '585813988a8c456bb3d41b9587c65801'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:04.245099 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-069bb614-ac3c-4f19-94af-4cd3eb32bdcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '585813988a8c456bb3d41b9587c65801'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:04.322117 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9304b8a-dc80-4fbd-b81f-d1f2ac9c9122 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:04.323622 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9304b8a-dc80-4fbd-b81f-d1f2ac9c9122 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:04.324363 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9304b8a-dc80-4fbd-b81f-d1f2ac9c9122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:04.338145 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1079/2175] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:55:03 2022] DELETE /identity/v3/users/585813988a8c456bb3d41b9587c65801 => generated 0 bytes in 1086 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:55:04.410219 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-e9304b8a-dc80-4fbd-b81f-d1f2ac9c9122 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:04.416125 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-e9304b8a-dc80-4fbd-b81f-d1f2ac9c9122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:04.712773 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1097/2176] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:55:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:55:04.772916 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069bb614-ac3c-4f19-94af-4cd3eb32bdcd admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:04.776251 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-069bb614-ac3c-4f19-94af-4cd3eb32bdcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:04.997173 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:05.148240 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069bb614-ac3c-4f19-94af-4cd3eb32bdcd admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:05.192841 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0666bd4-6bd7-4032-a9de-10eb40e80dfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:05.196917 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0666bd4-6bd7-4032-a9de-10eb40e80dfd service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:05.201981 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0666bd4-6bd7-4032-a9de-10eb40e80dfd service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:05.207328 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0666bd4-6bd7-4032-a9de-10eb40e80dfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:05.293310 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0666bd4-6bd7-4032-a9de-10eb40e80dfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:05.310238 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0666bd4-6bd7-4032-a9de-10eb40e80dfd service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:05.334517 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9304b8a-dc80-4fbd-b81f-d1f2ac9c9122 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:05.340056 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-e9304b8a-dc80-4fbd-b81f-d1f2ac9c9122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:05.404022 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1080/2177] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:55:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:55:05.564878 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9304b8a-dc80-4fbd-b81f-d1f2ac9c9122 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:05.586283 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e84fb-2b66-4ad3-9213-2af55a5132bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:05.589985 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e84fb-2b66-4ad3-9213-2af55a5132bc service cinder] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:05.590696 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e84fb-2b66-4ad3-9213-2af55a5132bc service cinder] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:05.591157 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e84fb-2b66-4ad3-9213-2af55a5132bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:05.595413 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-8e1e84fb-2b66-4ad3-9213-2af55a5132bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:05.759226 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:05.855995 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e84fb-2b66-4ad3-9213-2af55a5132bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:05.863871 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e84fb-2b66-4ad3-9213-2af55a5132bc service cinder] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:05.902558 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1098/2178] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:55:05 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:55:07.142479 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0666bd4-6bd7-4032-a9de-10eb40e80dfd service neutron] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:07.145644 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-f0666bd4-6bd7-4032-a9de-10eb40e80dfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:07.169880 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0666bd4-6bd7-4032-a9de-10eb40e80dfd service neutron] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:07.176306 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bcf8ca-cb9f-4b28-975c-82d19f751b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:07.177737 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcf8ca-cb9f-4b28-975c-82d19f751b5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:07.178496 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcf8ca-cb9f-4b28-975c-82d19f751b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:07.178996 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bcf8ca-cb9f-4b28-975c-82d19f751b5c admin admin] PATH_INFO: `/v3/projects/67263b933a124d059be167e71e466cc5` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:07.180530 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bcf8ca-cb9f-4b28-975c-82d19f751b5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=67263b933a124d059be167e71e466cc5)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:07.183285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bcf8ca-cb9f-4b28-975c-82d19f751b5c admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:07.306137 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-32bcf8ca-cb9f-4b28-975c-82d19f751b5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67263b933a124d059be167e71e466cc5', 'request_id': 'req-32bcf8ca-cb9f-4b28-975c-82d19f751b5c'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:07.320841 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-32bcf8ca-cb9f-4b28-975c-82d19f751b5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67263b933a124d059be167e71e466cc5', 'request_id': 'req-32bcf8ca-cb9f-4b28-975c-82d19f751b5c'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:07.335579 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-32bcf8ca-cb9f-4b28-975c-82d19f751b5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67263b933a124d059be167e71e466cc5', 'request_id': 'req-32bcf8ca-cb9f-4b28-975c-82d19f751b5c'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:07.371271 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-32bcf8ca-cb9f-4b28-975c-82d19f751b5c admin admin] The token cache is being invalidate because project 67263b933a124d059be167e71e466cc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:55:07.372315 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-32bcf8ca-cb9f-4b28-975c-82d19f751b5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:07.373964 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-32bcf8ca-cb9f-4b28-975c-82d19f751b5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:07.379706 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1081/2179] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:55:07 2022] DELETE /identity/v3/projects/67263b933a124d059be167e71e466cc5 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:55:07.385211 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e84fb-2b66-4ad3-9213-2af55a5132bc service cinder] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:07.414135 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e84fb-2b66-4ad3-9213-2af55a5132bc service cinder] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:07.582764 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136c839a-2630-4988-8bd2-1398847bebbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:07.583489 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c839a-2630-4988-8bd2-1398847bebbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:07.583796 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c839a-2630-4988-8bd2-1398847bebbb admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:07.584060 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136c839a-2630-4988-8bd2-1398847bebbb admin admin] PATH_INFO: `/v3/users/e9d34616c67642e68b8bda2da4cb06c9` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:07.585538 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136c839a-2630-4988-8bd2-1398847bebbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9d34616c67642e68b8bda2da4cb06c9)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:07.587907 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136c839a-2630-4988-8bd2-1398847bebbb admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:07.835381 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-136c839a-2630-4988-8bd2-1398847bebbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9d34616c67642e68b8bda2da4cb06c9'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:07.836804 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-136c839a-2630-4988-8bd2-1398847bebbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9d34616c67642e68b8bda2da4cb06c9'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:07.837821 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-136c839a-2630-4988-8bd2-1398847bebbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9d34616c67642e68b8bda2da4cb06c9'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:07.882116 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-136c839a-2630-4988-8bd2-1398847bebbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9d34616c67642e68b8bda2da4cb06c9'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:07.885503 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad70d41-d7ab-4965-860f-cd569d0a8c24 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:07.886194 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad70d41-d7ab-4965-860f-cd569d0a8c24 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:07.886692 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad70d41-d7ab-4965-860f-cd569d0a8c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:08.002181 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-136c839a-2630-4988-8bd2-1398847bebbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9d34616c67642e68b8bda2da4cb06c9'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:08.007231 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-4ad70d41-d7ab-4965-860f-cd569d0a8c24 None None] MFA Rules not processed for user `75cd9652625a4935a9af31bd4549ccf1`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:08.011381 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-4ad70d41-d7ab-4965-860f-cd569d0a8c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:08.092699 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1099/2180] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:55:07 2022] DELETE /identity/v3/users/e9d34616c67642e68b8bda2da4cb06c9 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:55:08.343354 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1082/2181] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:55:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:55:08.879818 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136c839a-2630-4988-8bd2-1398847bebbb admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:08.882381 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-136c839a-2630-4988-8bd2-1398847bebbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:09.101997 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:09.207521 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136c839a-2630-4988-8bd2-1398847bebbb admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:09.218066 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37080dd9-73ac-4e3f-a5c1-8d129f782e83 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733797f12a1741e1a55332991e867aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:09.219802 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37080dd9-73ac-4e3f-a5c1-8d129f782e83 service placement] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:09.220111 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37080dd9-73ac-4e3f-a5c1-8d129f782e83 service placement] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:09.220811 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37080dd9-73ac-4e3f-a5c1-8d129f782e83 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:09.225534 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-37080dd9-73ac-4e3f-a5c1-8d129f782e83 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:09.279291 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad70d41-d7ab-4965-860f-cd569d0a8c24 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:09.282539 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-4ad70d41-d7ab-4965-860f-cd569d0a8c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:09.294252 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37080dd9-73ac-4e3f-a5c1-8d129f782e83 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:09.298110 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37080dd9-73ac-4e3f-a5c1-8d129f782e83 service placement] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:09.310991 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad70d41-d7ab-4965-860f-cd569d0a8c24 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:09.336336 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1100/2182] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:55:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:55:09.408802 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f4b4c-2668-4caf-aeb9-30b3a718a001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:09.410310 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f4b4c-2668-4caf-aeb9-30b3a718a001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:09.410748 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f4b4c-2668-4caf-aeb9-30b3a718a001 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:09.411167 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566f4b4c-2668-4caf-aeb9-30b3a718a001 admin admin] PATH_INFO: `/v3/projects/ea06c8e214ac4a828a868fe79f5a50d3` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:09.425927 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566f4b4c-2668-4caf-aeb9-30b3a718a001 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea06c8e214ac4a828a868fe79f5a50d3)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:09.429960 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566f4b4c-2668-4caf-aeb9-30b3a718a001 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:09.435395 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:09.592003 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-566f4b4c-2668-4caf-aeb9-30b3a718a001 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea06c8e214ac4a828a868fe79f5a50d3', 'request_id': 'req-566f4b4c-2668-4caf-aeb9-30b3a718a001'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:09.614770 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-566f4b4c-2668-4caf-aeb9-30b3a718a001 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea06c8e214ac4a828a868fe79f5a50d3', 'request_id': 'req-566f4b4c-2668-4caf-aeb9-30b3a718a001'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:09.642458 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-566f4b4c-2668-4caf-aeb9-30b3a718a001 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea06c8e214ac4a828a868fe79f5a50d3', 'request_id': 'req-566f4b4c-2668-4caf-aeb9-30b3a718a001'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:09.674278 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-566f4b4c-2668-4caf-aeb9-30b3a718a001 admin admin] The token cache is being invalidate because project ea06c8e214ac4a828a868fe79f5a50d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:55:09.674853 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-566f4b4c-2668-4caf-aeb9-30b3a718a001 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:09.676416 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-566f4b4c-2668-4caf-aeb9-30b3a718a001 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:09.684408 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1083/2183] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:55:09 2022] DELETE /identity/v3/projects/ea06c8e214ac4a828a868fe79f5a50d3 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:55:09.685848 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37080dd9-73ac-4e3f-a5c1-8d129f782e83 service placement] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:09.720884 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37080dd9-73ac-4e3f-a5c1-8d129f782e83 service placement] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:09.864624 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2d0c2a-151c-4d4d-8842-5695b560072e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:09.865850 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d0c2a-151c-4d4d-8842-5695b560072e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:09.866378 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d0c2a-151c-4d4d-8842-5695b560072e admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:09.866806 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d0c2a-151c-4d4d-8842-5695b560072e admin admin] PATH_INFO: `/v3/users/3574f6db486d4ca19cd6fe14e49efdde` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:09.868282 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2d0c2a-151c-4d4d-8842-5695b560072e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3574f6db486d4ca19cd6fe14e49efdde)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:09.871023 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2d0c2a-151c-4d4d-8842-5695b560072e admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:10.038334 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-bb2d0c2a-151c-4d4d-8842-5695b560072e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3574f6db486d4ca19cd6fe14e49efdde'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:10.039628 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-bb2d0c2a-151c-4d4d-8842-5695b560072e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3574f6db486d4ca19cd6fe14e49efdde'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:10.040794 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-bb2d0c2a-151c-4d4d-8842-5695b560072e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3574f6db486d4ca19cd6fe14e49efdde'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:10.066738 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-bb2d0c2a-151c-4d4d-8842-5695b560072e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3574f6db486d4ca19cd6fe14e49efdde'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:10.136825 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-bb2d0c2a-151c-4d4d-8842-5695b560072e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3574f6db486d4ca19cd6fe14e49efdde'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:10.226173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1101/2184] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:55:09 2022] DELETE /identity/v3/users/3574f6db486d4ca19cd6fe14e49efdde => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:55:11.549992 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f4b4c-2668-4caf-aeb9-30b3a718a001 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:11.560180 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-566f4b4c-2668-4caf-aeb9-30b3a718a001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:11.613045 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566f4b4c-2668-4caf-aeb9-30b3a718a001 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:11.765184 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0533941c-0722-4b7a-a9fc-a60f7cfbf60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:11.767800 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533941c-0722-4b7a-a9fc-a60f7cfbf60c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:11.767800 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533941c-0722-4b7a-a9fc-a60f7cfbf60c admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:11.768864 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533941c-0722-4b7a-a9fc-a60f7cfbf60c admin admin] PATH_INFO: `/v3/projects/5f1e8485f1b549f5ad1f24b58c13038e` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:11.771411 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0533941c-0722-4b7a-a9fc-a60f7cfbf60c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f1e8485f1b549f5ad1f24b58c13038e)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:11.776125 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0533941c-0722-4b7a-a9fc-a60f7cfbf60c admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:11.934975 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-0533941c-0722-4b7a-a9fc-a60f7cfbf60c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f1e8485f1b549f5ad1f24b58c13038e', 'request_id': 'req-0533941c-0722-4b7a-a9fc-a60f7cfbf60c'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:11.959650 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-0533941c-0722-4b7a-a9fc-a60f7cfbf60c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f1e8485f1b549f5ad1f24b58c13038e', 'request_id': 'req-0533941c-0722-4b7a-a9fc-a60f7cfbf60c'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:11.991707 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-0533941c-0722-4b7a-a9fc-a60f7cfbf60c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f1e8485f1b549f5ad1f24b58c13038e', 'request_id': 'req-0533941c-0722-4b7a-a9fc-a60f7cfbf60c'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:12.025205 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-0533941c-0722-4b7a-a9fc-a60f7cfbf60c admin admin] The token cache is being invalidate because project 5f1e8485f1b549f5ad1f24b58c13038e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:55:12.027011 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-0533941c-0722-4b7a-a9fc-a60f7cfbf60c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:12.031807 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-0533941c-0722-4b7a-a9fc-a60f7cfbf60c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:12.035791 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1084/2185] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:55:11 2022] DELETE /identity/v3/projects/5f1e8485f1b549f5ad1f24b58c13038e => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:55:12.045096 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496788f4-723c-4e6f-8bd5-53a2cd97c0d0 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:12.050377 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496788f4-723c-4e6f-8bd5-53a2cd97c0d0 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:12.052076 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496788f4-723c-4e6f-8bd5-53a2cd97c0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:12.116469 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-496788f4-723c-4e6f-8bd5-53a2cd97c0d0 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:12.118605 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-496788f4-723c-4e6f-8bd5-53a2cd97c0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:12.264096 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:12.301134 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1102/2186] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:55:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:55:12.303025 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17f902-b233-41b1-8f71-6060f6631602 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:12.303344 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17f902-b233-41b1-8f71-6060f6631602 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:12.303583 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17f902-b233-41b1-8f71-6060f6631602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:12.368385 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496788f4-723c-4e6f-8bd5-53a2cd97c0d0 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:12.368729 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-bc17f902-b233-41b1-8f71-6060f6631602 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:12.370961 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-496788f4-723c-4e6f-8bd5-53a2cd97c0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:12.371936 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-bc17f902-b233-41b1-8f71-6060f6631602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:12.390516 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1085/2187] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:55:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:55:12.393538 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17f902-b233-41b1-8f71-6060f6631602 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:12.413851 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496788f4-723c-4e6f-8bd5-53a2cd97c0d0 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:12.433170 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17f902-b233-41b1-8f71-6060f6631602 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:12.439917 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dffd44-3da3-41ed-95a3-fec349da07a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:12.440896 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dffd44-3da3-41ed-95a3-fec349da07a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:12.441553 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dffd44-3da3-41ed-95a3-fec349da07a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:12.442013 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dffd44-3da3-41ed-95a3-fec349da07a5 admin admin] PATH_INFO: `/v3/users/aadb2bdb48fe48f6a9d8693b22a35b35` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:12.444755 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dffd44-3da3-41ed-95a3-fec349da07a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aadb2bdb48fe48f6a9d8693b22a35b35)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:12.450592 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dffd44-3da3-41ed-95a3-fec349da07a5 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:12.454767 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1ff08-1782-4b70-8dd8-c2f2a3c40dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:12.455791 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1ff08-1782-4b70-8dd8-c2f2a3c40dec admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:12.456115 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1ff08-1782-4b70-8dd8-c2f2a3c40dec admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:12.456657 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1ff08-1782-4b70-8dd8-c2f2a3c40dec admin admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:12.457930 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd1ff08-1782-4b70-8dd8-c2f2a3c40dec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:55:12.478101 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd1ff08-1782-4b70-8dd8-c2f2a3c40dec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:12.481615 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd1ff08-1782-4b70-8dd8-c2f2a3c40dec admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:12.539795 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1086/2188] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 13:55:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:55:12.551551 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1ff08-1782-4b70-8dd8-c2f2a3c40dec admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:12.578777 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:12.617605 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1ff08-1782-4b70-8dd8-c2f2a3c40dec admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:12.649738 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff546a95-2f1d-4bb4-9ab9-d2b86cf6d299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:12.650883 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff546a95-2f1d-4bb4-9ab9-d2b86cf6d299 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:12.651380 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff546a95-2f1d-4bb4-9ab9-d2b86cf6d299 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:12.651682 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-30dffd44-3da3-41ed-95a3-fec349da07a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aadb2bdb48fe48f6a9d8693b22a35b35'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:12.651843 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff546a95-2f1d-4bb4-9ab9-d2b86cf6d299 admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:12.653091 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff546a95-2f1d-4bb4-9ab9-d2b86cf6d299 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:12.654380 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-30dffd44-3da3-41ed-95a3-fec349da07a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aadb2bdb48fe48f6a9d8693b22a35b35'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:12.657136 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff546a95-2f1d-4bb4-9ab9-d2b86cf6d299 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:12.657803 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-30dffd44-3da3-41ed-95a3-fec349da07a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aadb2bdb48fe48f6a9d8693b22a35b35'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:12.685616 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-30dffd44-3da3-41ed-95a3-fec349da07a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aadb2bdb48fe48f6a9d8693b22a35b35'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:12.746050 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-30dffd44-3da3-41ed-95a3-fec349da07a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aadb2bdb48fe48f6a9d8693b22a35b35'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:12.815858 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1103/2189] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:55:12 2022] DELETE /identity/v3/users/aadb2bdb48fe48f6a9d8693b22a35b35 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:55:12.818425 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d0f86-09f3-4869-836a-d864ce9b1448 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:12.819141 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d0f86-09f3-4869-836a-d864ce9b1448 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:12.820032 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d0f86-09f3-4869-836a-d864ce9b1448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:12.835150 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1087/2190] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:55:12 2022] POST /identity/v3/projects => generated 385 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:55:12.838568 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff546a95-2f1d-4bb4-9ab9-d2b86cf6d299 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:12.844563 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-ff546a95-2f1d-4bb4-9ab9-d2b86cf6d299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:12.879270 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-b95d0f86-09f3-4869-836a-d864ce9b1448 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:12.883676 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-b95d0f86-09f3-4869-836a-d864ce9b1448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:13.116458 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff546a95-2f1d-4bb4-9ab9-d2b86cf6d299 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:13.128878 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b7aeb-2286-4afe-ae25-4b4052a19db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:13.130082 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b7aeb-2286-4afe-ae25-4b4052a19db8 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:13.130980 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b7aeb-2286-4afe-ae25-4b4052a19db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:13.132331 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1104/2191] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:55:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:55:13.133203 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b7aeb-2286-4afe-ae25-4b4052a19db8 admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:13.134521 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b7aeb-2286-4afe-ae25-4b4052a19db8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:13.139379 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b7aeb-2286-4afe-ae25-4b4052a19db8 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:13.147198 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d0f86-09f3-4869-836a-d864ce9b1448 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:13.149006 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-b95d0f86-09f3-4869-836a-d864ce9b1448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:13.242680 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1088/2192] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:55:12 2022] POST /identity/v3/users => generated 293 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:55:13.256927 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b7aeb-2286-4afe-ae25-4b4052a19db8 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:13.287050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b7aeb-2286-4afe-ae25-4b4052a19db8 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:13.315192 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5db093-c921-421c-a823-7c1321b3d191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:13.316333 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5db093-c921-421c-a823-7c1321b3d191 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:13.317185 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5db093-c921-421c-a823-7c1321b3d191 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:13.317185 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5db093-c921-421c-a823-7c1321b3d191 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:13.318445 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5db093-c921-421c-a823-7c1321b3d191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:13.322202 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5db093-c921-421c-a823-7c1321b3d191 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:13.373406 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1089/2193] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:55:13.386170 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5db093-c921-421c-a823-7c1321b3d191 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:13.414501 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5db093-c921-421c-a823-7c1321b3d191 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:13.426608 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0ae0f-afda-4325-a2e7-6917e8f23d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:13.427632 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0ae0f-afda-4325-a2e7-6917e8f23d74 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:13.428061 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0ae0f-afda-4325-a2e7-6917e8f23d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:13.428640 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0ae0f-afda-4325-a2e7-6917e8f23d74 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:13.429880 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a0ae0f-afda-4325-a2e7-6917e8f23d74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:13.432988 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a0ae0f-afda-4325-a2e7-6917e8f23d74 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:13.472859 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1090/2194] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 13:55:13.477858 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0ae0f-afda-4325-a2e7-6917e8f23d74 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:13.498251 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0ae0f-afda-4325-a2e7-6917e8f23d74 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:13.509183 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35271ba-aa6d-4be6-9a71-7d5b50ec8107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:13.510215 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35271ba-aa6d-4be6-9a71-7d5b50ec8107 admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:13.510771 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35271ba-aa6d-4be6-9a71-7d5b50ec8107 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:13.511365 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35271ba-aa6d-4be6-9a71-7d5b50ec8107 admin admin] PATH_INFO: `/v3/projects/c04a6b38c229429b87ab7b0fe1d88510/users/4a5258f5786c4e55b7da8bae76ae8749/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:13.525134 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d0f86-09f3-4869-836a-d864ce9b1448 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:13.548680 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd0cc0-007b-43ac-b443-ebb60063c00d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:13.550120 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd0cc0-007b-43ac-b443-ebb60063c00d service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:13.550690 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35271ba-aa6d-4be6-9a71-7d5b50ec8107 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c04a6b38c229429b87ab7b0fe1d88510, user_id=4a5258f5786c4e55b7da8bae76ae8749, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:13.555144 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd0cc0-007b-43ac-b443-ebb60063c00d service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:13.556099 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd0cc0-007b-43ac-b443-ebb60063c00d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:13.557324 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35271ba-aa6d-4be6-9a71-7d5b50ec8107 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:13.609067 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd0cc0-007b-43ac-b443-ebb60063c00d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:13.611737 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd0cc0-007b-43ac-b443-ebb60063c00d service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:13.643923 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1091/2195] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:55:13 2022] PUT /identity/v3/projects/c04a6b38c229429b87ab7b0fe1d88510/users/4a5258f5786c4e55b7da8bae76ae8749/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:55:13.660227 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f351050-0eab-4457-b57b-0efe1ff844ed None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:13.660757 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f351050-0eab-4457-b57b-0efe1ff844ed None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:13.661828 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f351050-0eab-4457-b57b-0efe1ff844ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:13.669517 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1105/2196] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:55:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:55:13.740972 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-5f351050-0eab-4457-b57b-0efe1ff844ed None None] MFA Rules not processed for user `4a5258f5786c4e55b7da8bae76ae8749`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:13.742663 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-5f351050-0eab-4457-b57b-0efe1ff844ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:14.078023 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1092/2197] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:55:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:55:14.078915 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd0cc0-007b-43ac-b443-ebb60063c00d service neutron] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:14.150191 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd0cc0-007b-43ac-b443-ebb60063c00d service neutron] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:14.261063 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:14.598406 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df8eb7-e639-4b84-ad3f-5b4b60695eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:14.613793 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df8eb7-e639-4b84-ad3f-5b4b60695eef admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:14.616352 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df8eb7-e639-4b84-ad3f-5b4b60695eef admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:14.616886 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df8eb7-e639-4b84-ad3f-5b4b60695eef admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:14.618150 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df8eb7-e639-4b84-ad3f-5b4b60695eef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:14.631671 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df8eb7-e639-4b84-ad3f-5b4b60695eef admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:14.778034 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1106/2198] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:55:14 2022] POST /identity/v3/projects => generated 383 bytes in 701 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:55:14.784995 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f351050-0eab-4457-b57b-0efe1ff844ed None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:14.852633 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f351050-0eab-4457-b57b-0efe1ff844ed None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:14.892681 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:15.104336 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189dbb59-9d12-4a33-994b-046561245a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:15.134635 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189dbb59-9d12-4a33-994b-046561245a61 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:15.138802 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189dbb59-9d12-4a33-994b-046561245a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:15.139527 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189dbb59-9d12-4a33-994b-046561245a61 admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:15.140670 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189dbb59-9d12-4a33-994b-046561245a61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:15.162299 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189dbb59-9d12-4a33-994b-046561245a61 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:15.263344 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df8eb7-e639-4b84-ad3f-5b4b60695eef admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:15.269434 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-b7df8eb7-e639-4b84-ad3f-5b4b60695eef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:15.290606 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1093/2199] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:55:14 2022] POST /identity/v3/users => generated 292 bytes in 500 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:55:15.292354 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189dbb59-9d12-4a33-994b-046561245a61 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:15.325599 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df8eb7-e639-4b84-ad3f-5b4b60695eef admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:15.342406 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed9115-2737-4b94-8e03-869133507b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:15.348850 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed9115-2737-4b94-8e03-869133507b6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:15.350077 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed9115-2737-4b94-8e03-869133507b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:15.350680 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed9115-2737-4b94-8e03-869133507b6c admin admin] PATH_INFO: `/v3/projects/8f937642c30d466f9f2e60c4b43e9923` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:15.353346 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed9115-2737-4b94-8e03-869133507b6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f937642c30d466f9f2e60c4b43e9923)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:15.357840 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed9115-2737-4b94-8e03-869133507b6c admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:15.360416 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189dbb59-9d12-4a33-994b-046561245a61 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:15.415719 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe426c-99d5-48e3-83c9-d86812caedec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:15.419975 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe426c-99d5-48e3-83c9-d86812caedec admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:15.421519 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe426c-99d5-48e3-83c9-d86812caedec admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:15.423815 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe426c-99d5-48e3-83c9-d86812caedec admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:15.436257 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe426c-99d5-48e3-83c9-d86812caedec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:15.446472 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe426c-99d5-48e3-83c9-d86812caedec admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:15.506853 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1094/2200] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:55:15.517116 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe426c-99d5-48e3-83c9-d86812caedec admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:15.586505 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe426c-99d5-48e3-83c9-d86812caedec admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:15.667631 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-c9ed9115-2737-4b94-8e03-869133507b6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f937642c30d466f9f2e60c4b43e9923', 'request_id': 'req-c9ed9115-2737-4b94-8e03-869133507b6c'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:15.702985 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-c9ed9115-2737-4b94-8e03-869133507b6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f937642c30d466f9f2e60c4b43e9923', 'request_id': 'req-c9ed9115-2737-4b94-8e03-869133507b6c'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:15.754246 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-c9ed9115-2737-4b94-8e03-869133507b6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f937642c30d466f9f2e60c4b43e9923', 'request_id': 'req-c9ed9115-2737-4b94-8e03-869133507b6c'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:15.803205 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-c9ed9115-2737-4b94-8e03-869133507b6c admin admin] The token cache is being invalidate because project 8f937642c30d466f9f2e60c4b43e9923 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:55:15.804107 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-c9ed9115-2737-4b94-8e03-869133507b6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:15.807569 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-c9ed9115-2737-4b94-8e03-869133507b6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:15.816989 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1107/2201] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:55:15 2022] DELETE /identity/v3/projects/8f937642c30d466f9f2e60c4b43e9923 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:55:15.823000 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed9115-2737-4b94-8e03-869133507b6c admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:15.826756 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-c9ed9115-2737-4b94-8e03-869133507b6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:15.888831 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b47c03-e7ce-423c-a2a2-d744ed1329c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:15.893882 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b47c03-e7ce-423c-a2a2-d744ed1329c1 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:15.894678 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b47c03-e7ce-423c-a2a2-d744ed1329c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:15.895231 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b47c03-e7ce-423c-a2a2-d744ed1329c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:15.896624 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b47c03-e7ce-423c-a2a2-d744ed1329c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:15.905050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b47c03-e7ce-423c-a2a2-d744ed1329c1 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:16.003185 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1095/2202] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 492 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:55:16.009225 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b47c03-e7ce-423c-a2a2-d744ed1329c1 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:16.033118 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-61b47c03-e7ce-423c-a2a2-d744ed1329c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:16.066383 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed9115-2737-4b94-8e03-869133507b6c admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:16.093155 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585a2f8-cd4a-4e97-baa5-b648231ad79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:16.095322 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585a2f8-cd4a-4e97-baa5-b648231ad79a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:16.098293 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585a2f8-cd4a-4e97-baa5-b648231ad79a admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:16.099379 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585a2f8-cd4a-4e97-baa5-b648231ad79a admin admin] PATH_INFO: `/v3/users/aa6db98d3a11410099356ca6c719ce4e` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:16.107292 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585a2f8-cd4a-4e97-baa5-b648231ad79a admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa6db98d3a11410099356ca6c719ce4e)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:16.116278 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585a2f8-cd4a-4e97-baa5-b648231ad79a admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:16.143926 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b47c03-e7ce-423c-a2a2-d744ed1329c1 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:16.160885 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48932c0b-0692-4f20-9f22-ca81303cd0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:16.162708 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48932c0b-0692-4f20-9f22-ca81303cd0cc admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:16.163569 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48932c0b-0692-4f20-9f22-ca81303cd0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:16.164344 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48932c0b-0692-4f20-9f22-ca81303cd0cc admin admin] PATH_INFO: `/v3/projects/c8305a7fdfd54f289b8eca99bbbcf43d/users/df0df50059b241dba2b488023a40a8f0/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:16.241809 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48932c0b-0692-4f20-9f22-ca81303cd0cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8305a7fdfd54f289b8eca99bbbcf43d, user_id=df0df50059b241dba2b488023a40a8f0, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:16.267906 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48932c0b-0692-4f20-9f22-ca81303cd0cc admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:16.305924 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:16.368234 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1096/2203] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:55:16 2022] PUT /identity/v3/projects/c8305a7fdfd54f289b8eca99bbbcf43d/users/df0df50059b241dba2b488023a40a8f0/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:55:16.384848 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-9585a2f8-cd4a-4e97-baa5-b648231ad79a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa6db98d3a11410099356ca6c719ce4e'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:16.387862 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-9585a2f8-cd4a-4e97-baa5-b648231ad79a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa6db98d3a11410099356ca6c719ce4e'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:16.392564 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-9585a2f8-cd4a-4e97-baa5-b648231ad79a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa6db98d3a11410099356ca6c719ce4e'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:16.449004 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-9585a2f8-cd4a-4e97-baa5-b648231ad79a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa6db98d3a11410099356ca6c719ce4e'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:16.497037 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1aae37-3dad-45c8-8e4b-6b5a1f484330 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:16.497515 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1aae37-3dad-45c8-8e4b-6b5a1f484330 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:16.497931 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1aae37-3dad-45c8-8e4b-6b5a1f484330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:16.529921 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-9585a2f8-cd4a-4e97-baa5-b648231ad79a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa6db98d3a11410099356ca6c719ce4e'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:16.596154 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1108/2204] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:55:15 2022] DELETE /identity/v3/users/aa6db98d3a11410099356ca6c719ce4e => generated 0 bytes in 774 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:55:16.651530 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-ae1aae37-3dad-45c8-8e4b-6b5a1f484330 None None] MFA Rules not processed for user `df0df50059b241dba2b488023a40a8f0`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:16.655860 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-ae1aae37-3dad-45c8-8e4b-6b5a1f484330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:16.975900 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:17.010411 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1097/2205] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:55:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 514 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:55:17.019831 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585a2f8-cd4a-4e97-baa5-b648231ad79a admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:17.022306 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-9585a2f8-cd4a-4e97-baa5-b648231ad79a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:17.168712 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af27c2f-14bd-4590-a5cd-537367ac7d9c None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:17.169280 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af27c2f-14bd-4590-a5cd-537367ac7d9c None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:17.169748 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af27c2f-14bd-4590-a5cd-537367ac7d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:17.227365 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-7af27c2f-14bd-4590-a5cd-537367ac7d9c None None] MFA Rules not processed for user `6d2dd101d1a14e5ab95f272ab1bbeb94`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:17.227365 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-7af27c2f-14bd-4590-a5cd-537367ac7d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:17.323870 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585a2f8-cd4a-4e97-baa5-b648231ad79a admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:17.353918 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc0d36-9f2d-422e-b218-76f174defc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:17.355240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc0d36-9f2d-422e-b218-76f174defc07 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:17.356037 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc0d36-9f2d-422e-b218-76f174defc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:17.356635 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc0d36-9f2d-422e-b218-76f174defc07 admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:17.358473 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bc0d36-9f2d-422e-b218-76f174defc07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:17.363855 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bc0d36-9f2d-422e-b218-76f174defc07 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:17.442181 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1098/2206] 10.222.0.69 () {58 vars in 1009 bytes} [Thu Sep 8 13:55:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:55:17.471007 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af27c2f-14bd-4590-a5cd-537367ac7d9c None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:17.474392 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-7af27c2f-14bd-4590-a5cd-537367ac7d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:17.483801 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1109/2207] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:55:17 2022] POST /identity/v3/projects => generated 385 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:55:17.492233 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc0d36-9f2d-422e-b218-76f174defc07 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:17.745482 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc0d36-9f2d-422e-b218-76f174defc07 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:17.779030 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dff05e-d598-41fa-a0e4-dabcd46a1c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:17.780475 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dff05e-d598-41fa-a0e4-dabcd46a1c28 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:17.781047 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dff05e-d598-41fa-a0e4-dabcd46a1c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:17.782620 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dff05e-d598-41fa-a0e4-dabcd46a1c28 admin admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:17.784154 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dff05e-d598-41fa-a0e4-dabcd46a1c28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:17.790168 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dff05e-d598-41fa-a0e4-dabcd46a1c28 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:17.794834 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af27c2f-14bd-4590-a5cd-537367ac7d9c None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:17.860357 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1110/2208] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:55:17 2022] POST /identity/v3/users => generated 299 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:55:17.862233 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dff05e-d598-41fa-a0e4-dabcd46a1c28 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:17.884624 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dff05e-d598-41fa-a0e4-dabcd46a1c28 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:17.899511 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff3f346-e1d5-475c-a03e-d17f6ccd04f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:17.900603 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3f346-e1d5-475c-a03e-d17f6ccd04f6 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:17.901075 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3f346-e1d5-475c-a03e-d17f6ccd04f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:17.901614 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3f346-e1d5-475c-a03e-d17f6ccd04f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:17.902869 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff3f346-e1d5-475c-a03e-d17f6ccd04f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:17.907548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff3f346-e1d5-475c-a03e-d17f6ccd04f6 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:17.944014 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1111/2209] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:55:17.945876 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff3f346-e1d5-475c-a03e-d17f6ccd04f6 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:17.961738 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:17.978150 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff3f346-e1d5-475c-a03e-d17f6ccd04f6 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:17.999001 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c34dec-4f96-49b4-b51a-cf527e720651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:18.000346 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c34dec-4f96-49b4-b51a-cf527e720651 admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:18.001093 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c34dec-4f96-49b4-b51a-cf527e720651 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:18.001779 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c34dec-4f96-49b4-b51a-cf527e720651 admin admin] PATH_INFO: `/v3/projects/cb826dad02d446d084761149d0998e3f/users/32a78cb2fe914eab806049cbc4c889db/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:18.086338 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c34dec-4f96-49b4-b51a-cf527e720651 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb826dad02d446d084761149d0998e3f, user_id=32a78cb2fe914eab806049cbc4c889db, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:18.090269 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af49ada-bf54-47b7-9a3b-4d3535d23eeb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9b97592a6840c3865d7dcf886221e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:18.091254 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af49ada-bf54-47b7-9a3b-4d3535d23eeb service swift] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:18.091774 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af49ada-bf54-47b7-9a3b-4d3535d23eeb service swift] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:18.092188 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af49ada-bf54-47b7-9a3b-4d3535d23eeb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:18.093053 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c34dec-4f96-49b4-b51a-cf527e720651 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:18.139429 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1112/2210] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:55:17 2022] PUT /identity/v3/projects/cb826dad02d446d084761149d0998e3f/users/32a78cb2fe914eab806049cbc4c889db/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:55:18.147285 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c34dec-4f96-49b4-b51a-cf527e720651 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:18.215163 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:18.331014 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af49ada-bf54-47b7-9a3b-4d3535d23eeb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:18.334418 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af49ada-bf54-47b7-9a3b-4d3535d23eeb service swift] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:18.397086 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c34dec-4f96-49b4-b51a-cf527e720651 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:18.407962 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1099/2211] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Sep 8 13:55:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 939 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 08 13:55:18.408552 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac310f-a83b-4a8d-b6fb-5ab15124c08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:18.410247 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac310f-a83b-4a8d-b6fb-5ab15124c08c admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:18.410866 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac310f-a83b-4a8d-b6fb-5ab15124c08c admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:18.411395 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac310f-a83b-4a8d-b6fb-5ab15124c08c admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:18.412845 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac310f-a83b-4a8d-b6fb-5ab15124c08c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:18.416907 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac310f-a83b-4a8d-b6fb-5ab15124c08c admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:18.458925 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1113/2212] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 13:55:18.459952 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af49ada-bf54-47b7-9a3b-4d3535d23eeb service swift] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:18.490743 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af49ada-bf54-47b7-9a3b-4d3535d23eeb service swift] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:18.522933 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b5f61-3da9-47a3-b948-edee335a3271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:18.525161 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b5f61-3da9-47a3-b948-edee335a3271 admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:18.525800 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b5f61-3da9-47a3-b948-edee335a3271 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:18.526331 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b5f61-3da9-47a3-b948-edee335a3271 admin admin] PATH_INFO: `/v3/projects/cb826dad02d446d084761149d0998e3f/users/32a78cb2fe914eab806049cbc4c889db/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:18.531210 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446b5f61-3da9-47a3-b948-edee335a3271 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb826dad02d446d084761149d0998e3f, user_id=32a78cb2fe914eab806049cbc4c889db, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:18.536219 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446b5f61-3da9-47a3-b948-edee335a3271 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:18.569934 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1100/2213] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:55:18 2022] PUT /identity/v3/projects/cb826dad02d446d084761149d0998e3f/users/32a78cb2fe914eab806049cbc4c889db/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:55:18.647371 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f51a0-7107-4efc-8061-2d09caf7bc63 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:18.647880 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f51a0-7107-4efc-8061-2d09caf7bc63 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:18.648373 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f51a0-7107-4efc-8061-2d09caf7bc63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:18.727459 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-902f51a0-7107-4efc-8061-2d09caf7bc63 None None] MFA Rules not processed for user `32a78cb2fe914eab806049cbc4c889db`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:18.729083 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-902f51a0-7107-4efc-8061-2d09caf7bc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:19.164313 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1114/2214] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:55:18 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 519 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:55:19.297904 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b5f61-3da9-47a3-b948-edee335a3271 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:19.302418 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-446b5f61-3da9-47a3-b948-edee335a3271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:19.325053 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f51a0-7107-4efc-8061-2d09caf7bc63 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:19.329217 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-902f51a0-7107-4efc-8061-2d09caf7bc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:19.652113 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b5f61-3da9-47a3-b948-edee335a3271 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:19.674156 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb722c16-1d3e-482c-be4d-3df35e8765c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:19.678601 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb722c16-1d3e-482c-be4d-3df35e8765c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:19.679455 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb722c16-1d3e-482c-be4d-3df35e8765c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:19.682044 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb722c16-1d3e-482c-be4d-3df35e8765c0 admin admin] PATH_INFO: `/v3/projects/581166a3d4e747cc988f06920bf2fd43` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:19.691307 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb722c16-1d3e-482c-be4d-3df35e8765c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=581166a3d4e747cc988f06920bf2fd43)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:19.695992 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb722c16-1d3e-482c-be4d-3df35e8765c0 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:19.787986 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f51a0-7107-4efc-8061-2d09caf7bc63 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:19.808005 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e741a37-8520-409c-abaf-8cfbdbd76cd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:19.810571 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e741a37-8520-409c-abaf-8cfbdbd76cd6 service cinder] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:19.811385 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e741a37-8520-409c-abaf-8cfbdbd76cd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:19.811385 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e741a37-8520-409c-abaf-8cfbdbd76cd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:19.823881 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-8e741a37-8520-409c-abaf-8cfbdbd76cd6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:19.853171 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-cb722c16-1d3e-482c-be4d-3df35e8765c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '581166a3d4e747cc988f06920bf2fd43', 'request_id': 'req-cb722c16-1d3e-482c-be4d-3df35e8765c0'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:19.892205 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-cb722c16-1d3e-482c-be4d-3df35e8765c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '581166a3d4e747cc988f06920bf2fd43', 'request_id': 'req-cb722c16-1d3e-482c-be4d-3df35e8765c0'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:19.924819 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-cb722c16-1d3e-482c-be4d-3df35e8765c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '581166a3d4e747cc988f06920bf2fd43', 'request_id': 'req-cb722c16-1d3e-482c-be4d-3df35e8765c0'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:19.961431 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:20.000292 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-cb722c16-1d3e-482c-be4d-3df35e8765c0 admin admin] The token cache is being invalidate because project 581166a3d4e747cc988f06920bf2fd43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:55:20.000629 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-cb722c16-1d3e-482c-be4d-3df35e8765c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:20.002461 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-cb722c16-1d3e-482c-be4d-3df35e8765c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:20.019950 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1101/2215] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:55:19 2022] DELETE /identity/v3/projects/581166a3d4e747cc988f06920bf2fd43 => generated 0 bytes in 722 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:55:20.022915 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd7d11-cf28-4109-9333-c6c61f2bf550 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:20.023436 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd7d11-cf28-4109-9333-c6c61f2bf550 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:20.034351 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd7d11-cf28-4109-9333-c6c61f2bf550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:20.111849 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-8acd7d11-cf28-4109-9333-c6c61f2bf550 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:20.114832 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-8acd7d11-cf28-4109-9333-c6c61f2bf550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:20.380467 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e741a37-8520-409c-abaf-8cfbdbd76cd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:20.382936 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e741a37-8520-409c-abaf-8cfbdbd76cd6 service cinder] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:20.394492 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:20.426892 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1102/2216] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:55:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:55:20.428683 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7b2cb-ab76-48d9-bfe7-d201658d3077 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:20.429187 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7b2cb-ab76-48d9-bfe7-d201658d3077 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:20.429700 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7b2cb-ab76-48d9-bfe7-d201658d3077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:20.432547 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1115/2217] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:55:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 1109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:55:20.502676 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-bde7b2cb-ab76-48d9-bfe7-d201658d3077 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:20.505483 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-bde7b2cb-ab76-48d9-bfe7-d201658d3077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:20.512953 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e741a37-8520-409c-abaf-8cfbdbd76cd6 service cinder] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:20.514892 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-8e741a37-8520-409c-abaf-8cfbdbd76cd6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:20.530274 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1103/2218] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:55:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:55:20.532136 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde7b2cb-ab76-48d9-bfe7-d201658d3077 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:20.560105 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde7b2cb-ab76-48d9-bfe7-d201658d3077 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:20.569915 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e741a37-8520-409c-abaf-8cfbdbd76cd6 service cinder] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:20.579742 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f38a3-ade0-4cf1-ae0e-fbd2a04663b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:20.583182 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f38a3-ade0-4cf1-ae0e-fbd2a04663b5 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:20.590000 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f38a3-ade0-4cf1-ae0e-fbd2a04663b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:20.591669 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902e71f6-ced4-42b1-af07-8a8f562cadac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:20.592534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f38a3-ade0-4cf1-ae0e-fbd2a04663b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:20.594810 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e71f6-ced4-42b1-af07-8a8f562cadac admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:20.596057 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f38a3-ade0-4cf1-ae0e-fbd2a04663b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:55:20.596837 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f38a3-ade0-4cf1-ae0e-fbd2a04663b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:20.597679 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e71f6-ced4-42b1-af07-8a8f562cadac admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:20.610589 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902e71f6-ced4-42b1-af07-8a8f562cadac admin admin] PATH_INFO: `/v3/users/336c88348b7441efba0e0fe0318a23b5` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:20.611518 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f38a3-ade0-4cf1-ae0e-fbd2a04663b5 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:20.612597 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902e71f6-ced4-42b1-af07-8a8f562cadac admin admin] RBAC: Authorizing `identity:delete_user(user_id=336c88348b7441efba0e0fe0318a23b5)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:20.621595 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902e71f6-ced4-42b1-af07-8a8f562cadac admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:20.669592 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1104/2219] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 13:55:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:55:20.674328 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f38a3-ade0-4cf1-ae0e-fbd2a04663b5 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:20.716646 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f38a3-ade0-4cf1-ae0e-fbd2a04663b5 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:20.731017 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9a314-c60a-46a2-ba25-788699c28c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:20.731771 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9a314-c60a-46a2-ba25-788699c28c41 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:20.731981 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9a314-c60a-46a2-ba25-788699c28c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:20.732262 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9a314-c60a-46a2-ba25-788699c28c41 admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:20.732936 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de9a314-c60a-46a2-ba25-788699c28c41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:20.738601 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de9a314-c60a-46a2-ba25-788699c28c41 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:20.771674 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-902e71f6-ced4-42b1-af07-8a8f562cadac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '336c88348b7441efba0e0fe0318a23b5'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:20.773041 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-902e71f6-ced4-42b1-af07-8a8f562cadac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '336c88348b7441efba0e0fe0318a23b5'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:20.778150 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-902e71f6-ced4-42b1-af07-8a8f562cadac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '336c88348b7441efba0e0fe0318a23b5'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:20.796377 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-902e71f6-ced4-42b1-af07-8a8f562cadac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '336c88348b7441efba0e0fe0318a23b5'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:20.845823 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-902e71f6-ced4-42b1-af07-8a8f562cadac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '336c88348b7441efba0e0fe0318a23b5'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:20.883798 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1116/2220] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:55:20 2022] DELETE /identity/v3/users/336c88348b7441efba0e0fe0318a23b5 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:55:20.889868 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e0d3f-4ba6-40a7-9665-36f56b847110 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:20.890897 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e0d3f-4ba6-40a7-9665-36f56b847110 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:20.892110 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e0d3f-4ba6-40a7-9665-36f56b847110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:20.899999 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1105/2221] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:55:20 2022] POST /identity/v3/projects => generated 369 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:55:20.901407 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9a314-c60a-46a2-ba25-788699c28c41 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:20.904475 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-8de9a314-c60a-46a2-ba25-788699c28c41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:20.973037 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-332e0d3f-4ba6-40a7-9665-36f56b847110 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:20.976804 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-332e0d3f-4ba6-40a7-9665-36f56b847110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:21.130860 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9a314-c60a-46a2-ba25-788699c28c41 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:21.144036 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1117/2222] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:55:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:55:21.149592 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c997111-baa6-40cd-b25b-dd05b062e77c None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:21.151872 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c997111-baa6-40cd-b25b-dd05b062e77c None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:21.152374 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c997111-baa6-40cd-b25b-dd05b062e77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:21.162867 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ed8b5-c92b-407d-9c2a-c92e487830f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:21.164313 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ed8b5-c92b-407d-9c2a-c92e487830f5 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:21.164873 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ed8b5-c92b-407d-9c2a-c92e487830f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:21.165334 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ed8b5-c92b-407d-9c2a-c92e487830f5 admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:21.170403 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ed8b5-c92b-407d-9c2a-c92e487830f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:21.174529 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ed8b5-c92b-407d-9c2a-c92e487830f5 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:21.204791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-3c997111-baa6-40cd-b25b-dd05b062e77c None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:21.208124 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-3c997111-baa6-40cd-b25b-dd05b062e77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:21.239050 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1118/2223] 10.222.0.112 () {58 vars in 1017 bytes} [Thu Sep 8 13:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:55:21.241276 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c997111-baa6-40cd-b25b-dd05b062e77c None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:21.263398 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-3c997111-baa6-40cd-b25b-dd05b062e77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:21.381276 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:21.406783 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1106/2224] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:55:20 2022] POST /identity/v3/users => generated 285 bytes in 497 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:55:21.425528 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ed8b5-c92b-407d-9c2a-c92e487830f5 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:21.484035 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ed8b5-c92b-407d-9c2a-c92e487830f5 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:21.489349 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c997111-baa6-40cd-b25b-dd05b062e77c None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:21.503072 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983ccc6-92e3-4f46-8952-572f232df16d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:21.503942 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983ccc6-92e3-4f46-8952-572f232df16d service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:21.506583 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983ccc6-92e3-4f46-8952-572f232df16d service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:21.507447 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983ccc6-92e3-4f46-8952-572f232df16d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:21.510928 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53080a9b-f9d0-4532-b9fb-20f80f23e58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:21.514551 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53080a9b-f9d0-4532-b9fb-20f80f23e58f admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:21.517670 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53080a9b-f9d0-4532-b9fb-20f80f23e58f admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:21.519730 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53080a9b-f9d0-4532-b9fb-20f80f23e58f admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:21.522354 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53080a9b-f9d0-4532-b9fb-20f80f23e58f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:21.528661 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53080a9b-f9d0-4532-b9fb-20f80f23e58f admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:21.544558 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0983ccc6-92e3-4f46-8952-572f232df16d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:21.553589 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0983ccc6-92e3-4f46-8952-572f232df16d service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:21.574963 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1119/2225] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:55:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:55:21.597906 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1107/2226] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:55:21.599980 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983ccc6-92e3-4f46-8952-572f232df16d service neutron] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:21.682955 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983ccc6-92e3-4f46-8952-572f232df16d service neutron] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:21.710991 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f355a8-3f1d-4dc6-afdd-07bb037ded25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:21.712933 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f355a8-3f1d-4dc6-afdd-07bb037ded25 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:21.713827 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f355a8-3f1d-4dc6-afdd-07bb037ded25 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:21.714606 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f355a8-3f1d-4dc6-afdd-07bb037ded25 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:21.716415 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f355a8-3f1d-4dc6-afdd-07bb037ded25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:21.721183 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f355a8-3f1d-4dc6-afdd-07bb037ded25 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:21.778465 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1120/2227] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:55:21.784473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53080a9b-f9d0-4532-b9fb-20f80f23e58f admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:21.850600 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53080a9b-f9d0-4532-b9fb-20f80f23e58f admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:21.887559 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f9a14-9fd9-4fe7-b4f4-d014e5f949d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:21.889040 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f9a14-9fd9-4fe7-b4f4-d014e5f949d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:21.889740 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f9a14-9fd9-4fe7-b4f4-d014e5f949d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:21.890638 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f9a14-9fd9-4fe7-b4f4-d014e5f949d9 admin admin] PATH_INFO: `/v3/projects/cdc3063b965a43fcb20dba1975e7fa93/users/e1714203a1d3405fb2d236d2a5b4a49a/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:21.994747 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128f9a14-9fd9-4fe7-b4f4-d014e5f949d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdc3063b965a43fcb20dba1975e7fa93, user_id=e1714203a1d3405fb2d236d2a5b4a49a, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:22.010413 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128f9a14-9fd9-4fe7-b4f4-d014e5f949d9 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:22.058384 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1108/2228] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:55:21 2022] PUT /identity/v3/projects/cdc3063b965a43fcb20dba1975e7fa93/users/e1714203a1d3405fb2d236d2a5b4a49a/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:55:22.065207 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df30ab8-4f3b-4199-b3fd-03e6b5e62d8d None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:22.066061 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df30ab8-4f3b-4199-b3fd-03e6b5e62d8d None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:22.066237 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df30ab8-4f3b-4199-b3fd-03e6b5e62d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:22.178893 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f9a14-9fd9-4fe7-b4f4-d014e5f949d9 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:22.181254 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-128f9a14-9fd9-4fe7-b4f4-d014e5f949d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:22.274120 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-4df30ab8-4f3b-4199-b3fd-03e6b5e62d8d None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:22.276613 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-4df30ab8-4f3b-4199-b3fd-03e6b5e62d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:22.508417 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f9a14-9fd9-4fe7-b4f4-d014e5f949d9 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:22.536238 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92785f5-217e-4804-8e69-fce2b968ef1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:22.538366 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92785f5-217e-4804-8e69-fce2b968ef1f service nova] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:22.539168 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92785f5-217e-4804-8e69-fce2b968ef1f service nova] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:22.540764 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92785f5-217e-4804-8e69-fce2b968ef1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:22.579546 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:22.645604 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1121/2229] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:55:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 583 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:55:22.702316 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df30ab8-4f3b-4199-b3fd-03e6b5e62d8d None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:22.927957 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92785f5-217e-4804-8e69-fce2b968ef1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:22.931156 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92785f5-217e-4804-8e69-fce2b968ef1f service nova] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:22.985569 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1109/2230] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:55:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 807 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:55:23.001901 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92785f5-217e-4804-8e69-fce2b968ef1f service nova] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:23.004296 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-c92785f5-217e-4804-8e69-fce2b968ef1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:23.057631 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df30ab8-4f3b-4199-b3fd-03e6b5e62d8d None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:23.097317 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af6231-dd77-4bdd-a223-118f6d460a5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:23.101529 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af6231-dd77-4bdd-a223-118f6d460a5a service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:23.109979 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af6231-dd77-4bdd-a223-118f6d460a5a service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:23.110935 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af6231-dd77-4bdd-a223-118f6d460a5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:23.118449 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92785f5-217e-4804-8e69-fce2b968ef1f service nova] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:23.158044 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c520c-6ee8-4288-b96b-f84653af1688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:23.159543 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c520c-6ee8-4288-b96b-f84653af1688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:23.161440 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c520c-6ee8-4288-b96b-f84653af1688 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:23.163817 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c520c-6ee8-4288-b96b-f84653af1688 admin admin] PATH_INFO: `/v3/projects/7191d7b713374f90b510f9d8a8e56bcf` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:23.172205 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c520c-6ee8-4288-b96b-f84653af1688 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7191d7b713374f90b510f9d8a8e56bcf)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:23.181271 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c520c-6ee8-4288-b96b-f84653af1688 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:23.183102 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74af6231-dd77-4bdd-a223-118f6d460a5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:23.185584 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74af6231-dd77-4bdd-a223-118f6d460a5a service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:23.227688 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1122/2231] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:55:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:55:23.337815 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-bb5c520c-6ee8-4288-b96b-f84653af1688 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7191d7b713374f90b510f9d8a8e56bcf', 'request_id': 'req-bb5c520c-6ee8-4288-b96b-f84653af1688'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:23.357584 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-bb5c520c-6ee8-4288-b96b-f84653af1688 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7191d7b713374f90b510f9d8a8e56bcf', 'request_id': 'req-bb5c520c-6ee8-4288-b96b-f84653af1688'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:23.383440 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-bb5c520c-6ee8-4288-b96b-f84653af1688 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7191d7b713374f90b510f9d8a8e56bcf', 'request_id': 'req-bb5c520c-6ee8-4288-b96b-f84653af1688'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:23.423492 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-bb5c520c-6ee8-4288-b96b-f84653af1688 admin admin] The token cache is being invalidate because project 7191d7b713374f90b510f9d8a8e56bcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:55:23.424264 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-bb5c520c-6ee8-4288-b96b-f84653af1688 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:23.425851 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-bb5c520c-6ee8-4288-b96b-f84653af1688 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:23.432560 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1110/2232] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:55:22 2022] DELETE /identity/v3/projects/7191d7b713374f90b510f9d8a8e56bcf => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:55:23.434448 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af6231-dd77-4bdd-a223-118f6d460a5a service neutron] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:23.459632 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af6231-dd77-4bdd-a223-118f6d460a5a service neutron] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:23.803881 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:23.826158 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b90aa90-9d9f-4cd2-be73-c8ba4219fcb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:23.828195 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90aa90-9d9f-4cd2-be73-c8ba4219fcb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:23.829030 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90aa90-9d9f-4cd2-be73-c8ba4219fcb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:23.829988 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90aa90-9d9f-4cd2-be73-c8ba4219fcb3 admin admin] PATH_INFO: `/v3/users/1f40444358af4352afdcffffaa1772c4` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:23.833025 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b90aa90-9d9f-4cd2-be73-c8ba4219fcb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f40444358af4352afdcffffaa1772c4)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:23.837784 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b90aa90-9d9f-4cd2-be73-c8ba4219fcb3 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:24.162927 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-3b90aa90-9d9f-4cd2-be73-c8ba4219fcb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f40444358af4352afdcffffaa1772c4'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:24.164069 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-3b90aa90-9d9f-4cd2-be73-c8ba4219fcb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f40444358af4352afdcffffaa1772c4'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:24.164822 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-3b90aa90-9d9f-4cd2-be73-c8ba4219fcb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f40444358af4352afdcffffaa1772c4'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:24.197812 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-3b90aa90-9d9f-4cd2-be73-c8ba4219fcb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f40444358af4352afdcffffaa1772c4'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:24.212995 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c520c-6ee8-4288-b96b-f84653af1688 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:24.217083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-bb5c520c-6ee8-4288-b96b-f84653af1688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:24.275078 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-3b90aa90-9d9f-4cd2-be73-c8ba4219fcb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f40444358af4352afdcffffaa1772c4'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:24.322262 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1123/2233] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:55:23 2022] DELETE /identity/v3/users/1f40444358af4352afdcffffaa1772c4 => generated 0 bytes in 885 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:55:24.494309 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c520c-6ee8-4288-b96b-f84653af1688 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:24.814445 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:24.915579 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd9335-2760-4260-876e-f512e33e44cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:24.915579 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd9335-2760-4260-876e-f512e33e44cf service cinder] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:24.915579 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd9335-2760-4260-876e-f512e33e44cf service cinder] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:24.915579 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd9335-2760-4260-876e-f512e33e44cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:24.925267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-97dd9335-2760-4260-876e-f512e33e44cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:25.372477 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b90aa90-9d9f-4cd2-be73-c8ba4219fcb3 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:25.375393 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-3b90aa90-9d9f-4cd2-be73-c8ba4219fcb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:25.404852 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd9335-2760-4260-876e-f512e33e44cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:25.418420 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd9335-2760-4260-876e-f512e33e44cf service cinder] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:25.475964 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1111/2234] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:55:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 1264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:55:25.750346 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b90aa90-9d9f-4cd2-be73-c8ba4219fcb3 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:25.787716 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02f14f-52da-4ea9-bf8e-1447d30f8400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:25.788754 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02f14f-52da-4ea9-bf8e-1447d30f8400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:25.789171 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02f14f-52da-4ea9-bf8e-1447d30f8400 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:25.789592 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02f14f-52da-4ea9-bf8e-1447d30f8400 admin admin] PATH_INFO: `/v3/projects/ed7455dbd038451993303440ebf3959d` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:25.792049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c02f14f-52da-4ea9-bf8e-1447d30f8400 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed7455dbd038451993303440ebf3959d)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:25.817726 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c02f14f-52da-4ea9-bf8e-1447d30f8400 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:26.071550 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-7c02f14f-52da-4ea9-bf8e-1447d30f8400 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed7455dbd038451993303440ebf3959d', 'request_id': 'req-7c02f14f-52da-4ea9-bf8e-1447d30f8400'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:26.104723 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-7c02f14f-52da-4ea9-bf8e-1447d30f8400 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed7455dbd038451993303440ebf3959d', 'request_id': 'req-7c02f14f-52da-4ea9-bf8e-1447d30f8400'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:26.129422 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-7c02f14f-52da-4ea9-bf8e-1447d30f8400 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed7455dbd038451993303440ebf3959d', 'request_id': 'req-7c02f14f-52da-4ea9-bf8e-1447d30f8400'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:26.175799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-7c02f14f-52da-4ea9-bf8e-1447d30f8400 admin admin] The token cache is being invalidate because project ed7455dbd038451993303440ebf3959d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:55:26.176334 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-7c02f14f-52da-4ea9-bf8e-1447d30f8400 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:26.178441 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-7c02f14f-52da-4ea9-bf8e-1447d30f8400 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:26.190502 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1124/2235] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:55:25 2022] DELETE /identity/v3/projects/ed7455dbd038451993303440ebf3959d => generated 0 bytes in 813 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:55:26.192914 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b29914-62fc-4198-9f64-7fefc4e4c246 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:26.193462 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b29914-62fc-4198-9f64-7fefc4e4c246 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:26.193969 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b29914-62fc-4198-9f64-7fefc4e4c246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:26.302709 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-c5b29914-62fc-4198-9f64-7fefc4e4c246 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:26.304927 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-c5b29914-62fc-4198-9f64-7fefc4e4c246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:26.728150 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1112/2236] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:55:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 537 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:55:26.737495 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0d818-6633-435d-9fc1-45120f38842e None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:26.738267 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0d818-6633-435d-9fc1-45120f38842e None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:26.738510 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0d818-6633-435d-9fc1-45120f38842e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:26.838183 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:26.876297 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-83e0d818-6633-435d-9fc1-45120f38842e None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:26.885138 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-83e0d818-6633-435d-9fc1-45120f38842e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:26.934243 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b29914-62fc-4198-9f64-7fefc4e4c246 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:26.935764 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1125/2237] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:55:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:55:26.945630 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38b7a9-5d81-46d1-818a-7e4c734ef9f2 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:26.946271 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38b7a9-5d81-46d1-818a-7e4c734ef9f2 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:26.947157 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38b7a9-5d81-46d1-818a-7e4c734ef9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:26.965346 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b29914-62fc-4198-9f64-7fefc4e4c246 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:27.001556 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b42d322-edc5-4978-a63d-7e9bb699eb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:27.003862 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42d322-edc5-4978-a63d-7e9bb699eb4e admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:27.004513 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42d322-edc5-4978-a63d-7e9bb699eb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:27.005245 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42d322-edc5-4978-a63d-7e9bb699eb4e admin admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:27.010397 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b42d322-edc5-4978-a63d-7e9bb699eb4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:55:27.011064 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b42d322-edc5-4978-a63d-7e9bb699eb4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:27.018758 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b42d322-edc5-4978-a63d-7e9bb699eb4e admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:27.070195 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-3c38b7a9-5d81-46d1-818a-7e4c734ef9f2 None None] MFA Rules not processed for user `e1714203a1d3405fb2d236d2a5b4a49a`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:27.072572 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-3c38b7a9-5d81-46d1-818a-7e4c734ef9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:27.087827 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1113/2238] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 13:55:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:55:27.100062 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b42d322-edc5-4978-a63d-7e9bb699eb4e admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:27.179603 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b42d322-edc5-4978-a63d-7e9bb699eb4e admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:27.215322 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc986d0-239e-462d-b4b7-128bcb727f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:27.217689 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc986d0-239e-462d-b4b7-128bcb727f80 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:27.218740 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc986d0-239e-462d-b4b7-128bcb727f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:27.225006 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc986d0-239e-462d-b4b7-128bcb727f80 admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:27.226992 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc986d0-239e-462d-b4b7-128bcb727f80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:27.231274 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc986d0-239e-462d-b4b7-128bcb727f80 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:27.464007 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1114/2239] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:55:27 2022] POST /identity/v3/projects => generated 401 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:55:27.486470 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc986d0-239e-462d-b4b7-128bcb727f80 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:27.547842 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1126/2240] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:55:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 603 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:55:27.548791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c38b7a9-5d81-46d1-818a-7e4c734ef9f2 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:27.565387 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-3c38b7a9-5d81-46d1-818a-7e4c734ef9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:27.651918 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c38b7a9-5d81-46d1-818a-7e4c734ef9f2 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:28.011000 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74698ad5-8a21-4896-992e-c5061177b22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:28.016267 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74698ad5-8a21-4896-992e-c5061177b22d admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:28.017020 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74698ad5-8a21-4896-992e-c5061177b22d admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:28.019419 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74698ad5-8a21-4896-992e-c5061177b22d admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:28.021964 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74698ad5-8a21-4896-992e-c5061177b22d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:28.032860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74698ad5-8a21-4896-992e-c5061177b22d admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:28.035548 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc986d0-239e-462d-b4b7-128bcb727f80 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:28.106450 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380fe84-27d3-4a38-a436-dfe7821d2b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:28.107260 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380fe84-27d3-4a38-a436-dfe7821d2b7a admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:28.107712 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380fe84-27d3-4a38-a436-dfe7821d2b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:28.108518 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380fe84-27d3-4a38-a436-dfe7821d2b7a admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:28.114428 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2380fe84-27d3-4a38-a436-dfe7821d2b7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:28.123463 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2380fe84-27d3-4a38-a436-dfe7821d2b7a admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:28.169775 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:28.206818 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1115/2241] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:55:27 2022] POST /identity/v3/users => generated 301 bytes in 742 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:55:28.212608 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380fe84-27d3-4a38-a436-dfe7821d2b7a admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:28.222089 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1127/2242] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:55:27 2022] POST /identity/v3/projects => generated 369 bytes in 674 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:55:28.223433 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74698ad5-8a21-4896-992e-c5061177b22d admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:28.261058 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380fe84-27d3-4a38-a436-dfe7821d2b7a admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:28.443124 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55cdece-a924-4137-afbc-56a04bbe3328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:28.444580 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55cdece-a924-4137-afbc-56a04bbe3328 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:28.445128 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55cdece-a924-4137-afbc-56a04bbe3328 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:28.445855 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55cdece-a924-4137-afbc-56a04bbe3328 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:28.454155 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55cdece-a924-4137-afbc-56a04bbe3328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:28.458041 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55cdece-a924-4137-afbc-56a04bbe3328 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:28.499582 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1116/2243] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 13:55:28.502208 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55cdece-a924-4137-afbc-56a04bbe3328 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:28.509482 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-d55cdece-a924-4137-afbc-56a04bbe3328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:28.700791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74698ad5-8a21-4896-992e-c5061177b22d admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:28.724635 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4425267-33bc-44f2-b94e-aba51c0cc846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:28.725539 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4425267-33bc-44f2-b94e-aba51c0cc846 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:28.726035 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4425267-33bc-44f2-b94e-aba51c0cc846 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:28.727094 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4425267-33bc-44f2-b94e-aba51c0cc846 admin admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:28.728245 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4425267-33bc-44f2-b94e-aba51c0cc846 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:28.732048 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4425267-33bc-44f2-b94e-aba51c0cc846 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:28.834437 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1128/2244] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:55:28 2022] POST /identity/v3/users => generated 291 bytes in 608 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:55:28.834437 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4425267-33bc-44f2-b94e-aba51c0cc846 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:28.867007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:28.879295 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4425267-33bc-44f2-b94e-aba51c0cc846 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:28.915895 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ddf5c6-18e9-4dc8-be27-e37ff09b19a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:28.916930 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ddf5c6-18e9-4dc8-be27-e37ff09b19a0 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:28.917694 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ddf5c6-18e9-4dc8-be27-e37ff09b19a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:28.918049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ddf5c6-18e9-4dc8-be27-e37ff09b19a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:28.919029 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ddf5c6-18e9-4dc8-be27-e37ff09b19a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:28.929678 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ddf5c6-18e9-4dc8-be27-e37ff09b19a0 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:28.966207 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1129/2245] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:55:28.967719 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ddf5c6-18e9-4dc8-be27-e37ff09b19a0 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:28.982776 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55cdece-a924-4137-afbc-56a04bbe3328 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:28.997594 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ca24c-0c5a-43da-8b60-04173e2aea3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:28.999240 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ca24c-0c5a-43da-8b60-04173e2aea3e service cinder] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:29.000171 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ca24c-0c5a-43da-8b60-04173e2aea3e service cinder] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:29.000751 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ca24c-0c5a-43da-8b60-04173e2aea3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:29.009745 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-9e4ca24c-0c5a-43da-8b60-04173e2aea3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:29.017474 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ddf5c6-18e9-4dc8-be27-e37ff09b19a0 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:29.043937 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e71a1-e797-4e68-94d0-ac59ce3e3e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:29.048691 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e71a1-e797-4e68-94d0-ac59ce3e3e22 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:29.050814 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e71a1-e797-4e68-94d0-ac59ce3e3e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:29.055522 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e71a1-e797-4e68-94d0-ac59ce3e3e22 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:29.057207 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46e71a1-e797-4e68-94d0-ac59ce3e3e22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:29.062951 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46e71a1-e797-4e68-94d0-ac59ce3e3e22 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:29.132730 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1130/2246] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:55:29.135132 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e71a1-e797-4e68-94d0-ac59ce3e3e22 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:29.233410 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e71a1-e797-4e68-94d0-ac59ce3e3e22 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:29.271030 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee34326-763f-4392-ad25-e2870b5e604e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:29.272880 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee34326-763f-4392-ad25-e2870b5e604e admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:29.285487 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee34326-763f-4392-ad25-e2870b5e604e admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:29.285487 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee34326-763f-4392-ad25-e2870b5e604e admin admin] PATH_INFO: `/v3/projects/c77248b34b8f4dea87490c1c57be1c61/users/460526730574439ba39760db1a99ed88/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:29.371331 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee34326-763f-4392-ad25-e2870b5e604e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c77248b34b8f4dea87490c1c57be1c61, user_id=460526730574439ba39760db1a99ed88, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:29.384860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee34326-763f-4392-ad25-e2870b5e604e admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:29.419182 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1131/2247] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:55:29 2022] PUT /identity/v3/projects/c77248b34b8f4dea87490c1c57be1c61/users/460526730574439ba39760db1a99ed88/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:55:29.424505 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee34326-763f-4392-ad25-e2870b5e604e admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:29.433325 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4ca24c-0c5a-43da-8b60-04173e2aea3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:29.436506 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4ca24c-0c5a-43da-8b60-04173e2aea3e service cinder] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:29.479816 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1117/2248] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:55:28 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 979 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:55:29.483326 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d28e9-d90e-4a3e-b9c4-84fad323eeb2 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:29.485154 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d28e9-d90e-4a3e-b9c4-84fad323eeb2 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:29.485154 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d28e9-d90e-4a3e-b9c4-84fad323eeb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:29.714000 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-d27d28e9-d90e-4a3e-b9c4-84fad323eeb2 None None] MFA Rules not processed for user `460526730574439ba39760db1a99ed88`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:29.714000 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-d27d28e9-d90e-4a3e-b9c4-84fad323eeb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:29.860514 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee34326-763f-4392-ad25-e2870b5e604e admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:29.884433 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087088b-f680-4561-8fb6-ac2193887240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:29.884433 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087088b-f680-4561-8fb6-ac2193887240 admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:29.889038 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087088b-f680-4561-8fb6-ac2193887240 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:29.891166 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087088b-f680-4561-8fb6-ac2193887240 admin admin] PATH_INFO: `/v3/projects/cceb5b5e94ad4d81a17e69b04e9521e4/users/711e13eb17ae445ea1d305e083b5c874/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:29.912889 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:29.965768 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d087088b-f680-4561-8fb6-ac2193887240 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cceb5b5e94ad4d81a17e69b04e9521e4, user_id=711e13eb17ae445ea1d305e083b5c874, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:29.979625 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d087088b-f680-4561-8fb6-ac2193887240 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:30.112150 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1132/2249] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:55:29 2022] PUT /identity/v3/projects/cceb5b5e94ad4d81a17e69b04e9521e4/users/711e13eb17ae445ea1d305e083b5c874/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:55:30.122511 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087088b-f680-4561-8fb6-ac2193887240 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:30.250569 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1118/2250] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:55:29 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 769 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:55:30.252768 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e44f4-7c36-447d-9fbe-31c1bc5fc081 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:30.253399 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e44f4-7c36-447d-9fbe-31c1bc5fc081 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:30.254045 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e44f4-7c36-447d-9fbe-31c1bc5fc081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:30.308211 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-d69e44f4-7c36-447d-9fbe-31c1bc5fc081 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:30.313443 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-d69e44f4-7c36-447d-9fbe-31c1bc5fc081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:30.513774 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1119/2251] 10.222.0.112 () {58 vars in 1017 bytes} [Thu Sep 8 13:55:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:55:30.514877 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e44f4-7c36-447d-9fbe-31c1bc5fc081 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:30.529867 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087088b-f680-4561-8fb6-ac2193887240 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:30.550416 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e44f4-7c36-447d-9fbe-31c1bc5fc081 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:30.550741 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae5d94-bbf8-4ed2-8588-0874ff5260e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:30.551849 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae5d94-bbf8-4ed2-8588-0874ff5260e5 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:30.552337 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae5d94-bbf8-4ed2-8588-0874ff5260e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:30.552822 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae5d94-bbf8-4ed2-8588-0874ff5260e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:30.554073 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ae5d94-bbf8-4ed2-8588-0874ff5260e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:30.557190 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ae5d94-bbf8-4ed2-8588-0874ff5260e5 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:30.574594 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa2307-fe92-4102-9817-8e83b3df85ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:30.575286 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa2307-fe92-4102-9817-8e83b3df85ad admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:30.575718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa2307-fe92-4102-9817-8e83b3df85ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:30.576090 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa2307-fe92-4102-9817-8e83b3df85ad admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:30.577144 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa2307-fe92-4102-9817-8e83b3df85ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:30.580515 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa2307-fe92-4102-9817-8e83b3df85ad admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:30.601425 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1133/2252] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 482 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 13:55:30.607979 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae5d94-bbf8-4ed2-8588-0874ff5260e5 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:30.641127 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae5d94-bbf8-4ed2-8588-0874ff5260e5 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:30.664484 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e50d14-5e59-42bf-805f-b5b8c66403dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:30.665580 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e50d14-5e59-42bf-805f-b5b8c66403dc admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:30.666091 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e50d14-5e59-42bf-805f-b5b8c66403dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:30.666602 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e50d14-5e59-42bf-805f-b5b8c66403dc admin admin] PATH_INFO: `/v3/projects/cceb5b5e94ad4d81a17e69b04e9521e4/users/711e13eb17ae445ea1d305e083b5c874/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:30.678519 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e50d14-5e59-42bf-805f-b5b8c66403dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=cceb5b5e94ad4d81a17e69b04e9521e4, user_id=711e13eb17ae445ea1d305e083b5c874, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:30.684645 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e50d14-5e59-42bf-805f-b5b8c66403dc admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:30.692253 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1120/2253] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:55:30 2022] POST /identity/v3/projects => generated 399 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:55:30.698781 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa2307-fe92-4102-9817-8e83b3df85ad admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:30.745752 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1134/2254] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:55:30 2022] PUT /identity/v3/projects/cceb5b5e94ad4d81a17e69b04e9521e4/users/711e13eb17ae445ea1d305e083b5c874/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:55:31.006594 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa2307-fe92-4102-9817-8e83b3df85ad admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:31.261195 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:31.277497 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab47c7b-57eb-4641-9efc-43f4b2a3f637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:31.278206 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab47c7b-57eb-4641-9efc-43f4b2a3f637 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:31.278499 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab47c7b-57eb-4641-9efc-43f4b2a3f637 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:31.278863 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab47c7b-57eb-4641-9efc-43f4b2a3f637 admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:31.279453 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab47c7b-57eb-4641-9efc-43f4b2a3f637 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:31.289166 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab47c7b-57eb-4641-9efc-43f4b2a3f637 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:31.346940 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1121/2255] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:55:30 2022] POST /identity/v3/users => generated 306 bytes in 649 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:55:31.353021 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e50d14-5e59-42bf-805f-b5b8c66403dc admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:31.393620 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e50d14-5e59-42bf-805f-b5b8c66403dc admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:31.418980 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d80426-ea70-4a7a-b711-0885f01cab09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:31.424507 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d80426-ea70-4a7a-b711-0885f01cab09 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:31.424507 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d80426-ea70-4a7a-b711-0885f01cab09 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:31.424507 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d80426-ea70-4a7a-b711-0885f01cab09 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:31.428330 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d80426-ea70-4a7a-b711-0885f01cab09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:31.442577 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d80426-ea70-4a7a-b711-0885f01cab09 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:31.529893 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1135/2256] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:55:31.533398 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab47c7b-57eb-4641-9efc-43f4b2a3f637 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:31.554602 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab47c7b-57eb-4641-9efc-43f4b2a3f637 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:31.573116 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f562f2a-c514-44c5-9fec-a0f4e557e7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:31.574741 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f562f2a-c514-44c5-9fec-a0f4e557e7d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:31.575561 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f562f2a-c514-44c5-9fec-a0f4e557e7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:31.576346 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f562f2a-c514-44c5-9fec-a0f4e557e7d3 admin admin] PATH_INFO: `/v3/projects/206e665169774ae2a0e2cd53d0978fe1/users/580f04a4a94241efa221f10ce5435fcb/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:31.648130 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f562f2a-c514-44c5-9fec-a0f4e557e7d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=206e665169774ae2a0e2cd53d0978fe1, user_id=580f04a4a94241efa221f10ce5435fcb, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:31.656627 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f562f2a-c514-44c5-9fec-a0f4e557e7d3 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:31.728651 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1122/2257] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:55:31 2022] PUT /identity/v3/projects/206e665169774ae2a0e2cd53d0978fe1/users/580f04a4a94241efa221f10ce5435fcb/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:55:31.735813 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d80426-ea70-4a7a-b711-0885f01cab09 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:31.771612 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d80426-ea70-4a7a-b711-0885f01cab09 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:31.823918 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:31.891118 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f562f2a-c514-44c5-9fec-a0f4e557e7d3 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:31.896674 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-5f562f2a-c514-44c5-9fec-a0f4e557e7d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:32.085704 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404fc3d-0874-48ef-99ec-7be94992c361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:32.086526 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404fc3d-0874-48ef-99ec-7be94992c361 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:32.086908 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404fc3d-0874-48ef-99ec-7be94992c361 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:32.087270 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404fc3d-0874-48ef-99ec-7be94992c361 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:32.088271 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b404fc3d-0874-48ef-99ec-7be94992c361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:32.105187 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b404fc3d-0874-48ef-99ec-7be94992c361 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:32.217634 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1136/2258] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 484 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 13:55:32.227926 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404fc3d-0874-48ef-99ec-7be94992c361 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:32.300650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404fc3d-0874-48ef-99ec-7be94992c361 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:32.319073 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22707fc-d8bc-424d-af51-7c79b1a55a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:32.322083 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22707fc-d8bc-424d-af51-7c79b1a55a30 admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:32.323840 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22707fc-d8bc-424d-af51-7c79b1a55a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:32.324452 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22707fc-d8bc-424d-af51-7c79b1a55a30 admin admin] PATH_INFO: `/v3/projects/206e665169774ae2a0e2cd53d0978fe1/users/580f04a4a94241efa221f10ce5435fcb/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:32.331282 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22707fc-d8bc-424d-af51-7c79b1a55a30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=206e665169774ae2a0e2cd53d0978fe1, user_id=580f04a4a94241efa221f10ce5435fcb, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:32.340394 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22707fc-d8bc-424d-af51-7c79b1a55a30 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:32.384481 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1137/2259] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:55:32 2022] PUT /identity/v3/projects/206e665169774ae2a0e2cd53d0978fe1/users/580f04a4a94241efa221f10ce5435fcb/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:55:32.422361 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913342e-1fca-4e0c-81de-1c6da1cac1ce None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:32.424288 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913342e-1fca-4e0c-81de-1c6da1cac1ce None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:32.425238 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913342e-1fca-4e0c-81de-1c6da1cac1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:32.526995 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-d913342e-1fca-4e0c-81de-1c6da1cac1ce None None] MFA Rules not processed for user `580f04a4a94241efa221f10ce5435fcb`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:32.529947 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-d913342e-1fca-4e0c-81de-1c6da1cac1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:32.538135 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f562f2a-c514-44c5-9fec-a0f4e557e7d3 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:32.776656 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1138/2260] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:55:32 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:55:32.779875 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d913342e-1fca-4e0c-81de-1c6da1cac1ce None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:32.826906 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b356746-eeef-4f91-b578-f18290b0f846 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:32.827559 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b356746-eeef-4f91-b578-f18290b0f846 service nova] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:32.828437 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b356746-eeef-4f91-b578-f18290b0f846 service nova] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:32.828881 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b356746-eeef-4f91-b578-f18290b0f846 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:33.077046 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d913342e-1fca-4e0c-81de-1c6da1cac1ce None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:33.088095 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999dea35-9338-41e9-8d35-1adcb50de564 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:33.089136 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999dea35-9338-41e9-8d35-1adcb50de564 service cinder] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:33.089436 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999dea35-9338-41e9-8d35-1adcb50de564 service cinder] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:33.089903 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999dea35-9338-41e9-8d35-1adcb50de564 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:33.112565 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999dea35-9338-41e9-8d35-1adcb50de564 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:33.117265 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999dea35-9338-41e9-8d35-1adcb50de564 service cinder] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:33.142135 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1139/2261] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:55:32 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:55:33.163685 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:33.211585 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b356746-eeef-4f91-b578-f18290b0f846 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:33.216304 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b356746-eeef-4f91-b578-f18290b0f846 service nova] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:33.297475 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1123/2262] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:55:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 1409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:55:33.432508 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999dea35-9338-41e9-8d35-1adcb50de564 service cinder] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:33.443707 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999dea35-9338-41e9-8d35-1adcb50de564 service cinder] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:33.464140 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0652a6-c33b-445a-b07b-a3b864412f9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:33.465083 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0652a6-c33b-445a-b07b-a3b864412f9d service cinder] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:33.465083 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0652a6-c33b-445a-b07b-a3b864412f9d service cinder] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:33.465720 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0652a6-c33b-445a-b07b-a3b864412f9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:33.528255 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:33.739007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0652a6-c33b-445a-b07b-a3b864412f9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:33.742790 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0652a6-c33b-445a-b07b-a3b864412f9d service cinder] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:33.768311 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1140/2263] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:55:33 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:55:33.796432 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68792410-138a-4e8b-9faa-eb79180bc4b6 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:33.798026 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68792410-138a-4e8b-9faa-eb79180bc4b6 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:33.798519 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68792410-138a-4e8b-9faa-eb79180bc4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:33.918849 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-68792410-138a-4e8b-9faa-eb79180bc4b6 None None] MFA Rules not processed for user `5d4f11a98f39401183a1317c92d3d3af`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:33.926060 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-68792410-138a-4e8b-9faa-eb79180bc4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:34.155638 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1124/2264] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:55:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:55:34.271676 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19289591-16da-4cd5-b431-4d58b2c5bef1 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:34.272192 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19289591-16da-4cd5-b431-4d58b2c5bef1 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:34.272671 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19289591-16da-4cd5-b431-4d58b2c5bef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:34.451710 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-19289591-16da-4cd5-b431-4d58b2c5bef1 None None] MFA Rules not processed for user `711e13eb17ae445ea1d305e083b5c874`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:34.469426 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-19289591-16da-4cd5-b431-4d58b2c5bef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:34.869752 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1141/2265] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:55:34 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 599 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:55:34.915078 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6adb0a-30a0-41d7-a754-8983e00917d7 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:34.916723 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6adb0a-30a0-41d7-a754-8983e00917d7 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:34.917041 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6adb0a-30a0-41d7-a754-8983e00917d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:35.038191 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-6c6adb0a-30a0-41d7-a754-8983e00917d7 None None] MFA Rules not processed for user `e1714203a1d3405fb2d236d2a5b4a49a`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:35.043734 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-6c6adb0a-30a0-41d7-a754-8983e00917d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:35.336586 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1125/2266] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:55:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 454 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:55:36.057413 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19289591-16da-4cd5-b431-4d58b2c5bef1 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:36.079977 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19289591-16da-4cd5-b431-4d58b2c5bef1 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:36.086943 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68778037-d41d-4f51-816b-7b9258160744 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:36.087631 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68778037-d41d-4f51-816b-7b9258160744 service nova] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:36.087914 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68778037-d41d-4f51-816b-7b9258160744 service nova] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:36.088186 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68778037-d41d-4f51-816b-7b9258160744 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:36.104185 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68778037-d41d-4f51-816b-7b9258160744 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:36.107306 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68778037-d41d-4f51-816b-7b9258160744 service nova] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:36.140628 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1142/2267] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:55:36 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:55:36.613566 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6adb0a-30a0-41d7-a754-8983e00917d7 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:36.615956 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-6c6adb0a-30a0-41d7-a754-8983e00917d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:36.665053 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6adb0a-30a0-41d7-a754-8983e00917d7 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:36.680405 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617967ec-b6b1-4051-a900-613b1c94fe3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:36.687432 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617967ec-b6b1-4051-a900-613b1c94fe3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:36.688300 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617967ec-b6b1-4051-a900-613b1c94fe3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:36.693012 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617967ec-b6b1-4051-a900-613b1c94fe3f admin admin] PATH_INFO: `/v3/users/4a5258f5786c4e55b7da8bae76ae8749` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:36.702444 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617967ec-b6b1-4051-a900-613b1c94fe3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a5258f5786c4e55b7da8bae76ae8749)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:36.711169 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617967ec-b6b1-4051-a900-613b1c94fe3f admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:36.943992 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-617967ec-b6b1-4051-a900-613b1c94fe3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a5258f5786c4e55b7da8bae76ae8749'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:36.949248 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-617967ec-b6b1-4051-a900-613b1c94fe3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a5258f5786c4e55b7da8bae76ae8749'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:37.019143 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-617967ec-b6b1-4051-a900-613b1c94fe3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a5258f5786c4e55b7da8bae76ae8749'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:37.117725 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-617967ec-b6b1-4051-a900-613b1c94fe3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a5258f5786c4e55b7da8bae76ae8749'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:37.122130 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-617967ec-b6b1-4051-a900-613b1c94fe3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a5258f5786c4e55b7da8bae76ae8749'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:37.184783 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1126/2268] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:55:36 2022] DELETE /identity/v3/users/4a5258f5786c4e55b7da8bae76ae8749 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:55:37.188209 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d5cef-d174-4dcf-886c-905cb2025a1b None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:37.189026 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d5cef-d174-4dcf-886c-905cb2025a1b None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:37.189512 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d5cef-d174-4dcf-886c-905cb2025a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:37.352679 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-190d5cef-d174-4dcf-886c-905cb2025a1b None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:37.359289 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-190d5cef-d174-4dcf-886c-905cb2025a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:37.688491 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1143/2269] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:55:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 503 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:55:37.726119 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617967ec-b6b1-4051-a900-613b1c94fe3f admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:37.729933 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-617967ec-b6b1-4051-a900-613b1c94fe3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:37.813731 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:38.098566 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617967ec-b6b1-4051-a900-613b1c94fe3f admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:38.121499 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0778ee3-86ae-485b-b3c0-94c202299331 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:38.122611 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0778ee3-86ae-485b-b3c0-94c202299331 service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:38.132137 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0778ee3-86ae-485b-b3c0-94c202299331 service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:38.132724 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0778ee3-86ae-485b-b3c0-94c202299331 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:38.181815 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0778ee3-86ae-485b-b3c0-94c202299331 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:38.185296 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0778ee3-86ae-485b-b3c0-94c202299331 service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:38.264552 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1127/2270] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:55:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:55:38.925967 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ff486-b187-4cdc-98fa-29e588d535b0 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:38.926799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ff486-b187-4cdc-98fa-29e588d535b0 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:38.926799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ff486-b187-4cdc-98fa-29e588d535b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:39.050093 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-af4ff486-b187-4cdc-98fa-29e588d535b0 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:39.058479 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-af4ff486-b187-4cdc-98fa-29e588d535b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:39.096359 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1144/2271] 10.222.0.112 () {58 vars in 1017 bytes} [Thu Sep 8 13:55:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:55:39.136225 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0778ee3-86ae-485b-b3c0-94c202299331 service neutron] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:39.139817 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-f0778ee3-86ae-485b-b3c0-94c202299331 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:39.720918 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0778ee3-86ae-485b-b3c0-94c202299331 service neutron] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:39.767527 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b9e28f-0c8e-45d8-bfcc-6c9668f3951b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:39.768558 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9e28f-0c8e-45d8-bfcc-6c9668f3951b service nova] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:39.768811 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9e28f-0c8e-45d8-bfcc-6c9668f3951b service nova] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:39.769089 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b9e28f-0c8e-45d8-bfcc-6c9668f3951b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:39.826364 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b9e28f-0c8e-45d8-bfcc-6c9668f3951b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:39.828825 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b9e28f-0c8e-45d8-bfcc-6c9668f3951b service nova] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:39.874225 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1128/2272] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:55:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 740 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:55:40.667831 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ff486-b187-4cdc-98fa-29e588d535b0 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:40.674527 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-af4ff486-b187-4cdc-98fa-29e588d535b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:40.733171 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ff486-b187-4cdc-98fa-29e588d535b0 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:40.775667 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a25381d-7d19-47ee-9c80-5a6cb301c4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:40.777219 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25381d-7d19-47ee-9c80-5a6cb301c4d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:40.778038 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25381d-7d19-47ee-9c80-5a6cb301c4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:40.778881 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25381d-7d19-47ee-9c80-5a6cb301c4d9 admin admin] PATH_INFO: `/v3/projects/c04a6b38c229429b87ab7b0fe1d88510` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:40.782007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a25381d-7d19-47ee-9c80-5a6cb301c4d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c04a6b38c229429b87ab7b0fe1d88510)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:40.788988 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c42316-b719-4a8b-9e17-aeed98181d9a None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:40.789727 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c42316-b719-4a8b-9e17-aeed98181d9a None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:40.789727 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c42316-b719-4a8b-9e17-aeed98181d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:40.792349 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a25381d-7d19-47ee-9c80-5a6cb301c4d9 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:40.835030 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-d9c42316-b719-4a8b-9e17-aeed98181d9a None None] MFA Rules not processed for user `5eb6e03e874d4b28aaf21c5b36f7bb98`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:40.837548 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-d9c42316-b719-4a8b-9e17-aeed98181d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:40.865330 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:40.962645 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-3a25381d-7d19-47ee-9c80-5a6cb301c4d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c04a6b38c229429b87ab7b0fe1d88510', 'request_id': 'req-3a25381d-7d19-47ee-9c80-5a6cb301c4d9'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:41.003825 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-3a25381d-7d19-47ee-9c80-5a6cb301c4d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c04a6b38c229429b87ab7b0fe1d88510', 'request_id': 'req-3a25381d-7d19-47ee-9c80-5a6cb301c4d9'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:41.043865 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-3a25381d-7d19-47ee-9c80-5a6cb301c4d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c04a6b38c229429b87ab7b0fe1d88510', 'request_id': 'req-3a25381d-7d19-47ee-9c80-5a6cb301c4d9'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:41.080357 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1129/2273] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:55:40 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:55:41.082336 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c42316-b719-4a8b-9e17-aeed98181d9a None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:41.094115 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-3a25381d-7d19-47ee-9c80-5a6cb301c4d9 admin admin] The token cache is being invalidate because project c04a6b38c229429b87ab7b0fe1d88510 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:55:41.094684 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-3a25381d-7d19-47ee-9c80-5a6cb301c4d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:41.095863 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-3a25381d-7d19-47ee-9c80-5a6cb301c4d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:41.096883 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-d9c42316-b719-4a8b-9e17-aeed98181d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:41.102303 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1145/2274] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:55:40 2022] DELETE /identity/v3/projects/c04a6b38c229429b87ab7b0fe1d88510 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:55:41.103556 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a25381d-7d19-47ee-9c80-5a6cb301c4d9 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:41.106947 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-3a25381d-7d19-47ee-9c80-5a6cb301c4d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:41.129187 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c42316-b719-4a8b-9e17-aeed98181d9a None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:41.269990 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a25381d-7d19-47ee-9c80-5a6cb301c4d9 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:41.301621 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4758b55-af48-441d-96fc-85ffc4b384b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:41.302957 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4758b55-af48-441d-96fc-85ffc4b384b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:41.303906 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:41.304326 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4758b55-af48-441d-96fc-85ffc4b384b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:41.305135 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4758b55-af48-441d-96fc-85ffc4b384b6 admin admin] PATH_INFO: `/v3/users/df0df50059b241dba2b488023a40a8f0` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:41.307601 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4758b55-af48-441d-96fc-85ffc4b384b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df0df50059b241dba2b488023a40a8f0)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:41.312398 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4758b55-af48-441d-96fc-85ffc4b384b6 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:41.332274 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da8800-4a93-4588-bdc5-27c3a1016fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:41.332934 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da8800-4a93-4588-bdc5-27c3a1016fde admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:41.333224 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da8800-4a93-4588-bdc5-27c3a1016fde admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:41.333514 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da8800-4a93-4588-bdc5-27c3a1016fde admin admin] PATH_INFO: `/v3/users/460526730574439ba39760db1a99ed88` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:41.334755 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da8800-4a93-4588-bdc5-27c3a1016fde admin admin] RBAC: Authorizing `identity:delete_user(user_id=460526730574439ba39760db1a99ed88)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:41.337283 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da8800-4a93-4588-bdc5-27c3a1016fde admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:41.442630 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-a4758b55-af48-441d-96fc-85ffc4b384b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df0df50059b241dba2b488023a40a8f0'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:41.443426 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-a4758b55-af48-441d-96fc-85ffc4b384b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df0df50059b241dba2b488023a40a8f0'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:41.445102 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-a4758b55-af48-441d-96fc-85ffc4b384b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df0df50059b241dba2b488023a40a8f0'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:41.463577 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-a4758b55-af48-441d-96fc-85ffc4b384b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df0df50059b241dba2b488023a40a8f0'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:41.487404 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-71da8800-4a93-4588-bdc5-27c3a1016fde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '460526730574439ba39760db1a99ed88'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:41.490337 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-a4758b55-af48-441d-96fc-85ffc4b384b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df0df50059b241dba2b488023a40a8f0'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:41.490914 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-71da8800-4a93-4588-bdc5-27c3a1016fde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '460526730574439ba39760db1a99ed88'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:41.519868 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-71da8800-4a93-4588-bdc5-27c3a1016fde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '460526730574439ba39760db1a99ed88'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:41.522165 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1146/2275] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:55:41 2022] DELETE /identity/v3/users/df0df50059b241dba2b488023a40a8f0 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:55:41.576488 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-71da8800-4a93-4588-bdc5-27c3a1016fde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '460526730574439ba39760db1a99ed88'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:41.578280 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-71da8800-4a93-4588-bdc5-27c3a1016fde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '460526730574439ba39760db1a99ed88'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:41.619616 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1130/2276] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:55:41 2022] DELETE /identity/v3/users/460526730574439ba39760db1a99ed88 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:55:41.626394 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c3381-2d2e-4858-ad74-8d87b5e7b401 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:41.626803 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c3381-2d2e-4858-ad74-8d87b5e7b401 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:41.627216 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c3381-2d2e-4858-ad74-8d87b5e7b401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:41.659961 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-e38c3381-2d2e-4858-ad74-8d87b5e7b401 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:41.662265 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-e38c3381-2d2e-4858-ad74-8d87b5e7b401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:41.734104 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:41.869855 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1147/2277] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:55:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:55:41.930943 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da8800-4a93-4588-bdc5-27c3a1016fde admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:41.932466 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-71da8800-4a93-4588-bdc5-27c3a1016fde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:42.102080 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da8800-4a93-4588-bdc5-27c3a1016fde admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:42.111948 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf9853-00c8-4402-b32f-7b33177155e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:42.113322 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf9853-00c8-4402-b32f-7b33177155e8 service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:42.113934 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf9853-00c8-4402-b32f-7b33177155e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:42.122056 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf9853-00c8-4402-b32f-7b33177155e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:42.142291 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf9853-00c8-4402-b32f-7b33177155e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:42.145646 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf9853-00c8-4402-b32f-7b33177155e8 service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:42.193162 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1131/2278] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:55:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:55:42.212644 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c3381-2d2e-4858-ad74-8d87b5e7b401 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:42.214980 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-e38c3381-2d2e-4858-ad74-8d87b5e7b401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:42.241913 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c3381-2d2e-4858-ad74-8d87b5e7b401 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:42.258950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f18bb-cdbd-48be-8315-9da07c7722fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:42.259574 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f18bb-cdbd-48be-8315-9da07c7722fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:42.259853 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f18bb-cdbd-48be-8315-9da07c7722fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:42.260130 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f18bb-cdbd-48be-8315-9da07c7722fd admin admin] PATH_INFO: `/v3/projects/c8305a7fdfd54f289b8eca99bbbcf43d` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:42.264358 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8f18bb-cdbd-48be-8315-9da07c7722fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8305a7fdfd54f289b8eca99bbbcf43d)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:42.267929 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8f18bb-cdbd-48be-8315-9da07c7722fd admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:42.399597 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-8f8f18bb-cdbd-48be-8315-9da07c7722fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8305a7fdfd54f289b8eca99bbbcf43d', 'request_id': 'req-8f8f18bb-cdbd-48be-8315-9da07c7722fd'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:42.414039 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-8f8f18bb-cdbd-48be-8315-9da07c7722fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8305a7fdfd54f289b8eca99bbbcf43d', 'request_id': 'req-8f8f18bb-cdbd-48be-8315-9da07c7722fd'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:42.432269 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-8f8f18bb-cdbd-48be-8315-9da07c7722fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8305a7fdfd54f289b8eca99bbbcf43d', 'request_id': 'req-8f8f18bb-cdbd-48be-8315-9da07c7722fd'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:42.454725 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-8f8f18bb-cdbd-48be-8315-9da07c7722fd admin admin] The token cache is being invalidate because project c8305a7fdfd54f289b8eca99bbbcf43d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:55:42.455057 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-8f8f18bb-cdbd-48be-8315-9da07c7722fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:42.455958 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-8f8f18bb-cdbd-48be-8315-9da07c7722fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:42.461422 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1148/2279] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:55:42 2022] DELETE /identity/v3/projects/c8305a7fdfd54f289b8eca99bbbcf43d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:55:42.463883 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf9853-00c8-4402-b32f-7b33177155e8 service neutron] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:42.497068 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf9853-00c8-4402-b32f-7b33177155e8 service neutron] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:42.601076 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3160a24-f3c8-4cb4-b20e-efc87057da08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:42.601960 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3160a24-f3c8-4cb4-b20e-efc87057da08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:42.602339 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3160a24-f3c8-4cb4-b20e-efc87057da08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:42.602718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3160a24-f3c8-4cb4-b20e-efc87057da08 admin admin] PATH_INFO: `/v3/users/32a78cb2fe914eab806049cbc4c889db` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:42.604120 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3160a24-f3c8-4cb4-b20e-efc87057da08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32a78cb2fe914eab806049cbc4c889db)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:42.607521 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3160a24-f3c8-4cb4-b20e-efc87057da08 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:42.623712 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:42.716914 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-a3160a24-f3c8-4cb4-b20e-efc87057da08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32a78cb2fe914eab806049cbc4c889db'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:42.717604 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-a3160a24-f3c8-4cb4-b20e-efc87057da08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32a78cb2fe914eab806049cbc4c889db'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:42.730744 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-a3160a24-f3c8-4cb4-b20e-efc87057da08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32a78cb2fe914eab806049cbc4c889db'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:42.758698 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-a3160a24-f3c8-4cb4-b20e-efc87057da08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32a78cb2fe914eab806049cbc4c889db'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:42.759688 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-a3160a24-f3c8-4cb4-b20e-efc87057da08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32a78cb2fe914eab806049cbc4c889db'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:42.788320 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1132/2280] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:55:42 2022] DELETE /identity/v3/users/32a78cb2fe914eab806049cbc4c889db => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:55:43.633299 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f18bb-cdbd-48be-8315-9da07c7722fd admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:43.637246 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-8f8f18bb-cdbd-48be-8315-9da07c7722fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:43.675582 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f18bb-cdbd-48be-8315-9da07c7722fd admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:43.913409 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300dba9-07ad-4e17-bc3f-bbd641c4bb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:43.914423 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300dba9-07ad-4e17-bc3f-bbd641c4bb67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:43.914909 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300dba9-07ad-4e17-bc3f-bbd641c4bb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:43.915400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300dba9-07ad-4e17-bc3f-bbd641c4bb67 admin admin] PATH_INFO: `/v3/projects/cb826dad02d446d084761149d0998e3f` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:43.917812 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1300dba9-07ad-4e17-bc3f-bbd641c4bb67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb826dad02d446d084761149d0998e3f)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:43.920808 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1300dba9-07ad-4e17-bc3f-bbd641c4bb67 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:44.096764 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-1300dba9-07ad-4e17-bc3f-bbd641c4bb67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb826dad02d446d084761149d0998e3f', 'request_id': 'req-1300dba9-07ad-4e17-bc3f-bbd641c4bb67'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:44.139070 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:44.148967 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-1300dba9-07ad-4e17-bc3f-bbd641c4bb67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb826dad02d446d084761149d0998e3f', 'request_id': 'req-1300dba9-07ad-4e17-bc3f-bbd641c4bb67'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:44.179632 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-1300dba9-07ad-4e17-bc3f-bbd641c4bb67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb826dad02d446d084761149d0998e3f', 'request_id': 'req-1300dba9-07ad-4e17-bc3f-bbd641c4bb67'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:44.229660 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-1300dba9-07ad-4e17-bc3f-bbd641c4bb67 admin admin] The token cache is being invalidate because project cb826dad02d446d084761149d0998e3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:55:44.235601 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-1300dba9-07ad-4e17-bc3f-bbd641c4bb67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:44.238475 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-1300dba9-07ad-4e17-bc3f-bbd641c4bb67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:44.329509 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1149/2281] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:55:43 2022] DELETE /identity/v3/projects/cb826dad02d446d084761149d0998e3f => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:55:44.558805 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3160a24-f3c8-4cb4-b20e-efc87057da08 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:44.561901 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-a3160a24-f3c8-4cb4-b20e-efc87057da08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:44.668969 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3160a24-f3c8-4cb4-b20e-efc87057da08 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:44.705917 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fe54e-47bc-4bbf-b804-3f625ce3e29e None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:44.706459 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fe54e-47bc-4bbf-b804-3f625ce3e29e None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:44.706459 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fe54e-47bc-4bbf-b804-3f625ce3e29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:44.762704 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-cf6fe54e-47bc-4bbf-b804-3f625ce3e29e None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:44.767900 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-cf6fe54e-47bc-4bbf-b804-3f625ce3e29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:44.878778 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6dbe0-f06b-41fa-8dd2-2476c715439e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:44.881656 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6dbe0-f06b-41fa-8dd2-2476c715439e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:44.882348 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6dbe0-f06b-41fa-8dd2-2476c715439e admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:44.882854 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6dbe0-f06b-41fa-8dd2-2476c715439e admin admin] PATH_INFO: `/v3/projects/c77248b34b8f4dea87490c1c57be1c61` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:44.885413 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d6dbe0-f06b-41fa-8dd2-2476c715439e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c77248b34b8f4dea87490c1c57be1c61)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:44.893773 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d6dbe0-f06b-41fa-8dd2-2476c715439e admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:45.065305 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-31d6dbe0-f06b-41fa-8dd2-2476c715439e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c77248b34b8f4dea87490c1c57be1c61', 'request_id': 'req-31d6dbe0-f06b-41fa-8dd2-2476c715439e'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:45.087180 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1150/2282] 10.222.0.112 () {58 vars in 1017 bytes} [Thu Sep 8 13:55:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:55:45.092365 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-31d6dbe0-f06b-41fa-8dd2-2476c715439e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c77248b34b8f4dea87490c1c57be1c61', 'request_id': 'req-31d6dbe0-f06b-41fa-8dd2-2476c715439e'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:45.093761 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232990c2-6d36-4d83-8985-32b78b2950db None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:45.095011 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232990c2-6d36-4d83-8985-32b78b2950db None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:45.095822 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232990c2-6d36-4d83-8985-32b78b2950db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:45.123415 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-31d6dbe0-f06b-41fa-8dd2-2476c715439e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c77248b34b8f4dea87490c1c57be1c61', 'request_id': 'req-31d6dbe0-f06b-41fa-8dd2-2476c715439e'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:45.165531 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-232990c2-6d36-4d83-8985-32b78b2950db None None] MFA Rules not processed for user `6d2dd101d1a14e5ab95f272ab1bbeb94`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:45.168318 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-232990c2-6d36-4d83-8985-32b78b2950db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:45.197394 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-31d6dbe0-f06b-41fa-8dd2-2476c715439e admin admin] The token cache is being invalidate because project c77248b34b8f4dea87490c1c57be1c61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:55:45.197394 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-31d6dbe0-f06b-41fa-8dd2-2476c715439e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:45.199199 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-31d6dbe0-f06b-41fa-8dd2-2476c715439e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:45.206917 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1133/2283] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:55:44 2022] DELETE /identity/v3/projects/c77248b34b8f4dea87490c1c57be1c61 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:55:45.215988 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6dbe0-f06b-41fa-8dd2-2476c715439e admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:45.226167 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-31d6dbe0-f06b-41fa-8dd2-2476c715439e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:45.341173 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:45.466378 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1151/2284] 10.222.0.69 () {58 vars in 1009 bytes} [Thu Sep 8 13:55:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:55:45.501979 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232990c2-6d36-4d83-8985-32b78b2950db None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:45.504207 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-232990c2-6d36-4d83-8985-32b78b2950db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:45.522942 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6dbe0-f06b-41fa-8dd2-2476c715439e admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:45.569942 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bf2c4-0e6e-4a42-a3e8-96f3cee454ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:45.597599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bf2c4-0e6e-4a42-a3e8-96f3cee454ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:45.600670 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bf2c4-0e6e-4a42-a3e8-96f3cee454ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:45.602292 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bf2c4-0e6e-4a42-a3e8-96f3cee454ad admin admin] PATH_INFO: `/v3/users/580f04a4a94241efa221f10ce5435fcb` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:45.621468 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06bf2c4-0e6e-4a42-a3e8-96f3cee454ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=580f04a4a94241efa221f10ce5435fcb)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:45.631772 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06bf2c4-0e6e-4a42-a3e8-96f3cee454ad admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:45.841539 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-e06bf2c4-0e6e-4a42-a3e8-96f3cee454ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '580f04a4a94241efa221f10ce5435fcb'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:45.845905 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-e06bf2c4-0e6e-4a42-a3e8-96f3cee454ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '580f04a4a94241efa221f10ce5435fcb'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:45.888195 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-e06bf2c4-0e6e-4a42-a3e8-96f3cee454ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '580f04a4a94241efa221f10ce5435fcb'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:45.939042 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-e06bf2c4-0e6e-4a42-a3e8-96f3cee454ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '580f04a4a94241efa221f10ce5435fcb'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:45.940599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-e06bf2c4-0e6e-4a42-a3e8-96f3cee454ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '580f04a4a94241efa221f10ce5435fcb'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:45.941867 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232990c2-6d36-4d83-8985-32b78b2950db None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:45.964982 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1a14e-61b7-4022-b023-54ff97c542f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9b97592a6840c3865d7dcf886221e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:45.969480 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1a14e-61b7-4022-b023-54ff97c542f7 service swift] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:45.969905 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1a14e-61b7-4022-b023-54ff97c542f7 service swift] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:45.970323 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1a14e-61b7-4022-b023-54ff97c542f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:45.976315 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-eac1a14e-61b7-4022-b023-54ff97c542f7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:45.999939 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1134/2285] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:55:45 2022] DELETE /identity/v3/users/580f04a4a94241efa221f10ce5435fcb => generated 0 bytes in 782 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:55:46.011252 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bf2c4-0e6e-4a42-a3e8-96f3cee454ad admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:46.022572 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-e06bf2c4-0e6e-4a42-a3e8-96f3cee454ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:46.058545 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac1a14e-61b7-4022-b023-54ff97c542f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:46.061550 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac1a14e-61b7-4022-b023-54ff97c542f7 service swift] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:46.090341 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1152/2286] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Sep 8 13:55:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 08 13:55:46.404449 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bf2c4-0e6e-4a42-a3e8-96f3cee454ad admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:46.430356 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea995ce-72a9-4465-a4cb-0ea81649f89d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:46.432302 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea995ce-72a9-4465-a4cb-0ea81649f89d service nova] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:46.433168 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea995ce-72a9-4465-a4cb-0ea81649f89d service nova] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:46.434089 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea995ce-72a9-4465-a4cb-0ea81649f89d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:46.439972 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-5ea995ce-72a9-4465-a4cb-0ea81649f89d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:46.585676 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:46.738451 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea995ce-72a9-4465-a4cb-0ea81649f89d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:46.752495 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea995ce-72a9-4465-a4cb-0ea81649f89d service nova] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:46.818527 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1135/2287] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:55:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 808 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:55:47.210590 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1a14e-61b7-4022-b023-54ff97c542f7 service swift] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:47.214138 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-eac1a14e-61b7-4022-b023-54ff97c542f7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:47.278379 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1a14e-61b7-4022-b023-54ff97c542f7 service swift] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:47.295842 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44648b36-37a3-4989-9f5b-3dbc3b959ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:47.298047 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44648b36-37a3-4989-9f5b-3dbc3b959ced admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:47.298689 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44648b36-37a3-4989-9f5b-3dbc3b959ced admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:47.299366 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44648b36-37a3-4989-9f5b-3dbc3b959ced admin admin] PATH_INFO: `/v3/projects/206e665169774ae2a0e2cd53d0978fe1` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:47.302371 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44648b36-37a3-4989-9f5b-3dbc3b959ced admin admin] RBAC: Authorizing `identity:delete_project(project_id=206e665169774ae2a0e2cd53d0978fe1)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:47.306969 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44648b36-37a3-4989-9f5b-3dbc3b959ced admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:47.382708 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:47.476888 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-44648b36-37a3-4989-9f5b-3dbc3b959ced admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '206e665169774ae2a0e2cd53d0978fe1', 'request_id': 'req-44648b36-37a3-4989-9f5b-3dbc3b959ced'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:47.491259 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-44648b36-37a3-4989-9f5b-3dbc3b959ced admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '206e665169774ae2a0e2cd53d0978fe1', 'request_id': 'req-44648b36-37a3-4989-9f5b-3dbc3b959ced'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:47.523006 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-44648b36-37a3-4989-9f5b-3dbc3b959ced admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '206e665169774ae2a0e2cd53d0978fe1', 'request_id': 'req-44648b36-37a3-4989-9f5b-3dbc3b959ced'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:47.574584 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-44648b36-37a3-4989-9f5b-3dbc3b959ced admin admin] The token cache is being invalidate because project 206e665169774ae2a0e2cd53d0978fe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:55:47.574982 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-44648b36-37a3-4989-9f5b-3dbc3b959ced admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:47.576387 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-44648b36-37a3-4989-9f5b-3dbc3b959ced admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:47.581294 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1153/2288] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:55:47 2022] DELETE /identity/v3/projects/206e665169774ae2a0e2cd53d0978fe1 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:55:47.587361 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae134259-80a2-4450-8ca4-05c1a5d66588 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:47.588179 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae134259-80a2-4450-8ca4-05c1a5d66588 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:47.588346 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae134259-80a2-4450-8ca4-05c1a5d66588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:47.664307 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-ae134259-80a2-4450-8ca4-05c1a5d66588 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:47.668213 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-ae134259-80a2-4450-8ca4-05c1a5d66588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:47.868844 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1136/2289] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:55:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:55:47.882478 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be488c74-e586-4f6b-8863-df024886f18d None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:47.883341 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be488c74-e586-4f6b-8863-df024886f18d None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:47.883770 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be488c74-e586-4f6b-8863-df024886f18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:47.944640 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-be488c74-e586-4f6b-8863-df024886f18d None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:47.947123 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-be488c74-e586-4f6b-8863-df024886f18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:47.963929 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1154/2290] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:55:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:55:47.970263 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae134259-80a2-4450-8ca4-05c1a5d66588 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:47.992578 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae134259-80a2-4450-8ca4-05c1a5d66588 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:48.009726 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63246cb-c13f-4adc-ba56-2203bbf2b6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:48.011019 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63246cb-c13f-4adc-ba56-2203bbf2b6ae admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:48.011661 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63246cb-c13f-4adc-ba56-2203bbf2b6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:48.012831 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63246cb-c13f-4adc-ba56-2203bbf2b6ae admin admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:48.014517 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63246cb-c13f-4adc-ba56-2203bbf2b6ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:55:48.017428 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63246cb-c13f-4adc-ba56-2203bbf2b6ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:48.021200 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63246cb-c13f-4adc-ba56-2203bbf2b6ae admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:48.065059 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1137/2291] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 13:55:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:55:48.072300 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be488c74-e586-4f6b-8863-df024886f18d None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:48.102747 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be488c74-e586-4f6b-8863-df024886f18d None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:48.136847 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81930a57-810b-432a-b873-a5e9f1b437c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:48.140609 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81930a57-810b-432a-b873-a5e9f1b437c6 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:48.144137 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81930a57-810b-432a-b873-a5e9f1b437c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:48.144748 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81930a57-810b-432a-b873-a5e9f1b437c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:48.159195 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81930a57-810b-432a-b873-a5e9f1b437c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:48.174124 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81930a57-810b-432a-b873-a5e9f1b437c6 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:48.314603 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1155/2292] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:55:48 2022] POST /identity/v3/projects => generated 381 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:55:48.316749 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63246cb-c13f-4adc-ba56-2203bbf2b6ae admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:48.364481 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63246cb-c13f-4adc-ba56-2203bbf2b6ae admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:48.751953 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53115b-d4bb-44e5-bea5-0a633ae2a78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:48.765456 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53115b-d4bb-44e5-bea5-0a633ae2a78a admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:48.765456 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53115b-d4bb-44e5-bea5-0a633ae2a78a admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:48.765456 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53115b-d4bb-44e5-bea5-0a633ae2a78a admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:48.774002 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d53115b-d4bb-44e5-bea5-0a633ae2a78a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:48.781576 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d53115b-d4bb-44e5-bea5-0a633ae2a78a admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:48.915757 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1138/2293] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:55:48 2022] POST /identity/v3/users => generated 291 bytes in 600 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:55:48.919786 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81930a57-810b-432a-b873-a5e9f1b437c6 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:48.977633 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81930a57-810b-432a-b873-a5e9f1b437c6 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:49.001523 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981071fe-eb21-4cff-b758-6ae87e023b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:49.003400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981071fe-eb21-4cff-b758-6ae87e023b0b admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:49.003915 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981071fe-eb21-4cff-b758-6ae87e023b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:49.011396 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981071fe-eb21-4cff-b758-6ae87e023b0b admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:49.013265 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981071fe-eb21-4cff-b758-6ae87e023b0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:49.033709 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981071fe-eb21-4cff-b758-6ae87e023b0b admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:49.087470 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53115b-d4bb-44e5-bea5-0a633ae2a78a admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:49.125499 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1156/2294] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:55:48 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:55:49.142958 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53115b-d4bb-44e5-bea5-0a633ae2a78a admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:49.191480 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2186ed-1f1b-458e-ab62-9584dd4c8735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:49.192556 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2186ed-1f1b-458e-ab62-9584dd4c8735 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:49.193050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2186ed-1f1b-458e-ab62-9584dd4c8735 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:49.197490 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2186ed-1f1b-458e-ab62-9584dd4c8735 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:49.203230 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2186ed-1f1b-458e-ab62-9584dd4c8735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:49.213596 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2186ed-1f1b-458e-ab62-9584dd4c8735 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:49.267003 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1139/2295] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:55:49.268913 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981071fe-eb21-4cff-b758-6ae87e023b0b admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:49.304858 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981071fe-eb21-4cff-b758-6ae87e023b0b admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:49.313792 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14014aa-88db-4b49-bc61-26e013b58a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:49.315275 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14014aa-88db-4b49-bc61-26e013b58a6e admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:49.316764 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14014aa-88db-4b49-bc61-26e013b58a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:49.317481 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14014aa-88db-4b49-bc61-26e013b58a6e admin admin] PATH_INFO: `/v3/projects/62d0dd12aa684faf835ef0ef022ef85a/users/7296918d1ede4f7b845219ebfb17ab65/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:49.419045 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14014aa-88db-4b49-bc61-26e013b58a6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=62d0dd12aa684faf835ef0ef022ef85a, user_id=7296918d1ede4f7b845219ebfb17ab65, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:49.432793 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14014aa-88db-4b49-bc61-26e013b58a6e admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:49.491837 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1157/2296] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:55:49 2022] PUT /identity/v3/projects/62d0dd12aa684faf835ef0ef022ef85a/users/7296918d1ede4f7b845219ebfb17ab65/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:55:49.518927 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6408b9-ced8-49ca-a8e8-cd6381c9c202 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:49.519546 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6408b9-ced8-49ca-a8e8-cd6381c9c202 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:49.520109 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6408b9-ced8-49ca-a8e8-cd6381c9c202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:49.637337 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-3f6408b9-ced8-49ca-a8e8-cd6381c9c202 None None] MFA Rules not processed for user `7296918d1ede4f7b845219ebfb17ab65`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:49.640423 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-3f6408b9-ced8-49ca-a8e8-cd6381c9c202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:49.757992 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:49.951619 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1140/2297] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:55:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 434 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:55:49.959503 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14014aa-88db-4b49-bc61-26e013b58a6e admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:50.239556 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14014aa-88db-4b49-bc61-26e013b58a6e admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:50.266534 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b3fc6-3240-47d5-ade5-abf71edd183f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:50.267707 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b3fc6-3240-47d5-ade5-abf71edd183f admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:50.268159 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b3fc6-3240-47d5-ade5-abf71edd183f admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:50.268647 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b3fc6-3240-47d5-ade5-abf71edd183f admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:50.283974 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9b3fc6-3240-47d5-ade5-abf71edd183f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:50.293898 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9b3fc6-3240-47d5-ade5-abf71edd183f admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:50.402033 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1158/2298] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:55:49 2022] POST /identity/v3/projects => generated 381 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:55:50.403685 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6408b9-ced8-49ca-a8e8-cd6381c9c202 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:50.452268 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6408b9-ced8-49ca-a8e8-cd6381c9c202 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:50.777405 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc04d7c-5779-4c37-a688-23cb780b4b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:50.781484 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc04d7c-5779-4c37-a688-23cb780b4b2c admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:50.785089 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc04d7c-5779-4c37-a688-23cb780b4b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:50.787153 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc04d7c-5779-4c37-a688-23cb780b4b2c admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:50.789813 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc04d7c-5779-4c37-a688-23cb780b4b2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:50.800873 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc04d7c-5779-4c37-a688-23cb780b4b2c admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:50.910702 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1141/2299] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:55:50 2022] POST /identity/v3/users => generated 297 bytes in 508 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:55:50.916741 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b3fc6-3240-47d5-ade5-abf71edd183f admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:50.943617 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b3fc6-3240-47d5-ade5-abf71edd183f admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:50.958689 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ffd5dc-1246-4c67-bdfc-288cdf8a68f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:50.962430 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffd5dc-1246-4c67-bdfc-288cdf8a68f7 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:50.965190 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffd5dc-1246-4c67-bdfc-288cdf8a68f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:50.965901 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ffd5dc-1246-4c67-bdfc-288cdf8a68f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:50.967315 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ffd5dc-1246-4c67-bdfc-288cdf8a68f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:50.972123 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ffd5dc-1246-4c67-bdfc-288cdf8a68f7 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:51.018365 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1159/2300] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 13:55:51.029315 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc04d7c-5779-4c37-a688-23cb780b4b2c admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:51.057979 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc04d7c-5779-4c37-a688-23cb780b4b2c admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:51.082057 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78861fa-3c74-4654-9817-ee16fb681b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:51.084151 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78861fa-3c74-4654-9817-ee16fb681b5b admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:51.085061 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78861fa-3c74-4654-9817-ee16fb681b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:51.086981 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78861fa-3c74-4654-9817-ee16fb681b5b admin admin] PATH_INFO: `/v3/projects/017f1be90c4f425d86f20163d97b38de/users/df4798606fbe4ab9a4e7cd8875bf9e13/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:51.214617 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78861fa-3c74-4654-9817-ee16fb681b5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=017f1be90c4f425d86f20163d97b38de, user_id=df4798606fbe4ab9a4e7cd8875bf9e13, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:51.232396 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78861fa-3c74-4654-9817-ee16fb681b5b admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:51.283361 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1142/2301] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:55:51 2022] PUT /identity/v3/projects/017f1be90c4f425d86f20163d97b38de/users/df4798606fbe4ab9a4e7cd8875bf9e13/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:55:51.289162 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ffd5dc-1246-4c67-bdfc-288cdf8a68f7 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:51.328690 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ffd5dc-1246-4c67-bdfc-288cdf8a68f7 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:51.374316 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:51.554662 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff42760-caef-47d4-96e9-52ab6bcebc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:51.563214 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff42760-caef-47d4-96e9-52ab6bcebc51 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:51.563891 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff42760-caef-47d4-96e9-52ab6bcebc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:51.564426 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff42760-caef-47d4-96e9-52ab6bcebc51 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:51.565649 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff42760-caef-47d4-96e9-52ab6bcebc51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:51.583487 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff42760-caef-47d4-96e9-52ab6bcebc51 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:51.643569 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78861fa-3c74-4654-9817-ee16fb681b5b admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:51.651281 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1160/2302] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:55:51.659795 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78861fa-3c74-4654-9817-ee16fb681b5b admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:51.689133 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7815b9-d95e-4970-99aa-03e7a1059606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:51.690349 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7815b9-d95e-4970-99aa-03e7a1059606 admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:51.690637 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7815b9-d95e-4970-99aa-03e7a1059606 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:51.691061 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7815b9-d95e-4970-99aa-03e7a1059606 admin admin] PATH_INFO: `/v3/projects/017f1be90c4f425d86f20163d97b38de/users/df4798606fbe4ab9a4e7cd8875bf9e13/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:51.700546 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7815b9-d95e-4970-99aa-03e7a1059606 admin admin] RBAC: Authorizing `identity:create_grant(project_id=017f1be90c4f425d86f20163d97b38de, user_id=df4798606fbe4ab9a4e7cd8875bf9e13, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:51.710108 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7815b9-d95e-4970-99aa-03e7a1059606 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:51.773037 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1143/2303] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:55:51 2022] PUT /identity/v3/projects/017f1be90c4f425d86f20163d97b38de/users/df4798606fbe4ab9a4e7cd8875bf9e13/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:55:51.797668 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf972492-381f-400f-aba6-b134541dffad None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:51.798231 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf972492-381f-400f-aba6-b134541dffad None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:51.798760 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf972492-381f-400f-aba6-b134541dffad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:51.913744 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-bf972492-381f-400f-aba6-b134541dffad None None] MFA Rules not processed for user `df4798606fbe4ab9a4e7cd8875bf9e13`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:51.915430 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-bf972492-381f-400f-aba6-b134541dffad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:52.211669 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1161/2304] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:55:51 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:55:52.227358 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7815b9-d95e-4970-99aa-03e7a1059606 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:52.230912 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-bd7815b9-d95e-4970-99aa-03e7a1059606 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:52.456571 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7815b9-d95e-4970-99aa-03e7a1059606 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:52.471286 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2b91c-1e74-432e-b81a-7fa7cb921049 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:52.475844 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2b91c-1e74-432e-b81a-7fa7cb921049 service cinder] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:52.476928 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2b91c-1e74-432e-b81a-7fa7cb921049 service cinder] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:52.477908 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2b91c-1e74-432e-b81a-7fa7cb921049 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:52.509640 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a2b91c-1e74-432e-b81a-7fa7cb921049 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:52.517077 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a2b91c-1e74-432e-b81a-7fa7cb921049 service cinder] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:52.592074 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1144/2305] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:55:52 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:55:52.612981 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c874e44-ffcd-403f-a9ec-d1fc0ec64c7e None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:52.613898 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c874e44-ffcd-403f-a9ec-d1fc0ec64c7e None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:52.614102 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c874e44-ffcd-403f-a9ec-d1fc0ec64c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:52.717275 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-4c874e44-ffcd-403f-a9ec-d1fc0ec64c7e None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:52.719488 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-4c874e44-ffcd-403f-a9ec-d1fc0ec64c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:53.059503 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1162/2306] 10.222.0.112 () {58 vars in 1017 bytes} [Thu Sep 8 13:55:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 448 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:55:53.915154 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2b91c-1e74-432e-b81a-7fa7cb921049 service cinder] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:53.933244 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2b91c-1e74-432e-b81a-7fa7cb921049 service cinder] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:53.960856 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b933d-15e3-449d-9815-120284f0c507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:53.963710 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b933d-15e3-449d-9815-120284f0c507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:53.964191 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b933d-15e3-449d-9815-120284f0c507 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:53.965905 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b933d-15e3-449d-9815-120284f0c507 admin admin] PATH_INFO: `/v3/users/7296918d1ede4f7b845219ebfb17ab65` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:53.973134 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355b933d-15e3-449d-9815-120284f0c507 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7296918d1ede4f7b845219ebfb17ab65)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:53.985238 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355b933d-15e3-449d-9815-120284f0c507 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:54.047079 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:54.105477 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c874e44-ffcd-403f-a9ec-d1fc0ec64c7e None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:54.111253 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-4c874e44-ffcd-403f-a9ec-d1fc0ec64c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:54.183267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-355b933d-15e3-449d-9815-120284f0c507 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7296918d1ede4f7b845219ebfb17ab65'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:54.184602 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-355b933d-15e3-449d-9815-120284f0c507 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7296918d1ede4f7b845219ebfb17ab65'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:54.222246 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-355b933d-15e3-449d-9815-120284f0c507 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7296918d1ede4f7b845219ebfb17ab65'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:54.267667 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-355b933d-15e3-449d-9815-120284f0c507 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7296918d1ede4f7b845219ebfb17ab65'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:54.269271 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-355b933d-15e3-449d-9815-120284f0c507 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7296918d1ede4f7b845219ebfb17ab65'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:54.315491 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1145/2307] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:55:53 2022] DELETE /identity/v3/users/7296918d1ede4f7b845219ebfb17ab65 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:55:54.318988 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb95ad-3695-4fba-a900-d523497deaf0 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:54.319637 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb95ad-3695-4fba-a900-d523497deaf0 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:54.320291 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb95ad-3695-4fba-a900-d523497deaf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:54.330422 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:54.375422 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-fbdb95ad-3695-4fba-a900-d523497deaf0 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:55:54.378017 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-fbdb95ad-3695-4fba-a900-d523497deaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:54.505183 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c874e44-ffcd-403f-a9ec-d1fc0ec64c7e None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:54.604134 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1146/2308] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:55:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:55:54.688401 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad2fc0-ca6d-4343-a629-2d8f252e1e49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:54.689740 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad2fc0-ca6d-4343-a629-2d8f252e1e49 service nova] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:54.691501 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad2fc0-ca6d-4343-a629-2d8f252e1e49 service nova] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:54.691501 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad2fc0-ca6d-4343-a629-2d8f252e1e49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:54.694329 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-d6ad2fc0-ca6d-4343-a629-2d8f252e1e49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:54.707695 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb95ad-3695-4fba-a900-d523497deaf0 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:54.709825 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-fbdb95ad-3695-4fba-a900-d523497deaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:54.733787 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad2fc0-ca6d-4343-a629-2d8f252e1e49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:54.753245 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad2fc0-ca6d-4343-a629-2d8f252e1e49 service nova] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:54.796372 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1163/2309] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:55:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 693 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:55:54.954868 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb95ad-3695-4fba-a900-d523497deaf0 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:54.979914 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27108f7-63b3-4da2-a565-40c66d0ea1ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:54.980558 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27108f7-63b3-4da2-a565-40c66d0ea1ac service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:54.980864 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27108f7-63b3-4da2-a565-40c66d0ea1ac service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:54.981169 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27108f7-63b3-4da2-a565-40c66d0ea1ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:55.013754 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27108f7-63b3-4da2-a565-40c66d0ea1ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:55.015427 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27108f7-63b3-4da2-a565-40c66d0ea1ac service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:55.076313 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1147/2310] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:55:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:55:57.526908 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad2fc0-ca6d-4343-a629-2d8f252e1e49 service nova] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:57.529121 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-d6ad2fc0-ca6d-4343-a629-2d8f252e1e49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:55:57.590627 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad2fc0-ca6d-4343-a629-2d8f252e1e49 service nova] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:57.629192 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05077c51-80d0-4927-b63b-947b99758440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:57.634940 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05077c51-80d0-4927-b63b-947b99758440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:57.640983 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05077c51-80d0-4927-b63b-947b99758440 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:57.643665 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05077c51-80d0-4927-b63b-947b99758440 admin admin] PATH_INFO: `/v3/projects/62d0dd12aa684faf835ef0ef022ef85a` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:57.656041 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05077c51-80d0-4927-b63b-947b99758440 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62d0dd12aa684faf835ef0ef022ef85a)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:57.678779 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05077c51-80d0-4927-b63b-947b99758440 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:57.978715 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-05077c51-80d0-4927-b63b-947b99758440 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62d0dd12aa684faf835ef0ef022ef85a', 'request_id': 'req-05077c51-80d0-4927-b63b-947b99758440'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:57.994728 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-05077c51-80d0-4927-b63b-947b99758440 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62d0dd12aa684faf835ef0ef022ef85a', 'request_id': 'req-05077c51-80d0-4927-b63b-947b99758440'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:58.023765 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-05077c51-80d0-4927-b63b-947b99758440 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62d0dd12aa684faf835ef0ef022ef85a', 'request_id': 'req-05077c51-80d0-4927-b63b-947b99758440'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:58.084744 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-05077c51-80d0-4927-b63b-947b99758440 admin admin] The token cache is being invalidate because project 62d0dd12aa684faf835ef0ef022ef85a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:55:58.086399 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-05077c51-80d0-4927-b63b-947b99758440 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:58.089982 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-05077c51-80d0-4927-b63b-947b99758440 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:58.100197 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1164/2311] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:55:57 2022] DELETE /identity/v3/projects/62d0dd12aa684faf835ef0ef022ef85a => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:55:58.106844 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27108f7-63b3-4da2-a565-40c66d0ea1ac service neutron] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:55:58.171012 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27108f7-63b3-4da2-a565-40c66d0ea1ac service neutron] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:55:58.323391 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:58.397083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcacaf2b-2439-4233-850d-250ef2216fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:55:58.398183 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcacaf2b-2439-4233-850d-250ef2216fea admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:55:58.398648 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcacaf2b-2439-4233-850d-250ef2216fea admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:55:58.399086 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcacaf2b-2439-4233-850d-250ef2216fea admin admin] PATH_INFO: `/v3/users/df4798606fbe4ab9a4e7cd8875bf9e13` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:55:58.401735 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcacaf2b-2439-4233-850d-250ef2216fea admin admin] RBAC: Authorizing `identity:delete_user(user_id=df4798606fbe4ab9a4e7cd8875bf9e13)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:55:58.404728 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcacaf2b-2439-4233-850d-250ef2216fea admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:55:58.637266 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-fcacaf2b-2439-4233-850d-250ef2216fea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df4798606fbe4ab9a4e7cd8875bf9e13'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:58.644492 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-fcacaf2b-2439-4233-850d-250ef2216fea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df4798606fbe4ab9a4e7cd8875bf9e13'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:58.677952 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-fcacaf2b-2439-4233-850d-250ef2216fea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df4798606fbe4ab9a4e7cd8875bf9e13'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:58.715711 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-fcacaf2b-2439-4233-850d-250ef2216fea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df4798606fbe4ab9a4e7cd8875bf9e13'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:58.725561 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-fcacaf2b-2439-4233-850d-250ef2216fea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df4798606fbe4ab9a4e7cd8875bf9e13'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:55:58.770527 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1148/2312] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:55:58 2022] DELETE /identity/v3/users/df4798606fbe4ab9a4e7cd8875bf9e13 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:56:00.584000 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56231693-cfd2-46da-82e2-ac073d007ae7 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:00.585940 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56231693-cfd2-46da-82e2-ac073d007ae7 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:00.586890 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56231693-cfd2-46da-82e2-ac073d007ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:00.710378 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-56231693-cfd2-46da-82e2-ac073d007ae7 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:56:00.714352 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-56231693-cfd2-46da-82e2-ac073d007ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:00.874857 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:00.967428 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1165/2313] 10.222.0.112 () {58 vars in 1017 bytes} [Thu Sep 8 13:56:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:56:01.385185 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcacaf2b-2439-4233-850d-250ef2216fea admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:01.386944 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-fcacaf2b-2439-4233-850d-250ef2216fea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:01.624879 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56231693-cfd2-46da-82e2-ac073d007ae7 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:01.627324 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-56231693-cfd2-46da-82e2-ac073d007ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:01.686685 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56231693-cfd2-46da-82e2-ac073d007ae7 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:01.701149 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93bee04-ca4e-49a1-8a1e-ec09838c5918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:01.707395 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93bee04-ca4e-49a1-8a1e-ec09838c5918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:01.707753 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93bee04-ca4e-49a1-8a1e-ec09838c5918 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:01.707950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93bee04-ca4e-49a1-8a1e-ec09838c5918 admin admin] PATH_INFO: `/v3/projects/017f1be90c4f425d86f20163d97b38de` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:01.715879 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93bee04-ca4e-49a1-8a1e-ec09838c5918 admin admin] RBAC: Authorizing `identity:delete_project(project_id=017f1be90c4f425d86f20163d97b38de)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:01.725585 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93bee04-ca4e-49a1-8a1e-ec09838c5918 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:01.812717 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcacaf2b-2439-4233-850d-250ef2216fea admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:01.844709 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e9638-1a1c-4b26-8744-e6db1a4e388e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:01.845648 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e9638-1a1c-4b26-8744-e6db1a4e388e service nova] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:01.846145 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e9638-1a1c-4b26-8744-e6db1a4e388e service nova] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:01.846647 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e9638-1a1c-4b26-8744-e6db1a4e388e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:01.883223 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35e9638-1a1c-4b26-8744-e6db1a4e388e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:01.886483 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35e9638-1a1c-4b26-8744-e6db1a4e388e service nova] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:01.941451 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1149/2314] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:56:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:56:01.958302 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-d93bee04-ca4e-49a1-8a1e-ec09838c5918 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '017f1be90c4f425d86f20163d97b38de', 'request_id': 'req-d93bee04-ca4e-49a1-8a1e-ec09838c5918'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:02.028936 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-d93bee04-ca4e-49a1-8a1e-ec09838c5918 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '017f1be90c4f425d86f20163d97b38de', 'request_id': 'req-d93bee04-ca4e-49a1-8a1e-ec09838c5918'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:02.058611 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-d93bee04-ca4e-49a1-8a1e-ec09838c5918 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '017f1be90c4f425d86f20163d97b38de', 'request_id': 'req-d93bee04-ca4e-49a1-8a1e-ec09838c5918'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:02.117728 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-d93bee04-ca4e-49a1-8a1e-ec09838c5918 admin admin] The token cache is being invalidate because project 017f1be90c4f425d86f20163d97b38de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:56:02.118783 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-d93bee04-ca4e-49a1-8a1e-ec09838c5918 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:02.122434 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-d93bee04-ca4e-49a1-8a1e-ec09838c5918 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:02.130622 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1166/2315] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:56:01 2022] DELETE /identity/v3/projects/017f1be90c4f425d86f20163d97b38de => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:56:02.139243 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e24b92-444e-4db1-b14a-c21cc9393117 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:02.140393 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e24b92-444e-4db1-b14a-c21cc9393117 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:02.141339 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e24b92-444e-4db1-b14a-c21cc9393117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:02.263820 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-a7e24b92-444e-4db1-b14a-c21cc9393117 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:56:02.274489 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-a7e24b92-444e-4db1-b14a-c21cc9393117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:02.495173 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:02.611566 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1150/2316] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:56:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 475 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:56:02.632343 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f45e6-65ce-450f-a177-4d0dcfbb52c4 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:02.633188 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f45e6-65ce-450f-a177-4d0dcfbb52c4 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:02.633390 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f45e6-65ce-450f-a177-4d0dcfbb52c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:02.711048 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-855f45e6-65ce-450f-a177-4d0dcfbb52c4 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:56:02.714262 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-855f45e6-65ce-450f-a177-4d0dcfbb52c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:02.727913 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1167/2317] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:56:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:56:02.734030 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e24b92-444e-4db1-b14a-c21cc9393117 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:02.761418 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e24b92-444e-4db1-b14a-c21cc9393117 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:02.771455 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e652d0b5-888e-43b1-9ba4-620474c5b22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:02.771455 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652d0b5-888e-43b1-9ba4-620474c5b22c admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:02.772038 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652d0b5-888e-43b1-9ba4-620474c5b22c admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:02.772353 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652d0b5-888e-43b1-9ba4-620474c5b22c admin admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:02.775527 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e652d0b5-888e-43b1-9ba4-620474c5b22c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:56:02.775527 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e652d0b5-888e-43b1-9ba4-620474c5b22c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:02.777881 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e652d0b5-888e-43b1-9ba4-620474c5b22c admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:02.819564 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1151/2318] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 13:56:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:56:02.839373 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f45e6-65ce-450f-a177-4d0dcfbb52c4 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:02.859960 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f45e6-65ce-450f-a177-4d0dcfbb52c4 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:02.868846 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aeba7e-46dd-4d31-b535-37e84191b233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:02.872200 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aeba7e-46dd-4d31-b535-37e84191b233 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:02.872567 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aeba7e-46dd-4d31-b535-37e84191b233 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:02.873064 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aeba7e-46dd-4d31-b535-37e84191b233 admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:02.875217 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aeba7e-46dd-4d31-b535-37e84191b233 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:02.879514 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aeba7e-46dd-4d31-b535-37e84191b233 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:02.941995 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1168/2319] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:56:02 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:56:02.948751 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e652d0b5-888e-43b1-9ba4-620474c5b22c admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:02.969793 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e652d0b5-888e-43b1-9ba4-620474c5b22c admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:03.095392 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5e5ef-29e6-4d46-bce6-b15cd5baa8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:03.096735 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5e5ef-29e6-4d46-bce6-b15cd5baa8b1 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:03.097176 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5e5ef-29e6-4d46-bce6-b15cd5baa8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:03.099142 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5e5ef-29e6-4d46-bce6-b15cd5baa8b1 admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:03.099142 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c5e5ef-29e6-4d46-bce6-b15cd5baa8b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:03.110158 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c5e5ef-29e6-4d46-bce6-b15cd5baa8b1 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:03.181266 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1152/2320] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:56:02 2022] POST /identity/v3/users => generated 292 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:56:03.186197 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aeba7e-46dd-4d31-b535-37e84191b233 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:03.204028 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aeba7e-46dd-4d31-b535-37e84191b233 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:03.209842 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d49cfd-f882-4b37-8d81-4eaae8c16a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:03.211037 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d49cfd-f882-4b37-8d81-4eaae8c16a9a admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:03.219057 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d49cfd-f882-4b37-8d81-4eaae8c16a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:03.219057 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d49cfd-f882-4b37-8d81-4eaae8c16a9a admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:03.219057 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d49cfd-f882-4b37-8d81-4eaae8c16a9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:03.219057 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d49cfd-f882-4b37-8d81-4eaae8c16a9a admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:03.254059 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1169/2321] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:56:03.260893 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5e5ef-29e6-4d46-bce6-b15cd5baa8b1 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:03.288429 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5e5ef-29e6-4d46-bce6-b15cd5baa8b1 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:03.300922 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93baf406-006a-4c4a-9327-d88fffcc7c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:03.302184 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93baf406-006a-4c4a-9327-d88fffcc7c08 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:03.302822 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93baf406-006a-4c4a-9327-d88fffcc7c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:03.304586 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93baf406-006a-4c4a-9327-d88fffcc7c08 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:03.306024 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93baf406-006a-4c4a-9327-d88fffcc7c08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:03.309995 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93baf406-006a-4c4a-9327-d88fffcc7c08 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:03.341834 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1153/2322] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 13:56:03.344780 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d49cfd-f882-4b37-8d81-4eaae8c16a9a admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:03.366140 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d49cfd-f882-4b37-8d81-4eaae8c16a9a admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:03.402827 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d11b0c-b52f-4fe8-91e6-8d659fc0f0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:03.403894 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d11b0c-b52f-4fe8-91e6-8d659fc0f0f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:03.404394 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d11b0c-b52f-4fe8-91e6-8d659fc0f0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:03.404890 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d11b0c-b52f-4fe8-91e6-8d659fc0f0f8 admin admin] PATH_INFO: `/v3/projects/0414496cd7fa40c1807011c7d9b1c99a/users/8722939f47d843e480f22bd2421aa850/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:03.461429 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d11b0c-b52f-4fe8-91e6-8d659fc0f0f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0414496cd7fa40c1807011c7d9b1c99a, user_id=8722939f47d843e480f22bd2421aa850, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:03.467017 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d11b0c-b52f-4fe8-91e6-8d659fc0f0f8 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:03.502714 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1170/2323] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:56:03 2022] PUT /identity/v3/projects/0414496cd7fa40c1807011c7d9b1c99a/users/8722939f47d843e480f22bd2421aa850/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:56:03.525202 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1f8dc-86fe-4fa2-a6ea-db3a86c4272a None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:03.526276 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1f8dc-86fe-4fa2-a6ea-db3a86c4272a None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:03.526276 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1f8dc-86fe-4fa2-a6ea-db3a86c4272a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:03.628945 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-0bf1f8dc-86fe-4fa2-a6ea-db3a86c4272a None None] MFA Rules not processed for user `8722939f47d843e480f22bd2421aa850`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:56:03.628945 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-0bf1f8dc-86fe-4fa2-a6ea-db3a86c4272a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:03.768496 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1154/2324] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:56:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:56:03.776598 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d11b0c-b52f-4fe8-91e6-8d659fc0f0f8 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:03.911208 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d11b0c-b52f-4fe8-91e6-8d659fc0f0f8 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:03.923361 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b02af-9451-4924-8715-08eb8aecd4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:03.923361 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b02af-9451-4924-8715-08eb8aecd4dd admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:03.923361 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b02af-9451-4924-8715-08eb8aecd4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:03.923361 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b02af-9451-4924-8715-08eb8aecd4dd admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:03.924909 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b02af-9451-4924-8715-08eb8aecd4dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:03.928866 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059b02af-9451-4924-8715-08eb8aecd4dd admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:03.941182 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:03.987301 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1171/2325] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:56:03 2022] POST /identity/v3/projects => generated 383 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:56:03.991663 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1f8dc-86fe-4fa2-a6ea-db3a86c4272a None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:04.006724 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1f8dc-86fe-4fa2-a6ea-db3a86c4272a None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:04.072620 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:04.121790 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d2525-8616-485d-b50e-e5e38a2e6ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:04.124145 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d2525-8616-485d-b50e-e5e38a2e6ec9 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:04.125521 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d2525-8616-485d-b50e-e5e38a2e6ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:04.126241 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d2525-8616-485d-b50e-e5e38a2e6ec9 admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:04.127430 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d2525-8616-485d-b50e-e5e38a2e6ec9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:04.130316 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d2525-8616-485d-b50e-e5e38a2e6ec9 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:04.163814 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1155/2326] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:56:03 2022] POST /identity/v3/users => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:56:04.169194 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b02af-9451-4924-8715-08eb8aecd4dd admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:04.186305 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b02af-9451-4924-8715-08eb8aecd4dd admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:04.195743 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c687e72-df0c-4f0a-92b9-8f8d2df984b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:04.196799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c687e72-df0c-4f0a-92b9-8f8d2df984b2 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:04.197214 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c687e72-df0c-4f0a-92b9-8f8d2df984b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:04.197676 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c687e72-df0c-4f0a-92b9-8f8d2df984b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:04.198667 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c687e72-df0c-4f0a-92b9-8f8d2df984b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:04.200560 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c687e72-df0c-4f0a-92b9-8f8d2df984b2 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:04.215812 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1172/2327] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:56:04.222346 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d2525-8616-485d-b50e-e5e38a2e6ec9 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:04.240142 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d2525-8616-485d-b50e-e5e38a2e6ec9 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:04.290025 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a74b58-d347-4b36-ac44-ecc65aae7f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:04.290881 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a74b58-d347-4b36-ac44-ecc65aae7f46 admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:04.291223 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a74b58-d347-4b36-ac44-ecc65aae7f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:04.292050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a74b58-d347-4b36-ac44-ecc65aae7f46 admin admin] PATH_INFO: `/v3/projects/e782cbab65a743d89d42db289b80517d/users/bee917f23c83401f992dbcb332d334c3/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:04.321379 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a74b58-d347-4b36-ac44-ecc65aae7f46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e782cbab65a743d89d42db289b80517d, user_id=bee917f23c83401f992dbcb332d334c3, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:04.325542 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a74b58-d347-4b36-ac44-ecc65aae7f46 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:04.363053 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1156/2328] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:56:04 2022] PUT /identity/v3/projects/e782cbab65a743d89d42db289b80517d/users/bee917f23c83401f992dbcb332d334c3/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:56:04.369411 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c687e72-df0c-4f0a-92b9-8f8d2df984b2 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:04.386133 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c687e72-df0c-4f0a-92b9-8f8d2df984b2 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:04.487610 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd97ff-59f5-4e91-bf56-4a4a7450544f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:04.488282 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd97ff-59f5-4e91-bf56-4a4a7450544f admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:04.488626 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd97ff-59f5-4e91-bf56-4a4a7450544f admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:04.489204 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd97ff-59f5-4e91-bf56-4a4a7450544f admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:04.490415 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbd97ff-59f5-4e91-bf56-4a4a7450544f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:04.493618 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbd97ff-59f5-4e91-bf56-4a4a7450544f admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:04.510354 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1173/2329] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:56:04.514686 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a74b58-d347-4b36-ac44-ecc65aae7f46 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:04.535758 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a74b58-d347-4b36-ac44-ecc65aae7f46 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:04.546035 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6450e88-3119-4522-8ab7-43e7861cff88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:04.546995 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6450e88-3119-4522-8ab7-43e7861cff88 admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:04.547334 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6450e88-3119-4522-8ab7-43e7861cff88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:04.547734 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6450e88-3119-4522-8ab7-43e7861cff88 admin admin] PATH_INFO: `/v3/projects/e782cbab65a743d89d42db289b80517d/users/bee917f23c83401f992dbcb332d334c3/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:04.550428 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6450e88-3119-4522-8ab7-43e7861cff88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e782cbab65a743d89d42db289b80517d, user_id=bee917f23c83401f992dbcb332d334c3, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:04.555378 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6450e88-3119-4522-8ab7-43e7861cff88 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:04.579734 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1157/2330] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:56:04 2022] PUT /identity/v3/projects/e782cbab65a743d89d42db289b80517d/users/bee917f23c83401f992dbcb332d334c3/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:56:04.595278 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e4fa0-888d-4443-9570-3f14dab0ec98 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:04.595647 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e4fa0-888d-4443-9570-3f14dab0ec98 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:04.596010 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e4fa0-888d-4443-9570-3f14dab0ec98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:04.651186 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-903e4fa0-888d-4443-9570-3f14dab0ec98 None None] MFA Rules not processed for user `bee917f23c83401f992dbcb332d334c3`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:56:04.653445 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-903e4fa0-888d-4443-9570-3f14dab0ec98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:04.801270 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1174/2331] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:56:04 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:56:04.821316 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6450e88-3119-4522-8ab7-43e7861cff88 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:04.823599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-d6450e88-3119-4522-8ab7-43e7861cff88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:04.930957 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6450e88-3119-4522-8ab7-43e7861cff88 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:04.938492 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57481094-cce3-4ba8-a105-e19eb8ca99d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:04.939537 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57481094-cce3-4ba8-a105-e19eb8ca99d0 service cinder] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:04.940003 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57481094-cce3-4ba8-a105-e19eb8ca99d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:04.940494 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57481094-cce3-4ba8-a105-e19eb8ca99d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:04.958210 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57481094-cce3-4ba8-a105-e19eb8ca99d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:04.960008 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57481094-cce3-4ba8-a105-e19eb8ca99d0 service cinder] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:04.978080 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1158/2332] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:56:04 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:56:05.147085 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e4fa0-888d-4443-9570-3f14dab0ec98 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:05.160929 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e4fa0-888d-4443-9570-3f14dab0ec98 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:05.166157 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba1720-f7a5-436e-9417-00e78a23c968 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:05.166842 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba1720-f7a5-436e-9417-00e78a23c968 service cinder] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:05.167183 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba1720-f7a5-436e-9417-00e78a23c968 service cinder] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:05.167541 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba1720-f7a5-436e-9417-00e78a23c968 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:05.270397 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:05.275856 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba1720-f7a5-436e-9417-00e78a23c968 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:05.278968 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba1720-f7a5-436e-9417-00e78a23c968 service cinder] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:05.302074 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1175/2333] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:56:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:56:05.785708 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57481094-cce3-4ba8-a105-e19eb8ca99d0 service cinder] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:05.896506 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57481094-cce3-4ba8-a105-e19eb8ca99d0 service cinder] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:05.903763 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fed733-5870-4ff5-8557-4c8c475a1fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:05.904787 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fed733-5870-4ff5-8557-4c8c475a1fe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:05.905766 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fed733-5870-4ff5-8557-4c8c475a1fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:05.906583 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fed733-5870-4ff5-8557-4c8c475a1fe0 admin admin] PATH_INFO: `/v3/users/8722939f47d843e480f22bd2421aa850` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:05.908713 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fed733-5870-4ff5-8557-4c8c475a1fe0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8722939f47d843e480f22bd2421aa850)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:05.912216 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fed733-5870-4ff5-8557-4c8c475a1fe0 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:05.985109 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:06.019073 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-f9fed733-5870-4ff5-8557-4c8c475a1fe0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8722939f47d843e480f22bd2421aa850'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:06.020920 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-f9fed733-5870-4ff5-8557-4c8c475a1fe0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8722939f47d843e480f22bd2421aa850'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:06.037652 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-f9fed733-5870-4ff5-8557-4c8c475a1fe0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8722939f47d843e480f22bd2421aa850'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:06.068359 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-f9fed733-5870-4ff5-8557-4c8c475a1fe0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8722939f47d843e480f22bd2421aa850'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:06.069697 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-f9fed733-5870-4ff5-8557-4c8c475a1fe0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8722939f47d843e480f22bd2421aa850'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:06.094157 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1159/2334] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:56:05 2022] DELETE /identity/v3/users/8722939f47d843e480f22bd2421aa850 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:56:06.099891 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d0002-ae3d-43ee-bbc9-a817919ca35c None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:06.100714 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d0002-ae3d-43ee-bbc9-a817919ca35c None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:06.100714 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d0002-ae3d-43ee-bbc9-a817919ca35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:06.326407 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-811d0002-ae3d-43ee-bbc9-a817919ca35c None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:56:06.329355 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-811d0002-ae3d-43ee-bbc9-a817919ca35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:06.425700 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1176/2335] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:56:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:56:06.439699 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fed733-5870-4ff5-8557-4c8c475a1fe0 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:06.442079 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-f9fed733-5870-4ff5-8557-4c8c475a1fe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:06.558069 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fed733-5870-4ff5-8557-4c8c475a1fe0 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:06.567349 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46090c3-3329-4227-96b5-d72915595475 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:06.568576 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46090c3-3329-4227-96b5-d72915595475 service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:06.569052 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46090c3-3329-4227-96b5-d72915595475 service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:06.569701 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46090c3-3329-4227-96b5-d72915595475 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:06.590093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46090c3-3329-4227-96b5-d72915595475 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:06.592903 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46090c3-3329-4227-96b5-d72915595475 service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:06.612928 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1160/2336] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:56:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:56:07.281920 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d0002-ae3d-43ee-bbc9-a817919ca35c None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:07.283848 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-811d0002-ae3d-43ee-bbc9-a817919ca35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:07.306680 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d0002-ae3d-43ee-bbc9-a817919ca35c None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:07.315794 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a09a4ad-5277-41ea-9915-8f03c87641b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:07.316911 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09a4ad-5277-41ea-9915-8f03c87641b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:07.317452 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09a4ad-5277-41ea-9915-8f03c87641b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:07.317452 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09a4ad-5277-41ea-9915-8f03c87641b6 admin admin] PATH_INFO: `/v3/projects/0414496cd7fa40c1807011c7d9b1c99a` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:07.322111 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a09a4ad-5277-41ea-9915-8f03c87641b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0414496cd7fa40c1807011c7d9b1c99a)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:07.325924 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a09a4ad-5277-41ea-9915-8f03c87641b6 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:07.428277 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-2a09a4ad-5277-41ea-9915-8f03c87641b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0414496cd7fa40c1807011c7d9b1c99a', 'request_id': 'req-2a09a4ad-5277-41ea-9915-8f03c87641b6'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:07.438242 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-2a09a4ad-5277-41ea-9915-8f03c87641b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0414496cd7fa40c1807011c7d9b1c99a', 'request_id': 'req-2a09a4ad-5277-41ea-9915-8f03c87641b6'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:07.448817 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-2a09a4ad-5277-41ea-9915-8f03c87641b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0414496cd7fa40c1807011c7d9b1c99a', 'request_id': 'req-2a09a4ad-5277-41ea-9915-8f03c87641b6'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:07.469684 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-2a09a4ad-5277-41ea-9915-8f03c87641b6 admin admin] The token cache is being invalidate because project 0414496cd7fa40c1807011c7d9b1c99a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:56:07.470297 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-2a09a4ad-5277-41ea-9915-8f03c87641b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:07.471063 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-2a09a4ad-5277-41ea-9915-8f03c87641b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:07.472622 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1177/2337] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:56:07 2022] DELETE /identity/v3/projects/0414496cd7fa40c1807011c7d9b1c99a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:56:07.477397 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46090c3-3329-4227-96b5-d72915595475 service neutron] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:07.491456 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46090c3-3329-4227-96b5-d72915595475 service neutron] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:07.597878 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145380f-e58f-44e7-983a-779a499a9849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:07.598900 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145380f-e58f-44e7-983a-779a499a9849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:07.599223 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145380f-e58f-44e7-983a-779a499a9849 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:07.599793 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145380f-e58f-44e7-983a-779a499a9849 admin admin] PATH_INFO: `/v3/users/bee917f23c83401f992dbcb332d334c3` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:07.601137 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145380f-e58f-44e7-983a-779a499a9849 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bee917f23c83401f992dbcb332d334c3)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:07.603255 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145380f-e58f-44e7-983a-779a499a9849 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:07.691107 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-b145380f-e58f-44e7-983a-779a499a9849 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bee917f23c83401f992dbcb332d334c3'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:07.692324 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-b145380f-e58f-44e7-983a-779a499a9849 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bee917f23c83401f992dbcb332d334c3'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:07.701070 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:07.705167 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-b145380f-e58f-44e7-983a-779a499a9849 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bee917f23c83401f992dbcb332d334c3'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:07.722047 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-b145380f-e58f-44e7-983a-779a499a9849 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bee917f23c83401f992dbcb332d334c3'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:07.722917 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-b145380f-e58f-44e7-983a-779a499a9849 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bee917f23c83401f992dbcb332d334c3'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:07.741274 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1161/2338] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:56:07 2022] DELETE /identity/v3/users/bee917f23c83401f992dbcb332d334c3 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:56:08.190889 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a09a4ad-5277-41ea-9915-8f03c87641b6 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:08.193062 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-2a09a4ad-5277-41ea-9915-8f03c87641b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:08.235791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a09a4ad-5277-41ea-9915-8f03c87641b6 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:08.356079 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d3e8e9-6413-4cd6-b2d5-849aebc190e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:08.357537 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3e8e9-6413-4cd6-b2d5-849aebc190e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:08.358081 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3e8e9-6413-4cd6-b2d5-849aebc190e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:08.358582 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3e8e9-6413-4cd6-b2d5-849aebc190e6 admin admin] PATH_INFO: `/v3/projects/e782cbab65a743d89d42db289b80517d` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:08.360874 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d3e8e9-6413-4cd6-b2d5-849aebc190e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e782cbab65a743d89d42db289b80517d)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:08.365065 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d3e8e9-6413-4cd6-b2d5-849aebc190e6 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:08.437229 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:08.518836 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-26d3e8e9-6413-4cd6-b2d5-849aebc190e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e782cbab65a743d89d42db289b80517d', 'request_id': 'req-26d3e8e9-6413-4cd6-b2d5-849aebc190e6'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:08.530865 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-26d3e8e9-6413-4cd6-b2d5-849aebc190e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e782cbab65a743d89d42db289b80517d', 'request_id': 'req-26d3e8e9-6413-4cd6-b2d5-849aebc190e6'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:08.550584 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-26d3e8e9-6413-4cd6-b2d5-849aebc190e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e782cbab65a743d89d42db289b80517d', 'request_id': 'req-26d3e8e9-6413-4cd6-b2d5-849aebc190e6'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:08.577856 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-26d3e8e9-6413-4cd6-b2d5-849aebc190e6 admin admin] The token cache is being invalidate because project e782cbab65a743d89d42db289b80517d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:56:08.578295 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-26d3e8e9-6413-4cd6-b2d5-849aebc190e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:08.580065 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-26d3e8e9-6413-4cd6-b2d5-849aebc190e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:08.584535 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1178/2339] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:56:08 2022] DELETE /identity/v3/projects/e782cbab65a743d89d42db289b80517d => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:56:08.590223 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d93e06-6685-40b5-8e58-e363f6569275 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:08.590961 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d93e06-6685-40b5-8e58-e363f6569275 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:08.590961 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d93e06-6685-40b5-8e58-e363f6569275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:08.625015 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-94d93e06-6685-40b5-8e58-e363f6569275 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:56:08.627062 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-94d93e06-6685-40b5-8e58-e363f6569275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:08.870232 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1162/2340] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:56:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:56:08.883188 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd341460-b24f-453a-a096-e36f76eabd09 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:08.883533 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd341460-b24f-453a-a096-e36f76eabd09 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:08.883841 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd341460-b24f-453a-a096-e36f76eabd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:08.947046 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-bd341460-b24f-453a-a096-e36f76eabd09 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:56:08.947046 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-bd341460-b24f-453a-a096-e36f76eabd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:08.971362 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1179/2341] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:56:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:56:08.973747 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d93e06-6685-40b5-8e58-e363f6569275 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:08.993662 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d93e06-6685-40b5-8e58-e363f6569275 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:09.017051 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b168fcc-0fdc-41d3-ae53-4cfc921a2b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:09.019347 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b168fcc-0fdc-41d3-ae53-4cfc921a2b11 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:09.020724 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b168fcc-0fdc-41d3-ae53-4cfc921a2b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:09.024284 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b168fcc-0fdc-41d3-ae53-4cfc921a2b11 admin admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:09.026042 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b168fcc-0fdc-41d3-ae53-4cfc921a2b11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:56:09.030571 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b168fcc-0fdc-41d3-ae53-4cfc921a2b11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:09.039301 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b168fcc-0fdc-41d3-ae53-4cfc921a2b11 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:09.069938 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd341460-b24f-453a-a096-e36f76eabd09 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:09.078846 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1163/2342] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 13:56:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:56:09.086430 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd341460-b24f-453a-a096-e36f76eabd09 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:09.094132 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ea9ec-e90c-47ce-ac99-870d81625f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:09.095313 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ea9ec-e90c-47ce-ac99-870d81625f20 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:09.095862 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ea9ec-e90c-47ce-ac99-870d81625f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:09.096396 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ea9ec-e90c-47ce-ac99-870d81625f20 admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:09.097692 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8ea9ec-e90c-47ce-ac99-870d81625f20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:09.101946 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8ea9ec-e90c-47ce-ac99-870d81625f20 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:09.190104 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1180/2343] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:56:09 2022] POST /identity/v3/projects => generated 375 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:56:09.197543 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b168fcc-0fdc-41d3-ae53-4cfc921a2b11 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:09.264889 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b168fcc-0fdc-41d3-ae53-4cfc921a2b11 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:09.418095 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50fbf4e-aab3-4191-ba2b-0f43f93c19af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:09.419141 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fbf4e-aab3-4191-ba2b-0f43f93c19af admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:09.419617 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fbf4e-aab3-4191-ba2b-0f43f93c19af admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:09.420092 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fbf4e-aab3-4191-ba2b-0f43f93c19af admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:09.421843 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50fbf4e-aab3-4191-ba2b-0f43f93c19af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:09.426118 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50fbf4e-aab3-4191-ba2b-0f43f93c19af admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:09.473990 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1164/2344] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:56:09 2022] POST /identity/v3/users => generated 288 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:56:09.480801 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ea9ec-e90c-47ce-ac99-870d81625f20 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:09.507603 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ea9ec-e90c-47ce-ac99-870d81625f20 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:09.518865 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d6e68-3f1e-4873-8fd3-55e27d93d6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:09.521878 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d6e68-3f1e-4873-8fd3-55e27d93d6e4 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:09.522258 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d6e68-3f1e-4873-8fd3-55e27d93d6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:09.522657 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d6e68-3f1e-4873-8fd3-55e27d93d6e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:09.523193 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d6e68-3f1e-4873-8fd3-55e27d93d6e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:09.525016 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d6e68-3f1e-4873-8fd3-55e27d93d6e4 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:09.545313 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1181/2345] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:56:09.553656 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50fbf4e-aab3-4191-ba2b-0f43f93c19af admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:09.582394 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50fbf4e-aab3-4191-ba2b-0f43f93c19af admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:09.591195 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb0baf-28bc-4779-b92f-af020e747f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:09.592246 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb0baf-28bc-4779-b92f-af020e747f91 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:09.593301 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb0baf-28bc-4779-b92f-af020e747f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:09.593853 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb0baf-28bc-4779-b92f-af020e747f91 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:09.595053 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fb0baf-28bc-4779-b92f-af020e747f91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:09.598250 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fb0baf-28bc-4779-b92f-af020e747f91 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:09.622520 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1165/2346] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:56:09.629669 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d6e68-3f1e-4873-8fd3-55e27d93d6e4 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:09.647418 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d6e68-3f1e-4873-8fd3-55e27d93d6e4 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:09.657836 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f9c28-58f6-45d4-baa3-52775cb44a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:09.659018 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f9c28-58f6-45d4-baa3-52775cb44a04 admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:09.659752 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f9c28-58f6-45d4-baa3-52775cb44a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:09.660238 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4f9c28-58f6-45d4-baa3-52775cb44a04 admin admin] PATH_INFO: `/v3/projects/71c3f9f4ec0b4138884485fa5a105502/users/0a950a9360144b5097ae0a2fbc89a44d/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:09.690281 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4f9c28-58f6-45d4-baa3-52775cb44a04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71c3f9f4ec0b4138884485fa5a105502, user_id=0a950a9360144b5097ae0a2fbc89a44d, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:09.696280 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4f9c28-58f6-45d4-baa3-52775cb44a04 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:09.723737 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1182/2347] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:56:09 2022] PUT /identity/v3/projects/71c3f9f4ec0b4138884485fa5a105502/users/0a950a9360144b5097ae0a2fbc89a44d/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:56:09.743310 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe023b7-95e5-440a-a452-cf3d9f1bdd6f None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:09.744248 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe023b7-95e5-440a-a452-cf3d9f1bdd6f None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:09.745020 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe023b7-95e5-440a-a452-cf3d9f1bdd6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:09.811959 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-dfe023b7-95e5-440a-a452-cf3d9f1bdd6f None None] MFA Rules not processed for user `0a950a9360144b5097ae0a2fbc89a44d`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:56:09.814270 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-dfe023b7-95e5-440a-a452-cf3d9f1bdd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:09.875973 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:09.935697 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1166/2348] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:56:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:56:09.960761 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f9c28-58f6-45d4-baa3-52775cb44a04 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:09.963516 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-1d4f9c28-58f6-45d4-baa3-52775cb44a04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:10.122081 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4f9c28-58f6-45d4-baa3-52775cb44a04 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:10.130496 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f842b-9845-4873-956e-3a4221a5e7e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:10.131875 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f842b-9845-4873-956e-3a4221a5e7e9 service cinder] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:10.132331 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f842b-9845-4873-956e-3a4221a5e7e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:10.133013 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f842b-9845-4873-956e-3a4221a5e7e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:10.150699 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f842b-9845-4873-956e-3a4221a5e7e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:10.153976 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f842b-9845-4873-956e-3a4221a5e7e9 service cinder] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:10.172761 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1183/2349] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:56:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:56:10.472779 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf87069-6665-4ee3-bcc8-d4f8cb8dc6b2 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:10.473678 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf87069-6665-4ee3-bcc8-d4f8cb8dc6b2 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:10.474552 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf87069-6665-4ee3-bcc8-d4f8cb8dc6b2 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:10.478466 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1167/2350] 10.222.0.69 () {54 vars in 921 bytes} [Thu Sep 8 13:56:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:56:10.493330 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66802e25-141c-4f21-9750-3e35a05ebc6c None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:10.494293 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66802e25-141c-4f21-9750-3e35a05ebc6c None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:10.494433 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66802e25-141c-4f21-9750-3e35a05ebc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:10.555461 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-66802e25-141c-4f21-9750-3e35a05ebc6c None None] MFA Rules not processed for user `c95448c1b8b1466cae37fda5c713d53f`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:56:10.557732 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-66802e25-141c-4f21-9750-3e35a05ebc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:10.694153 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:10.753524 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1184/2351] 10.222.0.69 () {58 vars in 1018 bytes} [Thu Sep 8 13:56:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:56:10.786059 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf87069-6665-4ee3-bcc8-d4f8cb8dc6b2 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:10.790290 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-1bf87069-6665-4ee3-bcc8-d4f8cb8dc6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:11.049878 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf87069-6665-4ee3-bcc8-d4f8cb8dc6b2 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:11.058891 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3bd8d-c843-4cc0-855a-2c305c1d1aa6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6677b4518c094636bc8ed7b588103390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:11.060380 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3bd8d-c843-4cc0-855a-2c305c1d1aa6 service glance] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:11.061104 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3bd8d-c843-4cc0-855a-2c305c1d1aa6 service glance] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:11.062023 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3bd8d-c843-4cc0-855a-2c305c1d1aa6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:11.088835 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d3bd8d-c843-4cc0-855a-2c305c1d1aa6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:11.090786 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d3bd8d-c843-4cc0-855a-2c305c1d1aa6 service glance] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:11.128913 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1168/2352] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:56:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:56:11.286590 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba45fc-f4c9-4660-bd4c-6c5a906508f9 None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:11.290956 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba45fc-f4c9-4660-bd4c-6c5a906508f9 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:11.292103 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba45fc-f4c9-4660-bd4c-6c5a906508f9 None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:11.313334 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1185/2353] 10.222.0.69 () {54 vars in 921 bytes} [Thu Sep 8 13:56:11 2022] GET /identity => generated 270 bytes in 31 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:56:11.321313 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf6afe3-c24c-40ae-8a12-4250e55e3215 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:11.321834 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf6afe3-c24c-40ae-8a12-4250e55e3215 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:11.322230 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf6afe3-c24c-40ae-8a12-4250e55e3215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:11.403686 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-6cf6afe3-c24c-40ae-8a12-4250e55e3215 None None] MFA Rules not processed for user `db898158553743d3a28f3d6237e91a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:56:11.409969 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-6cf6afe3-c24c-40ae-8a12-4250e55e3215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:11.572613 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1169/2354] 10.222.0.69 () {58 vars in 1018 bytes} [Thu Sep 8 13:56:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:56:11.588248 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba45fc-f4c9-4660-bd4c-6c5a906508f9 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:11.595193 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-61ba45fc-f4c9-4660-bd4c-6c5a906508f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:11.625261 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba45fc-f4c9-4660-bd4c-6c5a906508f9 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:11.631304 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c7d69-24b6-4b44-8ac3-2962012ab7d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:11.632451 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c7d69-24b6-4b44-8ac3-2962012ab7d9 service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:11.632912 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c7d69-24b6-4b44-8ac3-2962012ab7d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:11.634635 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c7d69-24b6-4b44-8ac3-2962012ab7d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:11.647594 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33c7d69-24b6-4b44-8ac3-2962012ab7d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:11.651013 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33c7d69-24b6-4b44-8ac3-2962012ab7d9 service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:11.664027 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1186/2355] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:56:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:56:11.830670 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b1bd4-6a8c-4123-8f60-f2c5596f3ef7 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:11.832448 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b1bd4-6a8c-4123-8f60-f2c5596f3ef7 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:11.832448 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b1bd4-6a8c-4123-8f60-f2c5596f3ef7 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:11.835434 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1170/2356] 10.222.0.69 () {54 vars in 921 bytes} [Thu Sep 8 13:56:11 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 13:56:11.864700 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384a3f2-8d58-49f7-847a-c151b8a475ed None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:11.865222 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384a3f2-8d58-49f7-847a-c151b8a475ed None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:11.866901 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384a3f2-8d58-49f7-847a-c151b8a475ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:11.935906 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-6384a3f2-8d58-49f7-847a-c151b8a475ed None None] MFA Rules not processed for user `c95448c1b8b1466cae37fda5c713d53f`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:56:11.939476 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-6384a3f2-8d58-49f7-847a-c151b8a475ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:11.964337 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1187/2357] 10.222.0.69 () {58 vars in 1018 bytes} [Thu Sep 8 13:56:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:56:11.979984 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b1bd4-6a8c-4123-8f60-f2c5596f3ef7 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:12.020040 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b1bd4-6a8c-4123-8f60-f2c5596f3ef7 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:12.032786 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd0a5d-da1b-4f64-960f-25cb574bcea8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:12.038852 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd0a5d-da1b-4f64-960f-25cb574bcea8 service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:12.038852 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd0a5d-da1b-4f64-960f-25cb574bcea8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:12.038852 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd0a5d-da1b-4f64-960f-25cb574bcea8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:12.068930 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd0a5d-da1b-4f64-960f-25cb574bcea8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:12.071896 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bd0a5d-da1b-4f64-960f-25cb574bcea8 service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:12.100243 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1171/2358] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:56:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:56:21.928025 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=18 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:22.087825 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=70 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:25.146472 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384a3f2-8d58-49f7-847a-c151b8a475ed None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:25.343074 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384a3f2-8d58-49f7-847a-c151b8a475ed None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:25.351505 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779d633-b429-4cbe-a6fb-b6e98eb88779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:25.352589 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779d633-b429-4cbe-a6fb-b6e98eb88779 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:25.353066 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779d633-b429-4cbe-a6fb-b6e98eb88779 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:25.353700 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6779d633-b429-4cbe-a6fb-b6e98eb88779 admin admin] PATH_INFO: `/v3/users/0a950a9360144b5097ae0a2fbc89a44d` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:25.355750 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779d633-b429-4cbe-a6fb-b6e98eb88779 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a950a9360144b5097ae0a2fbc89a44d)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:25.360884 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6779d633-b429-4cbe-a6fb-b6e98eb88779 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:25.455462 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-6779d633-b429-4cbe-a6fb-b6e98eb88779 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a950a9360144b5097ae0a2fbc89a44d'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:25.456335 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-6779d633-b429-4cbe-a6fb-b6e98eb88779 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a950a9360144b5097ae0a2fbc89a44d'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:25.457313 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-6779d633-b429-4cbe-a6fb-b6e98eb88779 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a950a9360144b5097ae0a2fbc89a44d'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:25.471894 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-6779d633-b429-4cbe-a6fb-b6e98eb88779 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a950a9360144b5097ae0a2fbc89a44d'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:25.491945 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-6779d633-b429-4cbe-a6fb-b6e98eb88779 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a950a9360144b5097ae0a2fbc89a44d'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:25.524041 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1188/2359] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:56:25 2022] DELETE /identity/v3/users/0a950a9360144b5097ae0a2fbc89a44d => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:56:25.526484 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c1265-6414-40ae-bc39-d8df9134f94d None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:25.527350 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c1265-6414-40ae-bc39-d8df9134f94d None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:25.527517 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c1265-6414-40ae-bc39-d8df9134f94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:25.568754 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-266c1265-6414-40ae-bc39-d8df9134f94d None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:56:25.570902 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-266c1265-6414-40ae-bc39-d8df9134f94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:25.707633 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1172/2360] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:56:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:56:25.720042 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779d633-b429-4cbe-a6fb-b6e98eb88779 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:25.722299 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-6779d633-b429-4cbe-a6fb-b6e98eb88779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:25.850988 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6779d633-b429-4cbe-a6fb-b6e98eb88779 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:25.859857 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bacd97e-6a5b-4b14-a3f7-9d2d84aaf506 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:25.861203 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacd97e-6a5b-4b14-a3f7-9d2d84aaf506 service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:25.861796 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacd97e-6a5b-4b14-a3f7-9d2d84aaf506 service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:25.862491 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bacd97e-6a5b-4b14-a3f7-9d2d84aaf506 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:25.885115 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bacd97e-6a5b-4b14-a3f7-9d2d84aaf506 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:25.887741 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bacd97e-6a5b-4b14-a3f7-9d2d84aaf506 service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:25.903529 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1189/2361] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:56:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:56:26.544332 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c1265-6414-40ae-bc39-d8df9134f94d None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:26.546972 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-266c1265-6414-40ae-bc39-d8df9134f94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:26.572863 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c1265-6414-40ae-bc39-d8df9134f94d None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:26.584190 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe0ec8-e346-46c5-9bdf-5d0472891b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:26.585625 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe0ec8-e346-46c5-9bdf-5d0472891b44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:26.586239 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe0ec8-e346-46c5-9bdf-5d0472891b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:26.586866 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe0ec8-e346-46c5-9bdf-5d0472891b44 admin admin] PATH_INFO: `/v3/projects/71c3f9f4ec0b4138884485fa5a105502` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:26.590274 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe0ec8-e346-46c5-9bdf-5d0472891b44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71c3f9f4ec0b4138884485fa5a105502)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:26.594625 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fe0ec8-e346-46c5-9bdf-5d0472891b44 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:26.696511 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-e0fe0ec8-e346-46c5-9bdf-5d0472891b44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71c3f9f4ec0b4138884485fa5a105502', 'request_id': 'req-e0fe0ec8-e346-46c5-9bdf-5d0472891b44'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:26.705033 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-e0fe0ec8-e346-46c5-9bdf-5d0472891b44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71c3f9f4ec0b4138884485fa5a105502', 'request_id': 'req-e0fe0ec8-e346-46c5-9bdf-5d0472891b44'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:26.713507 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-e0fe0ec8-e346-46c5-9bdf-5d0472891b44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71c3f9f4ec0b4138884485fa5a105502', 'request_id': 'req-e0fe0ec8-e346-46c5-9bdf-5d0472891b44'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:26.738218 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-e0fe0ec8-e346-46c5-9bdf-5d0472891b44 admin admin] The token cache is being invalidate because project 71c3f9f4ec0b4138884485fa5a105502 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:56:26.738691 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-e0fe0ec8-e346-46c5-9bdf-5d0472891b44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:26.739596 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-e0fe0ec8-e346-46c5-9bdf-5d0472891b44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:26.741555 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1173/2362] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:56:26 2022] DELETE /identity/v3/projects/71c3f9f4ec0b4138884485fa5a105502 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:56:26.748983 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbf309-cf3f-4f87-8967-f3738d3db407 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:26.749878 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbf309-cf3f-4f87-8967-f3738d3db407 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:26.749878 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddbf309-cf3f-4f87-8967-f3738d3db407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:26.784331 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-4ddbf309-cf3f-4f87-8967-f3738d3db407 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:56:26.786527 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-4ddbf309-cf3f-4f87-8967-f3738d3db407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:26.828060 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:26.985908 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1190/2363] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:56:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:56:26.991965 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fd53d-f456-4d1d-9869-0664115b2783 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:26.992445 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fd53d-f456-4d1d-9869-0664115b2783 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:26.992933 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fd53d-f456-4d1d-9869-0664115b2783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:27.037238 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-227fd53d-f456-4d1d-9869-0664115b2783 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:56:27.038995 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-227fd53d-f456-4d1d-9869-0664115b2783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:27.053677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1174/2364] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:56:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:56:27.059481 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddbf309-cf3f-4f87-8967-f3738d3db407 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:27.082497 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddbf309-cf3f-4f87-8967-f3738d3db407 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:27.092035 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b82eb-cea8-4157-be4d-f5bc0898fb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:27.093097 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b82eb-cea8-4157-be4d-f5bc0898fb54 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:27.093598 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b82eb-cea8-4157-be4d-f5bc0898fb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:27.094079 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984b82eb-cea8-4157-be4d-f5bc0898fb54 admin admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:27.095286 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b82eb-cea8-4157-be4d-f5bc0898fb54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:56:27.095820 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b82eb-cea8-4157-be4d-f5bc0898fb54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:27.099024 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984b82eb-cea8-4157-be4d-f5bc0898fb54 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:27.129161 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1191/2365] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 13:56:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:56:27.142686 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227fd53d-f456-4d1d-9869-0664115b2783 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:27.162909 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227fd53d-f456-4d1d-9869-0664115b2783 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:27.175377 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c606c-80ad-40b6-b8fe-8a19e20006b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:27.176795 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c606c-80ad-40b6-b8fe-8a19e20006b5 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:27.177293 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c606c-80ad-40b6-b8fe-8a19e20006b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:27.178772 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c606c-80ad-40b6-b8fe-8a19e20006b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:27.185202 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c606c-80ad-40b6-b8fe-8a19e20006b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:27.186782 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c606c-80ad-40b6-b8fe-8a19e20006b5 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:27.265811 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1175/2366] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:56:27 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:56:27.267039 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b82eb-cea8-4157-be4d-f5bc0898fb54 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:27.288665 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984b82eb-cea8-4157-be4d-f5bc0898fb54 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:27.416092 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a3761-a3b6-470e-914a-6c9f1ec4ed20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:27.416092 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a3761-a3b6-470e-914a-6c9f1ec4ed20 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:27.417043 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a3761-a3b6-470e-914a-6c9f1ec4ed20 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:27.417043 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a3761-a3b6-470e-914a-6c9f1ec4ed20 admin admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:27.417818 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449a3761-a3b6-470e-914a-6c9f1ec4ed20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:27.420947 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449a3761-a3b6-470e-914a-6c9f1ec4ed20 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:27.473404 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1192/2367] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:56:27 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:56:27.473913 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c606c-80ad-40b6-b8fe-8a19e20006b5 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:27.495559 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c606c-80ad-40b6-b8fe-8a19e20006b5 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:27.504550 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d4a64-9d07-43b1-a746-bd447a98b9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:27.506288 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d4a64-9d07-43b1-a746-bd447a98b9af admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:27.506288 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d4a64-9d07-43b1-a746-bd447a98b9af admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:27.506927 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d4a64-9d07-43b1-a746-bd447a98b9af admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:27.508493 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d4a64-9d07-43b1-a746-bd447a98b9af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:27.512444 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16d4a64-9d07-43b1-a746-bd447a98b9af admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:27.576942 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a3761-a3b6-470e-914a-6c9f1ec4ed20 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:27.577542 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1176/2368] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:56:27.616721 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a3761-a3b6-470e-914a-6c9f1ec4ed20 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:27.647223 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7d25af-3b0a-4b52-ad46-ba7b8d7384fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:27.648892 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d25af-3b0a-4b52-ad46-ba7b8d7384fc admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:27.649318 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d25af-3b0a-4b52-ad46-ba7b8d7384fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:27.649823 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7d25af-3b0a-4b52-ad46-ba7b8d7384fc admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:27.651111 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7d25af-3b0a-4b52-ad46-ba7b8d7384fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:27.653525 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7d25af-3b0a-4b52-ad46-ba7b8d7384fc admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:27.686977 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1193/2369] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:56:27.693521 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d4a64-9d07-43b1-a746-bd447a98b9af admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:27.727225 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d4a64-9d07-43b1-a746-bd447a98b9af admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:27.736707 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c95a9-d22c-4a52-83ed-574123e1a2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:27.738238 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c95a9-d22c-4a52-83ed-574123e1a2e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:27.738702 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c95a9-d22c-4a52-83ed-574123e1a2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:27.739153 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c95a9-d22c-4a52-83ed-574123e1a2e0 admin admin] PATH_INFO: `/v3/projects/de3b812e3d0941fca1102287c3a9ab33/users/dcd25a0b8152482aa249ad8a54ceb643/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:27.779895 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c95a9-d22c-4a52-83ed-574123e1a2e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de3b812e3d0941fca1102287c3a9ab33, user_id=dcd25a0b8152482aa249ad8a54ceb643, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:27.784726 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671c95a9-d22c-4a52-83ed-574123e1a2e0 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:27.832257 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1177/2370] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:56:27 2022] PUT /identity/v3/projects/de3b812e3d0941fca1102287c3a9ab33/users/dcd25a0b8152482aa249ad8a54ceb643/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:56:27.857261 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3b83c-8955-48f2-884f-88ee233df977 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:27.863822 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3b83c-8955-48f2-884f-88ee233df977 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:27.864555 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3b83c-8955-48f2-884f-88ee233df977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:27.959458 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-37d3b83c-8955-48f2-884f-88ee233df977 None None] MFA Rules not processed for user `dcd25a0b8152482aa249ad8a54ceb643`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:56:27.961862 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-37d3b83c-8955-48f2-884f-88ee233df977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:28.196055 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1194/2371] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:56:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:56:28.216019 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c95a9-d22c-4a52-83ed-574123e1a2e0 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:28.271199 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:28.443366 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c95a9-d22c-4a52-83ed-574123e1a2e0 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:28.462069 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0be337-40e9-4fe0-b604-c6fc01fef609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:28.462718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0be337-40e9-4fe0-b604-c6fc01fef609 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:28.463003 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0be337-40e9-4fe0-b604-c6fc01fef609 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:28.463272 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0be337-40e9-4fe0-b604-c6fc01fef609 admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:28.464193 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0be337-40e9-4fe0-b604-c6fc01fef609 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:28.468889 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0be337-40e9-4fe0-b604-c6fc01fef609 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:28.536766 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1178/2372] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:56:28 2022] POST /identity/v3/projects => generated 383 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:56:28.538987 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d3b83c-8955-48f2-884f-88ee233df977 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:28.595568 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d3b83c-8955-48f2-884f-88ee233df977 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:28.664483 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:28.829773 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b53b6-0db9-47a2-a979-d55a5cf53c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:28.831215 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b53b6-0db9-47a2-a979-d55a5cf53c4a admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:28.832324 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b53b6-0db9-47a2-a979-d55a5cf53c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:28.833064 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b53b6-0db9-47a2-a979-d55a5cf53c4a admin admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:28.836694 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401b53b6-0db9-47a2-a979-d55a5cf53c4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:28.849949 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401b53b6-0db9-47a2-a979-d55a5cf53c4a admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:28.925898 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1195/2373] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:56:28 2022] POST /identity/v3/users => generated 292 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:56:28.931178 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0be337-40e9-4fe0-b604-c6fc01fef609 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:28.961124 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0be337-40e9-4fe0-b604-c6fc01fef609 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:28.971530 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f2c68-f226-462a-a8db-da2ebcc95aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:28.972789 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f2c68-f226-462a-a8db-da2ebcc95aba admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:28.973444 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f2c68-f226-462a-a8db-da2ebcc95aba admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:28.975656 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f2c68-f226-462a-a8db-da2ebcc95aba admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:28.975656 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f2c68-f226-462a-a8db-da2ebcc95aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:28.989556 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f2c68-f226-462a-a8db-da2ebcc95aba admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:29.024181 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1179/2374] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 13:56:29.031819 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b53b6-0db9-47a2-a979-d55a5cf53c4a admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:29.065578 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b53b6-0db9-47a2-a979-d55a5cf53c4a admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:29.086309 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf4077b-0c84-427e-95de-6ce2b22aa7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:29.087267 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4077b-0c84-427e-95de-6ce2b22aa7e6 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:29.087749 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4077b-0c84-427e-95de-6ce2b22aa7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:29.088284 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf4077b-0c84-427e-95de-6ce2b22aa7e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:29.089454 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf4077b-0c84-427e-95de-6ce2b22aa7e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:29.092837 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf4077b-0c84-427e-95de-6ce2b22aa7e6 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:29.167024 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1196/2375] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:56:29.174858 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f2c68-f226-462a-a8db-da2ebcc95aba admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:29.205273 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f2c68-f226-462a-a8db-da2ebcc95aba admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:29.220163 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae022d33-6523-4551-bdd7-01dba81ed78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:29.221299 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae022d33-6523-4551-bdd7-01dba81ed78f admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:29.224886 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae022d33-6523-4551-bdd7-01dba81ed78f admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:29.226083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae022d33-6523-4551-bdd7-01dba81ed78f admin admin] PATH_INFO: `/v3/projects/1667bfda43494890af23d4d631234276/users/2d3b6f87f2da49959ac50ef63a3a4e3a/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:29.298258 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae022d33-6523-4551-bdd7-01dba81ed78f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1667bfda43494890af23d4d631234276, user_id=2d3b6f87f2da49959ac50ef63a3a4e3a, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:29.304058 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae022d33-6523-4551-bdd7-01dba81ed78f admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:29.336602 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1180/2376] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:56:29 2022] PUT /identity/v3/projects/1667bfda43494890af23d4d631234276/users/2d3b6f87f2da49959ac50ef63a3a4e3a/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:56:29.372284 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd22abe-0f99-4235-8ac3-14a9d8ff4986 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:29.386390 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd22abe-0f99-4235-8ac3-14a9d8ff4986 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:29.387679 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd22abe-0f99-4235-8ac3-14a9d8ff4986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:29.453081 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-5dd22abe-0f99-4235-8ac3-14a9d8ff4986 None None] MFA Rules not processed for user `2d3b6f87f2da49959ac50ef63a3a4e3a`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:56:29.457038 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-5dd22abe-0f99-4235-8ac3-14a9d8ff4986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:29.626325 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1197/2377] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:56:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:56:29.638665 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae022d33-6523-4551-bdd7-01dba81ed78f admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:29.823536 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae022d33-6523-4551-bdd7-01dba81ed78f admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:29.844346 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6534b336-e2e9-42b6-a6db-e682b7d479fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:29.845976 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534b336-e2e9-42b6-a6db-e682b7d479fd admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:29.847659 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534b336-e2e9-42b6-a6db-e682b7d479fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:29.848329 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534b336-e2e9-42b6-a6db-e682b7d479fd admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:29.850349 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6534b336-e2e9-42b6-a6db-e682b7d479fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:29.854635 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6534b336-e2e9-42b6-a6db-e682b7d479fd admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:29.929414 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1181/2378] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:56:29 2022] POST /identity/v3/projects => generated 383 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:56:29.930705 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd22abe-0f99-4235-8ac3-14a9d8ff4986 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:29.974859 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd22abe-0f99-4235-8ac3-14a9d8ff4986 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:30.166213 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e75964-2a19-4135-970a-2e523739afd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:30.168718 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e75964-2a19-4135-970a-2e523739afd2 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:30.169620 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e75964-2a19-4135-970a-2e523739afd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:30.171619 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e75964-2a19-4135-970a-2e523739afd2 admin admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:30.173602 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e75964-2a19-4135-970a-2e523739afd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:30.185340 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e75964-2a19-4135-970a-2e523739afd2 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:30.289043 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6534b336-e2e9-42b6-a6db-e682b7d479fd admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:30.290552 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1198/2379] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:56:29 2022] POST /identity/v3/users => generated 298 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:56:30.330069 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6534b336-e2e9-42b6-a6db-e682b7d479fd admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:30.347290 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16776a2b-954e-4e09-bae0-7d1b6650a890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:30.348883 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16776a2b-954e-4e09-bae0-7d1b6650a890 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:30.350072 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16776a2b-954e-4e09-bae0-7d1b6650a890 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:30.350415 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16776a2b-954e-4e09-bae0-7d1b6650a890 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:30.352469 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16776a2b-954e-4e09-bae0-7d1b6650a890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:30.356318 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16776a2b-954e-4e09-bae0-7d1b6650a890 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:30.398055 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1182/2380] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 13:56:30.405781 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e75964-2a19-4135-970a-2e523739afd2 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:30.442548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e75964-2a19-4135-970a-2e523739afd2 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:30.460133 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a25d577-8217-47de-a9d0-1c47bd1bc487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:30.463718 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25d577-8217-47de-a9d0-1c47bd1bc487 admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:30.468623 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25d577-8217-47de-a9d0-1c47bd1bc487 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:30.470099 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25d577-8217-47de-a9d0-1c47bd1bc487 admin admin] PATH_INFO: `/v3/projects/7cb20f7091af438e93a3a9304947800f/users/2e496bbb25b143a9a305f148dfaf25f4/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:30.545802 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:30.564808 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a25d577-8217-47de-a9d0-1c47bd1bc487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cb20f7091af438e93a3a9304947800f, user_id=2e496bbb25b143a9a305f148dfaf25f4, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:30.568803 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a25d577-8217-47de-a9d0-1c47bd1bc487 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:30.601700 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1199/2381] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:56:30 2022] PUT /identity/v3/projects/7cb20f7091af438e93a3a9304947800f/users/2e496bbb25b143a9a305f148dfaf25f4/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:56:30.610166 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16776a2b-954e-4e09-bae0-7d1b6650a890 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:30.639254 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16776a2b-954e-4e09-bae0-7d1b6650a890 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:30.842529 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:30.910044 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4b5d3-71e6-482f-9fee-b726248773a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:30.911485 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4b5d3-71e6-482f-9fee-b726248773a6 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:30.914911 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4b5d3-71e6-482f-9fee-b726248773a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:30.915833 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4b5d3-71e6-482f-9fee-b726248773a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:30.917344 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc4b5d3-71e6-482f-9fee-b726248773a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:30.925417 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc4b5d3-71e6-482f-9fee-b726248773a6 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:30.978718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1183/2382] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:56:30.987193 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a25d577-8217-47de-a9d0-1c47bd1bc487 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:31.057024 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a25d577-8217-47de-a9d0-1c47bd1bc487 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:31.114222 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55e9e3-f6a7-4791-82e6-cbf7ba2e2564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:31.115751 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55e9e3-f6a7-4791-82e6-cbf7ba2e2564 admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:31.116115 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55e9e3-f6a7-4791-82e6-cbf7ba2e2564 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:31.116707 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55e9e3-f6a7-4791-82e6-cbf7ba2e2564 admin admin] PATH_INFO: `/v3/projects/7cb20f7091af438e93a3a9304947800f/users/2e496bbb25b143a9a305f148dfaf25f4/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:31.121400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a55e9e3-f6a7-4791-82e6-cbf7ba2e2564 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cb20f7091af438e93a3a9304947800f, user_id=2e496bbb25b143a9a305f148dfaf25f4, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:31.128332 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a55e9e3-f6a7-4791-82e6-cbf7ba2e2564 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:31.196250 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1200/2383] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:56:30 2022] PUT /identity/v3/projects/7cb20f7091af438e93a3a9304947800f/users/2e496bbb25b143a9a305f148dfaf25f4/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:56:31.330011 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8278cf-3aff-4386-ba3d-5cd3f8b78c34 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:31.331625 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8278cf-3aff-4386-ba3d-5cd3f8b78c34 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:31.332351 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8278cf-3aff-4386-ba3d-5cd3f8b78c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:31.456966 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-0c8278cf-3aff-4386-ba3d-5cd3f8b78c34 None None] MFA Rules not processed for user `2e496bbb25b143a9a305f148dfaf25f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:56:31.459326 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-0c8278cf-3aff-4386-ba3d-5cd3f8b78c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:31.557264 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55e9e3-f6a7-4791-82e6-cbf7ba2e2564 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:31.560143 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-6a55e9e3-f6a7-4791-82e6-cbf7ba2e2564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:31.646365 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1184/2384] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:56:31 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:56:31.747484 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55e9e3-f6a7-4791-82e6-cbf7ba2e2564 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:31.770680 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f70525-81ba-4abd-a1ca-6fa804a74c00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:31.772702 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f70525-81ba-4abd-a1ca-6fa804a74c00 service cinder] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:31.773604 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f70525-81ba-4abd-a1ca-6fa804a74c00 service cinder] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:31.773604 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f70525-81ba-4abd-a1ca-6fa804a74c00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:31.793313 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-30f70525-81ba-4abd-a1ca-6fa804a74c00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:31.793903 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8278cf-3aff-4386-ba3d-5cd3f8b78c34 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:31.797554 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-0c8278cf-3aff-4386-ba3d-5cd3f8b78c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:31.844308 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8278cf-3aff-4386-ba3d-5cd3f8b78c34 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:31.868083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b06e3-dc20-4a3d-adcf-e5927215cddf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:31.869709 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b06e3-dc20-4a3d-adcf-e5927215cddf service cinder] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:31.870427 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b06e3-dc20-4a3d-adcf-e5927215cddf service cinder] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:31.871120 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b06e3-dc20-4a3d-adcf-e5927215cddf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:31.972878 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f70525-81ba-4abd-a1ca-6fa804a74c00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:31.976529 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f70525-81ba-4abd-a1ca-6fa804a74c00 service cinder] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:32.000841 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1201/2385] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:56:31 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:56:32.049014 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b06e3-dc20-4a3d-adcf-e5927215cddf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:32.051775 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b06e3-dc20-4a3d-adcf-e5927215cddf service cinder] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:32.084957 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1185/2386] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:56:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:56:32.512455 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf3049-7a8b-4ad0-a4dc-4f2f7426a75f None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:32.513486 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf3049-7a8b-4ad0-a4dc-4f2f7426a75f None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:32.515084 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf3049-7a8b-4ad0-a4dc-4f2f7426a75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:32.583423 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-95cf3049-7a8b-4ad0-a4dc-4f2f7426a75f None None] MFA Rules not processed for user `6d2dd101d1a14e5ab95f272ab1bbeb94`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:56:32.587962 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-95cf3049-7a8b-4ad0-a4dc-4f2f7426a75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:32.771369 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1202/2387] 10.222.0.69 () {58 vars in 1009 bytes} [Thu Sep 8 13:56:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:56:32.806284 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b06e3-dc20-4a3d-adcf-e5927215cddf service cinder] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:32.809829 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-672b06e3-dc20-4a3d-adcf-e5927215cddf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:33.013513 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b06e3-dc20-4a3d-adcf-e5927215cddf service cinder] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:33.030093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44b9c5-6791-4708-bf43-033a372dd395 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9b97592a6840c3865d7dcf886221e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:33.031738 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44b9c5-6791-4708-bf43-033a372dd395 service swift] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:33.032766 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44b9c5-6791-4708-bf43-033a372dd395 service swift] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:33.034046 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44b9c5-6791-4708-bf43-033a372dd395 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:33.048243 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:33.066657 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e44b9c5-6791-4708-bf43-033a372dd395 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:33.072485 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e44b9c5-6791-4708-bf43-033a372dd395 service swift] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:33.118099 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1186/2388] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Sep 8 13:56:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 08 13:56:34.910345 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf3049-7a8b-4ad0-a4dc-4f2f7426a75f None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:34.956296 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf3049-7a8b-4ad0-a4dc-4f2f7426a75f None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:34.979898 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e371a-fbbc-4ffd-9625-d03c0a5c29a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:34.980958 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e371a-fbbc-4ffd-9625-d03c0a5c29a2 service cinder] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:34.981554 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e371a-fbbc-4ffd-9625-d03c0a5c29a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:34.982039 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e371a-fbbc-4ffd-9625-d03c0a5c29a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:35.140779 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:35.285885 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e371a-fbbc-4ffd-9625-d03c0a5c29a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:35.288553 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e371a-fbbc-4ffd-9625-d03c0a5c29a2 service cinder] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:35.325795 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1203/2389] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:56:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:56:35.500742 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44b9c5-6791-4708-bf43-033a372dd395 service swift] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:35.504432 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-2e44b9c5-6791-4708-bf43-033a372dd395 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:35.649235 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44b9c5-6791-4708-bf43-033a372dd395 service swift] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:35.661246 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd69435a-9ca7-47d5-8e81-22115ea6626c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:35.662661 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69435a-9ca7-47d5-8e81-22115ea6626c service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:35.663245 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69435a-9ca7-47d5-8e81-22115ea6626c service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:35.663735 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd69435a-9ca7-47d5-8e81-22115ea6626c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:35.667485 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-fd69435a-9ca7-47d5-8e81-22115ea6626c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:35.826661 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd69435a-9ca7-47d5-8e81-22115ea6626c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:35.828737 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd69435a-9ca7-47d5-8e81-22115ea6626c service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:35.844501 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1187/2390] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:56:35 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:56:36.405609 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126853a-73b2-4e3b-815c-29bfcc9a6d7d None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:36.407668 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126853a-73b2-4e3b-815c-29bfcc9a6d7d None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:36.408339 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126853a-73b2-4e3b-815c-29bfcc9a6d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:36.427761 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd69435a-9ca7-47d5-8e81-22115ea6626c service neutron] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:36.449820 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-5126853a-73b2-4e3b-815c-29bfcc9a6d7d None None] MFA Rules not processed for user `cfe716e6e4fe4b82bcecd0e701e8a012`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:56:36.450106 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd69435a-9ca7-47d5-8e81-22115ea6626c service neutron] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:36.453281 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-5126853a-73b2-4e3b-815c-29bfcc9a6d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:36.468618 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db6f3c-2bba-453a-92c0-257ae6c71ec2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:36.472798 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db6f3c-2bba-453a-92c0-257ae6c71ec2 service cinder] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:36.473493 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db6f3c-2bba-453a-92c0-257ae6c71ec2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:36.473992 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db6f3c-2bba-453a-92c0-257ae6c71ec2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:36.506159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db6f3c-2bba-453a-92c0-257ae6c71ec2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:36.510039 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db6f3c-2bba-453a-92c0-257ae6c71ec2 service cinder] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:36.560160 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1188/2391] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:56:36 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:56:36.678268 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1204/2392] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:56:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:56:42.780426 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db6f3c-2bba-453a-92c0-257ae6c71ec2 service cinder] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:43.005297 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db6f3c-2bba-453a-92c0-257ae6c71ec2 service cinder] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:43.046948 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4b8b6-b913-4337-a47a-3919c3827e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:43.054436 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4b8b6-b913-4337-a47a-3919c3827e0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:43.055051 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4b8b6-b913-4337-a47a-3919c3827e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:43.055676 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4b8b6-b913-4337-a47a-3919c3827e0d admin admin] PATH_INFO: `/v3/users/dcd25a0b8152482aa249ad8a54ceb643` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:43.058288 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e4b8b6-b913-4337-a47a-3919c3827e0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcd25a0b8152482aa249ad8a54ceb643)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:43.062924 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e4b8b6-b913-4337-a47a-3919c3827e0d admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:43.193098 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:43.232872 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-41e4b8b6-b913-4337-a47a-3919c3827e0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcd25a0b8152482aa249ad8a54ceb643'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:43.234285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-41e4b8b6-b913-4337-a47a-3919c3827e0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcd25a0b8152482aa249ad8a54ceb643'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:43.263035 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-41e4b8b6-b913-4337-a47a-3919c3827e0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcd25a0b8152482aa249ad8a54ceb643'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:43.304188 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-41e4b8b6-b913-4337-a47a-3919c3827e0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcd25a0b8152482aa249ad8a54ceb643'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:43.305858 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-41e4b8b6-b913-4337-a47a-3919c3827e0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcd25a0b8152482aa249ad8a54ceb643'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:43.341351 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1189/2393] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:56:42 2022] DELETE /identity/v3/users/dcd25a0b8152482aa249ad8a54ceb643 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:56:43.349357 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0907128-8f89-4d65-ab6c-6f030d6a0e3c None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:43.351335 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0907128-8f89-4d65-ab6c-6f030d6a0e3c None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:43.352087 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0907128-8f89-4d65-ab6c-6f030d6a0e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:43.424487 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-d0907128-8f89-4d65-ab6c-6f030d6a0e3c None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:56:43.427175 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-d0907128-8f89-4d65-ab6c-6f030d6a0e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:43.628772 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1205/2394] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:56:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:56:43.646014 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4b8b6-b913-4337-a47a-3919c3827e0d admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:43.648405 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-41e4b8b6-b913-4337-a47a-3919c3827e0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:43.844967 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4b8b6-b913-4337-a47a-3919c3827e0d admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:43.872473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b217daca-908a-41e2-9da1-e7ac3e430154 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:43.874472 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217daca-908a-41e2-9da1-e7ac3e430154 service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:43.876465 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217daca-908a-41e2-9da1-e7ac3e430154 service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:43.876465 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b217daca-908a-41e2-9da1-e7ac3e430154 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:43.912299 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b217daca-908a-41e2-9da1-e7ac3e430154 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:43.914313 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b217daca-908a-41e2-9da1-e7ac3e430154 service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:43.966103 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1190/2395] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:56:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:56:45.183584 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0907128-8f89-4d65-ab6c-6f030d6a0e3c None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:45.186874 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-d0907128-8f89-4d65-ab6c-6f030d6a0e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:45.230465 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0907128-8f89-4d65-ab6c-6f030d6a0e3c None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:45.272103 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be31beee-12e3-4746-a2fb-5b9afd8f5f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:45.273131 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31beee-12e3-4746-a2fb-5b9afd8f5f75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:45.273595 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31beee-12e3-4746-a2fb-5b9afd8f5f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:45.274023 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31beee-12e3-4746-a2fb-5b9afd8f5f75 admin admin] PATH_INFO: `/v3/projects/de3b812e3d0941fca1102287c3a9ab33` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:45.275929 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be31beee-12e3-4746-a2fb-5b9afd8f5f75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de3b812e3d0941fca1102287c3a9ab33)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:45.283143 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be31beee-12e3-4746-a2fb-5b9afd8f5f75 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:45.471846 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-be31beee-12e3-4746-a2fb-5b9afd8f5f75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de3b812e3d0941fca1102287c3a9ab33', 'request_id': 'req-be31beee-12e3-4746-a2fb-5b9afd8f5f75'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:45.553354 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-be31beee-12e3-4746-a2fb-5b9afd8f5f75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de3b812e3d0941fca1102287c3a9ab33', 'request_id': 'req-be31beee-12e3-4746-a2fb-5b9afd8f5f75'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:45.586421 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-be31beee-12e3-4746-a2fb-5b9afd8f5f75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de3b812e3d0941fca1102287c3a9ab33', 'request_id': 'req-be31beee-12e3-4746-a2fb-5b9afd8f5f75'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:45.614661 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:45.635662 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-be31beee-12e3-4746-a2fb-5b9afd8f5f75 admin admin] The token cache is being invalidate because project de3b812e3d0941fca1102287c3a9ab33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:56:45.639486 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-be31beee-12e3-4746-a2fb-5b9afd8f5f75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:45.648674 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-be31beee-12e3-4746-a2fb-5b9afd8f5f75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:45.658855 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1206/2396] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:56:45 2022] DELETE /identity/v3/projects/de3b812e3d0941fca1102287c3a9ab33 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:56:45.666978 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b217daca-908a-41e2-9da1-e7ac3e430154 service neutron] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:45.706123 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b217daca-908a-41e2-9da1-e7ac3e430154 service neutron] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:46.139359 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16df92-ef78-4c1c-b6f6-50efd47308a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:46.166122 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16df92-ef78-4c1c-b6f6-50efd47308a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:46.167770 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16df92-ef78-4c1c-b6f6-50efd47308a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:46.167770 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16df92-ef78-4c1c-b6f6-50efd47308a1 admin admin] PATH_INFO: `/v3/users/2d3b6f87f2da49959ac50ef63a3a4e3a` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:46.171046 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e16df92-ef78-4c1c-b6f6-50efd47308a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d3b6f87f2da49959ac50ef63a3a4e3a)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:46.190813 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e16df92-ef78-4c1c-b6f6-50efd47308a1 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:46.400694 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-5e16df92-ef78-4c1c-b6f6-50efd47308a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d3b6f87f2da49959ac50ef63a3a4e3a'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:46.406131 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-5e16df92-ef78-4c1c-b6f6-50efd47308a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d3b6f87f2da49959ac50ef63a3a4e3a'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:46.420242 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:46.424325 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-5e16df92-ef78-4c1c-b6f6-50efd47308a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d3b6f87f2da49959ac50ef63a3a4e3a'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:46.460385 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-5e16df92-ef78-4c1c-b6f6-50efd47308a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d3b6f87f2da49959ac50ef63a3a4e3a'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:46.461331 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-5e16df92-ef78-4c1c-b6f6-50efd47308a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d3b6f87f2da49959ac50ef63a3a4e3a'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:46.505298 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1191/2397] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:56:45 2022] DELETE /identity/v3/users/2d3b6f87f2da49959ac50ef63a3a4e3a => generated 0 bytes in 841 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:56:48.354677 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be31beee-12e3-4746-a2fb-5b9afd8f5f75 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:48.360385 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-be31beee-12e3-4746-a2fb-5b9afd8f5f75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:48.425217 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be31beee-12e3-4746-a2fb-5b9afd8f5f75 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:48.665265 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc931af5-ccdb-4230-9f0b-1745a39f6d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:48.666220 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc931af5-ccdb-4230-9f0b-1745a39f6d19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:48.666690 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc931af5-ccdb-4230-9f0b-1745a39f6d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:48.667163 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc931af5-ccdb-4230-9f0b-1745a39f6d19 admin admin] PATH_INFO: `/v3/projects/1667bfda43494890af23d4d631234276` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:48.669072 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc931af5-ccdb-4230-9f0b-1745a39f6d19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1667bfda43494890af23d4d631234276)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:48.673173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc931af5-ccdb-4230-9f0b-1745a39f6d19 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:48.826976 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-dc931af5-ccdb-4230-9f0b-1745a39f6d19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1667bfda43494890af23d4d631234276', 'request_id': 'req-dc931af5-ccdb-4230-9f0b-1745a39f6d19'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:48.866955 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-dc931af5-ccdb-4230-9f0b-1745a39f6d19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1667bfda43494890af23d4d631234276', 'request_id': 'req-dc931af5-ccdb-4230-9f0b-1745a39f6d19'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:48.897912 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-dc931af5-ccdb-4230-9f0b-1745a39f6d19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1667bfda43494890af23d4d631234276', 'request_id': 'req-dc931af5-ccdb-4230-9f0b-1745a39f6d19'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:48.960827 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-dc931af5-ccdb-4230-9f0b-1745a39f6d19 admin admin] The token cache is being invalidate because project 1667bfda43494890af23d4d631234276 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:56:48.969178 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-dc931af5-ccdb-4230-9f0b-1745a39f6d19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:48.971806 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-dc931af5-ccdb-4230-9f0b-1745a39f6d19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:48.988393 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1207/2398] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:56:48 2022] DELETE /identity/v3/projects/1667bfda43494890af23d4d631234276 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:56:48.994282 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16df92-ef78-4c1c-b6f6-50efd47308a1 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:48.997445 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-5e16df92-ef78-4c1c-b6f6-50efd47308a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:49.046818 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16df92-ef78-4c1c-b6f6-50efd47308a1 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:49.223217 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c5f8b5-a0da-4814-8626-7bb84be958fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:49.226260 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5f8b5-a0da-4814-8626-7bb84be958fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:49.227226 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5f8b5-a0da-4814-8626-7bb84be958fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:49.227962 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5f8b5-a0da-4814-8626-7bb84be958fc admin admin] PATH_INFO: `/v3/users/2e496bbb25b143a9a305f148dfaf25f4` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:49.230869 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c5f8b5-a0da-4814-8626-7bb84be958fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e496bbb25b143a9a305f148dfaf25f4)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:49.236347 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c5f8b5-a0da-4814-8626-7bb84be958fc admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:49.400741 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-c4c5f8b5-a0da-4814-8626-7bb84be958fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e496bbb25b143a9a305f148dfaf25f4'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:49.402332 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-c4c5f8b5-a0da-4814-8626-7bb84be958fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e496bbb25b143a9a305f148dfaf25f4'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:49.419340 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-c4c5f8b5-a0da-4814-8626-7bb84be958fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e496bbb25b143a9a305f148dfaf25f4'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:49.458320 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-c4c5f8b5-a0da-4814-8626-7bb84be958fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e496bbb25b143a9a305f148dfaf25f4'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:49.459947 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-c4c5f8b5-a0da-4814-8626-7bb84be958fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e496bbb25b143a9a305f148dfaf25f4'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:49.538223 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1192/2399] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:56:48 2022] DELETE /identity/v3/users/2e496bbb25b143a9a305f148dfaf25f4 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:56:50.368441 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc931af5-ccdb-4230-9f0b-1745a39f6d19 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:50.370347 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-dc931af5-ccdb-4230-9f0b-1745a39f6d19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:50.414542 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc931af5-ccdb-4230-9f0b-1745a39f6d19 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:50.678611 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1707996-d1bf-415b-9a21-9dce0908b7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:50.686796 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1707996-d1bf-415b-9a21-9dce0908b7cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:50.688774 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1707996-d1bf-415b-9a21-9dce0908b7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:50.689326 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1707996-d1bf-415b-9a21-9dce0908b7cf admin admin] PATH_INFO: `/v3/projects/7cb20f7091af438e93a3a9304947800f` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:50.692089 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1707996-d1bf-415b-9a21-9dce0908b7cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cb20f7091af438e93a3a9304947800f)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:50.703435 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1707996-d1bf-415b-9a21-9dce0908b7cf admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:50.822774 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:50.877866 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-f1707996-d1bf-415b-9a21-9dce0908b7cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cb20f7091af438e93a3a9304947800f', 'request_id': 'req-f1707996-d1bf-415b-9a21-9dce0908b7cf'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:50.915244 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-f1707996-d1bf-415b-9a21-9dce0908b7cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cb20f7091af438e93a3a9304947800f', 'request_id': 'req-f1707996-d1bf-415b-9a21-9dce0908b7cf'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:50.942860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-f1707996-d1bf-415b-9a21-9dce0908b7cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cb20f7091af438e93a3a9304947800f', 'request_id': 'req-f1707996-d1bf-415b-9a21-9dce0908b7cf'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:50.983726 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-f1707996-d1bf-415b-9a21-9dce0908b7cf admin admin] The token cache is being invalidate because project 7cb20f7091af438e93a3a9304947800f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:56:50.984354 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-f1707996-d1bf-415b-9a21-9dce0908b7cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:50.985584 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-f1707996-d1bf-415b-9a21-9dce0908b7cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:56:50.996656 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1208/2400] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:56:50 2022] DELETE /identity/v3/projects/7cb20f7091af438e93a3a9304947800f => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:56:51.000468 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115128d-a026-4b80-b3c5-edc6c676fc2b None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:51.010798 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115128d-a026-4b80-b3c5-edc6c676fc2b None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:51.011633 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115128d-a026-4b80-b3c5-edc6c676fc2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:51.120126 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-b115128d-a026-4b80-b3c5-edc6c676fc2b None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:56:51.122259 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-b115128d-a026-4b80-b3c5-edc6c676fc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:51.333998 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:51.397494 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1193/2401] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:56:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:56:51.420905 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a05a6-2c43-4599-b447-81fa6992d826 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:51.422392 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a05a6-2c43-4599-b447-81fa6992d826 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:51.423057 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a05a6-2c43-4599-b447-81fa6992d826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:51.521146 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-b31a05a6-2c43-4599-b447-81fa6992d826 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:56:51.530475 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-b31a05a6-2c43-4599-b447-81fa6992d826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:51.581018 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1209/2402] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:56:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:56:51.583102 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b115128d-a026-4b80-b3c5-edc6c676fc2b None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:51.608060 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b115128d-a026-4b80-b3c5-edc6c676fc2b None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:51.646569 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4749b7-33fc-4f71-aede-d105fa625ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:51.647722 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4749b7-33fc-4f71-aede-d105fa625ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:51.649057 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4749b7-33fc-4f71-aede-d105fa625ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:51.658291 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4749b7-33fc-4f71-aede-d105fa625ee2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:51.658291 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4749b7-33fc-4f71-aede-d105fa625ee2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:56:51.658291 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4749b7-33fc-4f71-aede-d105fa625ee2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:51.674150 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4749b7-33fc-4f71-aede-d105fa625ee2 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:51.715174 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1194/2403] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 13:56:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:56:51.721578 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a05a6-2c43-4599-b447-81fa6992d826 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:51.752558 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a05a6-2c43-4599-b447-81fa6992d826 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:51.792625 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a68e94-7685-4909-98e9-128d7e97e733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:51.798051 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a68e94-7685-4909-98e9-128d7e97e733 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:51.799178 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a68e94-7685-4909-98e9-128d7e97e733 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:51.799924 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a68e94-7685-4909-98e9-128d7e97e733 admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:51.801598 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a68e94-7685-4909-98e9-128d7e97e733 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:51.813718 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a68e94-7685-4909-98e9-128d7e97e733 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:51.924104 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1210/2404] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:56:51 2022] POST /identity/v3/projects => generated 371 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:56:51.934501 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4749b7-33fc-4f71-aede-d105fa625ee2 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:51.970616 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4749b7-33fc-4f71-aede-d105fa625ee2 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:52.189741 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210232b1-4462-4bd0-a74f-b3db55ac3564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:52.192420 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210232b1-4462-4bd0-a74f-b3db55ac3564 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:52.192956 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210232b1-4462-4bd0-a74f-b3db55ac3564 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:52.194191 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210232b1-4462-4bd0-a74f-b3db55ac3564 admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:52.196245 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210232b1-4462-4bd0-a74f-b3db55ac3564 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:52.201262 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210232b1-4462-4bd0-a74f-b3db55ac3564 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:52.288056 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a68e94-7685-4909-98e9-128d7e97e733 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:52.291184 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1195/2405] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:56:51 2022] POST /identity/v3/users => generated 286 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:56:52.310147 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a68e94-7685-4909-98e9-128d7e97e733 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:52.323819 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276f14f-15e3-4b0d-8e79-77000b1d7450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:52.329656 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276f14f-15e3-4b0d-8e79-77000b1d7450 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:52.330504 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276f14f-15e3-4b0d-8e79-77000b1d7450 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:52.332941 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276f14f-15e3-4b0d-8e79-77000b1d7450 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:52.335916 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a276f14f-15e3-4b0d-8e79-77000b1d7450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:52.342904 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a276f14f-15e3-4b0d-8e79-77000b1d7450 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:52.399285 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1211/2406] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:56:52.407014 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210232b1-4462-4bd0-a74f-b3db55ac3564 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:52.453730 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210232b1-4462-4bd0-a74f-b3db55ac3564 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:52.487157 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c4b2e-abf8-434a-a838-e7f6cdbf901a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:52.489491 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c4b2e-abf8-434a-a838-e7f6cdbf901a admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:52.490159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c4b2e-abf8-434a-a838-e7f6cdbf901a admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:52.491724 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c4b2e-abf8-434a-a838-e7f6cdbf901a admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:52.498320 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c4b2e-abf8-434a-a838-e7f6cdbf901a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:52.501317 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c4b2e-abf8-434a-a838-e7f6cdbf901a admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:52.580677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1196/2407] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:56:52.588192 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276f14f-15e3-4b0d-8e79-77000b1d7450 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:52.620011 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276f14f-15e3-4b0d-8e79-77000b1d7450 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:52.641324 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5139e7f-e704-4128-990b-e7e67782564a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:52.643272 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5139e7f-e704-4128-990b-e7e67782564a admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:52.645302 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5139e7f-e704-4128-990b-e7e67782564a admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:52.646111 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5139e7f-e704-4128-990b-e7e67782564a admin admin] PATH_INFO: `/v3/projects/be8e3993e0c746a2adb7a5f0f304e26a/users/cb73a0582bdd46cfa2a350eff014bbc1/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:52.735625 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5139e7f-e704-4128-990b-e7e67782564a admin admin] RBAC: Authorizing `identity:create_grant(project_id=be8e3993e0c746a2adb7a5f0f304e26a, user_id=cb73a0582bdd46cfa2a350eff014bbc1, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:52.741696 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5139e7f-e704-4128-990b-e7e67782564a admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:52.785673 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1212/2408] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:56:52 2022] PUT /identity/v3/projects/be8e3993e0c746a2adb7a5f0f304e26a/users/cb73a0582bdd46cfa2a350eff014bbc1/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:56:52.793690 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734ea10-b456-4034-921c-4825f21ddc84 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:52.794176 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734ea10-b456-4034-921c-4825f21ddc84 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:52.795226 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734ea10-b456-4034-921c-4825f21ddc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:52.857929 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-b734ea10-b456-4034-921c-4825f21ddc84 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:56:52.860153 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-b734ea10-b456-4034-921c-4825f21ddc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:53.074325 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1197/2409] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:56:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:56:53.091854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5139e7f-e704-4128-990b-e7e67782564a admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:53.094667 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-c5139e7f-e704-4128-990b-e7e67782564a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:53.302065 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5139e7f-e704-4128-990b-e7e67782564a admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:53.310919 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea4f0a-7916-4d0d-9638-009af4f1dfcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:53.312338 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea4f0a-7916-4d0d-9638-009af4f1dfcb service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:53.312979 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea4f0a-7916-4d0d-9638-009af4f1dfcb service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:53.313681 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea4f0a-7916-4d0d-9638-009af4f1dfcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:53.361483 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea4f0a-7916-4d0d-9638-009af4f1dfcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:53.365495 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea4f0a-7916-4d0d-9638-009af4f1dfcb service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:53.391974 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1213/2410] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:56:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:56:56.649162 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e54874-5acd-4a73-a118-92ac9782cc0a None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:56.650841 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e54874-5acd-4a73-a118-92ac9782cc0a None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:56.651559 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e54874-5acd-4a73-a118-92ac9782cc0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:56.696854 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-d5e54874-5acd-4a73-a118-92ac9782cc0a None None] MFA Rules not processed for user `cb73a0582bdd46cfa2a350eff014bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:56:56.699425 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-d5e54874-5acd-4a73-a118-92ac9782cc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:56.808900 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:56.871546 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1198/2411] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:56:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:56:56.887601 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea4f0a-7916-4d0d-9638-009af4f1dfcb service neutron] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:56:56.891563 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-c2ea4f0a-7916-4d0d-9638-009af4f1dfcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:57.189849 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea4f0a-7916-4d0d-9638-009af4f1dfcb service neutron] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:56:57.202730 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b437363-0106-4baf-ae73-9929de82beef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:56:57.204953 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b437363-0106-4baf-ae73-9929de82beef service cinder] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:57.205921 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b437363-0106-4baf-ae73-9929de82beef service cinder] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:57.207435 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b437363-0106-4baf-ae73-9929de82beef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:57.293527 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b437363-0106-4baf-ae73-9929de82beef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:56:57.300863 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b437363-0106-4baf-ae73-9929de82beef service cinder] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:56:57.343935 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1214/2412] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:56:56 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:56:59.602701 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e321f7-017c-4c2b-a507-022e9b2d5998 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:56:59.603390 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e321f7-017c-4c2b-a507-022e9b2d5998 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:56:59.603696 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e321f7-017c-4c2b-a507-022e9b2d5998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:56:59.641233 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-a8e321f7-017c-4c2b-a507-022e9b2d5998 None None] MFA Rules not processed for user `cb73a0582bdd46cfa2a350eff014bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:56:59.643270 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-a8e321f7-017c-4c2b-a507-022e9b2d5998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:56:59.658040 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1199/2413] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:56:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:57:00.584808 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1257d7-7562-40b9-93f1-d68ad05670f7 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:00.586647 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1257d7-7562-40b9-93f1-d68ad05670f7 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:00.587029 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1257d7-7562-40b9-93f1-d68ad05670f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:00.603484 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:00.634479 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-0b1257d7-7562-40b9-93f1-d68ad05670f7 None None] MFA Rules not processed for user `6d2dd101d1a14e5ab95f272ab1bbeb94`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:57:00.637415 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-0b1257d7-7562-40b9-93f1-d68ad05670f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:00.775401 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1215/2414] 10.222.0.69 () {58 vars in 967 bytes} [Thu Sep 8 13:57:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:57:00.796195 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e321f7-017c-4c2b-a507-022e9b2d5998 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:57:00.798632 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-a8e321f7-017c-4c2b-a507-022e9b2d5998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:01.006436 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e321f7-017c-4c2b-a507-022e9b2d5998 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:57:01.018620 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7484ca5-3e34-41fa-aebc-5d59d401d7c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9b97592a6840c3865d7dcf886221e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:57:01.020415 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7484ca5-3e34-41fa-aebc-5d59d401d7c3 service swift] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:01.021203 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7484ca5-3e34-41fa-aebc-5d59d401d7c3 service swift] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:01.021865 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7484ca5-3e34-41fa-aebc-5d59d401d7c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:01.041632 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7484ca5-3e34-41fa-aebc-5d59d401d7c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:57:01.046868 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7484ca5-3e34-41fa-aebc-5d59d401d7c3 service swift] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:57:01.073490 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1200/2415] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Sep 8 13:57:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 08 13:57:10.762085 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=24 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:11.058724 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=41 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:14.129472 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1257d7-7562-40b9-93f1-d68ad05670f7 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:57:14.131465 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-0b1257d7-7562-40b9-93f1-d68ad05670f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:14.161284 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1257d7-7562-40b9-93f1-d68ad05670f7 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:57:14.173189 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d059489-5276-4e3d-97e8-688ec2862ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:57:14.174292 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d059489-5276-4e3d-97e8-688ec2862ba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:14.174682 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d059489-5276-4e3d-97e8-688ec2862ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:14.175000 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d059489-5276-4e3d-97e8-688ec2862ba7 admin admin] PATH_INFO: `/v3/users/e1714203a1d3405fb2d236d2a5b4a49a` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:14.176760 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d059489-5276-4e3d-97e8-688ec2862ba7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1714203a1d3405fb2d236d2a5b4a49a)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:57:14.179785 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d059489-5276-4e3d-97e8-688ec2862ba7 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:57:14.314619 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-1d059489-5276-4e3d-97e8-688ec2862ba7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1714203a1d3405fb2d236d2a5b4a49a'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:57:14.316219 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-1d059489-5276-4e3d-97e8-688ec2862ba7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1714203a1d3405fb2d236d2a5b4a49a'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:57:14.317458 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-1d059489-5276-4e3d-97e8-688ec2862ba7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1714203a1d3405fb2d236d2a5b4a49a'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:57:14.330529 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-1d059489-5276-4e3d-97e8-688ec2862ba7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1714203a1d3405fb2d236d2a5b4a49a'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:57:14.353127 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-1d059489-5276-4e3d-97e8-688ec2862ba7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1714203a1d3405fb2d236d2a5b4a49a'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:57:14.390762 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1216/2416] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:57:14 2022] DELETE /identity/v3/users/e1714203a1d3405fb2d236d2a5b4a49a => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:57:14.867084 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7484ca5-3e34-41fa-aebc-5d59d401d7c3 service swift] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:57:14.917720 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7484ca5-3e34-41fa-aebc-5d59d401d7c3 service swift] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:57:15.119683 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf08c1-1361-4bdc-9175-1b5532cbf1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:57:15.120759 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf08c1-1361-4bdc-9175-1b5532cbf1e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:15.121206 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf08c1-1361-4bdc-9175-1b5532cbf1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:15.121677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf08c1-1361-4bdc-9175-1b5532cbf1e8 admin admin] PATH_INFO: `/v3/projects/cdc3063b965a43fcb20dba1975e7fa93` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:15.125738 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf08c1-1361-4bdc-9175-1b5532cbf1e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdc3063b965a43fcb20dba1975e7fa93)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:57:15.129584 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf08c1-1361-4bdc-9175-1b5532cbf1e8 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:57:15.297988 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-7fcf08c1-1361-4bdc-9175-1b5532cbf1e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdc3063b965a43fcb20dba1975e7fa93', 'request_id': 'req-7fcf08c1-1361-4bdc-9175-1b5532cbf1e8'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:57:15.324391 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-7fcf08c1-1361-4bdc-9175-1b5532cbf1e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdc3063b965a43fcb20dba1975e7fa93', 'request_id': 'req-7fcf08c1-1361-4bdc-9175-1b5532cbf1e8'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:57:15.340139 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-7fcf08c1-1361-4bdc-9175-1b5532cbf1e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdc3063b965a43fcb20dba1975e7fa93', 'request_id': 'req-7fcf08c1-1361-4bdc-9175-1b5532cbf1e8'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:57:15.372823 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-7fcf08c1-1361-4bdc-9175-1b5532cbf1e8 admin admin] The token cache is being invalidate because project cdc3063b965a43fcb20dba1975e7fa93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:57:15.373234 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-7fcf08c1-1361-4bdc-9175-1b5532cbf1e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:57:15.374302 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-7fcf08c1-1361-4bdc-9175-1b5532cbf1e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:57:15.376470 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1201/2417] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:57:14 2022] DELETE /identity/v3/projects/cdc3063b965a43fcb20dba1975e7fa93 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:57:15.388033 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d059489-5276-4e3d-97e8-688ec2862ba7 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:57:15.396373 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-1d059489-5276-4e3d-97e8-688ec2862ba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:15.427548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d059489-5276-4e3d-97e8-688ec2862ba7 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:57:15.575011 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cbc122-318c-46a5-8e38-8941e5bb9794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:57:15.576214 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbc122-318c-46a5-8e38-8941e5bb9794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:15.578431 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbc122-318c-46a5-8e38-8941e5bb9794 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:15.578431 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cbc122-318c-46a5-8e38-8941e5bb9794 admin admin] PATH_INFO: `/v3/users/711e13eb17ae445ea1d305e083b5c874` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:15.583267 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cbc122-318c-46a5-8e38-8941e5bb9794 admin admin] RBAC: Authorizing `identity:delete_user(user_id=711e13eb17ae445ea1d305e083b5c874)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:57:15.583267 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cbc122-318c-46a5-8e38-8941e5bb9794 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:57:15.678142 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-b9cbc122-318c-46a5-8e38-8941e5bb9794 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '711e13eb17ae445ea1d305e083b5c874'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:57:15.679312 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-b9cbc122-318c-46a5-8e38-8941e5bb9794 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '711e13eb17ae445ea1d305e083b5c874'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:57:15.680672 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-b9cbc122-318c-46a5-8e38-8941e5bb9794 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '711e13eb17ae445ea1d305e083b5c874'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:57:15.694924 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-b9cbc122-318c-46a5-8e38-8941e5bb9794 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '711e13eb17ae445ea1d305e083b5c874'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:57:15.725038 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-b9cbc122-318c-46a5-8e38-8941e5bb9794 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '711e13eb17ae445ea1d305e083b5c874'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:57:15.729581 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:15.776043 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1217/2418] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:57:15 2022] DELETE /identity/v3/users/711e13eb17ae445ea1d305e083b5c874 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:57:16.421013 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf08c1-1361-4bdc-9175-1b5532cbf1e8 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:57:16.424973 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-7fcf08c1-1361-4bdc-9175-1b5532cbf1e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:16.471731 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf08c1-1361-4bdc-9175-1b5532cbf1e8 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:57:16.700200 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0ed13-fdb4-4112-98f3-5186e3481f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:57:16.702271 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0ed13-fdb4-4112-98f3-5186e3481f7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:16.703044 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0ed13-fdb4-4112-98f3-5186e3481f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:16.703867 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0ed13-fdb4-4112-98f3-5186e3481f7d admin admin] PATH_INFO: `/v3/projects/cceb5b5e94ad4d81a17e69b04e9521e4` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:16.709875 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0ed13-fdb4-4112-98f3-5186e3481f7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cceb5b5e94ad4d81a17e69b04e9521e4)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:57:16.714199 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0ed13-fdb4-4112-98f3-5186e3481f7d admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:57:16.842421 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:16.884713 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-bcd0ed13-fdb4-4112-98f3-5186e3481f7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cceb5b5e94ad4d81a17e69b04e9521e4', 'request_id': 'req-bcd0ed13-fdb4-4112-98f3-5186e3481f7d'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:57:16.898128 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-bcd0ed13-fdb4-4112-98f3-5186e3481f7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cceb5b5e94ad4d81a17e69b04e9521e4', 'request_id': 'req-bcd0ed13-fdb4-4112-98f3-5186e3481f7d'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:57:16.910893 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-bcd0ed13-fdb4-4112-98f3-5186e3481f7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cceb5b5e94ad4d81a17e69b04e9521e4', 'request_id': 'req-bcd0ed13-fdb4-4112-98f3-5186e3481f7d'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:57:16.940699 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-bcd0ed13-fdb4-4112-98f3-5186e3481f7d admin admin] The token cache is being invalidate because project cceb5b5e94ad4d81a17e69b04e9521e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:57:16.941051 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-bcd0ed13-fdb4-4112-98f3-5186e3481f7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:57:16.941851 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-bcd0ed13-fdb4-4112-98f3-5186e3481f7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:57:16.948611 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1202/2419] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:57:16 2022] DELETE /identity/v3/projects/cceb5b5e94ad4d81a17e69b04e9521e4 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:57:16.962181 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d743f0-e350-4453-8446-8d2f2c915339 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:16.963018 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d743f0-e350-4453-8446-8d2f2c915339 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:16.963018 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d743f0-e350-4453-8446-8d2f2c915339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:17.027175 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-49d743f0-e350-4453-8446-8d2f2c915339 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:57:17.027691 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-49d743f0-e350-4453-8446-8d2f2c915339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:17.271003 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1218/2420] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:57:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:57:17.290579 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed76535-13d4-47ce-a818-aae54a9d2cb3 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:17.290579 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed76535-13d4-47ce-a818-aae54a9d2cb3 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:17.290579 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed76535-13d4-47ce-a818-aae54a9d2cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:17.332883 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-5ed76535-13d4-47ce-a818-aae54a9d2cb3 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:57:17.335952 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-5ed76535-13d4-47ce-a818-aae54a9d2cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:17.361349 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1203/2421] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:57:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:57:17.363084 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d743f0-e350-4453-8446-8d2f2c915339 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:57:17.395475 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d743f0-e350-4453-8446-8d2f2c915339 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:57:17.411798 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2077dd35-5a52-4f4c-9471-899a8ccf2585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:57:17.414203 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077dd35-5a52-4f4c-9471-899a8ccf2585 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:17.415243 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077dd35-5a52-4f4c-9471-899a8ccf2585 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:17.416106 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077dd35-5a52-4f4c-9471-899a8ccf2585 admin admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:17.417338 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2077dd35-5a52-4f4c-9471-899a8ccf2585 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:57:17.421506 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2077dd35-5a52-4f4c-9471-899a8ccf2585 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:57:17.434484 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2077dd35-5a52-4f4c-9471-899a8ccf2585 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:57:17.490724 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1219/2422] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 13:57:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:57:17.493837 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed76535-13d4-47ce-a818-aae54a9d2cb3 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:57:17.518634 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed76535-13d4-47ce-a818-aae54a9d2cb3 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:57:17.563976 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad27c6-bc2e-43db-ad3e-526c4002b90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:57:17.565540 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad27c6-bc2e-43db-ad3e-526c4002b90b admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:17.566292 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad27c6-bc2e-43db-ad3e-526c4002b90b admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:17.568447 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad27c6-bc2e-43db-ad3e-526c4002b90b admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:17.569809 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad27c6-bc2e-43db-ad3e-526c4002b90b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:57:17.572951 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad27c6-bc2e-43db-ad3e-526c4002b90b admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:57:17.677660 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2077dd35-5a52-4f4c-9471-899a8ccf2585 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:57:17.680219 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1204/2423] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:57:17 2022] POST /identity/v3/projects => generated 377 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:57:17.716447 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2077dd35-5a52-4f4c-9471-899a8ccf2585 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:57:17.882822 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab06f447-f1e0-497b-ba64-bce5152b6c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:57:17.883262 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06f447-f1e0-497b-ba64-bce5152b6c25 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:17.883748 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06f447-f1e0-497b-ba64-bce5152b6c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:17.884340 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06f447-f1e0-497b-ba64-bce5152b6c25 admin admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:17.887089 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab06f447-f1e0-497b-ba64-bce5152b6c25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:57:17.890510 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab06f447-f1e0-497b-ba64-bce5152b6c25 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:57:17.937449 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1220/2424] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:57:17 2022] POST /identity/v3/users => generated 289 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:57:17.945310 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad27c6-bc2e-43db-ad3e-526c4002b90b admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:57:17.965017 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad27c6-bc2e-43db-ad3e-526c4002b90b admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:57:17.988354 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3fea03-0bba-4e7f-82fa-0915844584d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:57:17.990656 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fea03-0bba-4e7f-82fa-0915844584d8 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:17.990934 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fea03-0bba-4e7f-82fa-0915844584d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:17.991405 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fea03-0bba-4e7f-82fa-0915844584d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:17.992410 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3fea03-0bba-4e7f-82fa-0915844584d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:57:17.995427 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3fea03-0bba-4e7f-82fa-0915844584d8 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:57:18.016149 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1205/2425] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:57:18.022353 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab06f447-f1e0-497b-ba64-bce5152b6c25 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:57:18.039634 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab06f447-f1e0-497b-ba64-bce5152b6c25 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:57:18.051080 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893e2c1-2a03-4889-99ee-6641bf352284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:57:18.052184 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893e2c1-2a03-4889-99ee-6641bf352284 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:18.052709 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893e2c1-2a03-4889-99ee-6641bf352284 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:18.053222 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893e2c1-2a03-4889-99ee-6641bf352284 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:18.054105 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a893e2c1-2a03-4889-99ee-6641bf352284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:57:18.056824 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a893e2c1-2a03-4889-99ee-6641bf352284 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:57:18.080211 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1221/2426] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:57:18.088484 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3fea03-0bba-4e7f-82fa-0915844584d8 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:57:18.119512 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3fea03-0bba-4e7f-82fa-0915844584d8 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:57:18.142490 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adbb57d-0d7b-47e8-9b99-17a3c975cb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:57:18.143907 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbb57d-0d7b-47e8-9b99-17a3c975cb6b admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:18.144481 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbb57d-0d7b-47e8-9b99-17a3c975cb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:18.144916 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbb57d-0d7b-47e8-9b99-17a3c975cb6b admin admin] PATH_INFO: `/v3/projects/a91049dc331b4f3a9dda116b082cf7c4/users/25956684bd674b008637f0a22b03aa6f/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:18.187862 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adbb57d-0d7b-47e8-9b99-17a3c975cb6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a91049dc331b4f3a9dda116b082cf7c4, user_id=25956684bd674b008637f0a22b03aa6f, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:57:18.198979 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adbb57d-0d7b-47e8-9b99-17a3c975cb6b admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:57:18.235629 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1206/2427] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:57:18 2022] PUT /identity/v3/projects/a91049dc331b4f3a9dda116b082cf7c4/users/25956684bd674b008637f0a22b03aa6f/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:57:18.253408 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6234054-dfaa-455b-a8b0-7e60b1fa3baa None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:18.254025 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6234054-dfaa-455b-a8b0-7e60b1fa3baa None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:18.254664 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6234054-dfaa-455b-a8b0-7e60b1fa3baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:18.328158 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-c6234054-dfaa-455b-a8b0-7e60b1fa3baa None None] MFA Rules not processed for user `25956684bd674b008637f0a22b03aa6f`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:57:18.331426 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-c6234054-dfaa-455b-a8b0-7e60b1fa3baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:18.413464 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:18.477355 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1222/2428] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:57:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:57:18.495766 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adbb57d-0d7b-47e8-9b99-17a3c975cb6b admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:57:18.498766 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-2adbb57d-0d7b-47e8-9b99-17a3c975cb6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:18.703771 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adbb57d-0d7b-47e8-9b99-17a3c975cb6b admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:57:18.738062 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f50c425-4e8d-4c50-a656-67d951b05474 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6677b4518c094636bc8ed7b588103390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:57:18.740932 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50c425-4e8d-4c50-a656-67d951b05474 service glance] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:18.742708 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50c425-4e8d-4c50-a656-67d951b05474 service glance] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:18.744584 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50c425-4e8d-4c50-a656-67d951b05474 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:18.785003 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f50c425-4e8d-4c50-a656-67d951b05474 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:57:18.788351 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f50c425-4e8d-4c50-a656-67d951b05474 service glance] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:57:18.816965 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1207/2429] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:57:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:57:19.804422 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4ec9c-88fb-4ac1-8169-924cbf39310f None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:19.805243 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4ec9c-88fb-4ac1-8169-924cbf39310f None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:19.805746 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf4ec9c-88fb-4ac1-8169-924cbf39310f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:19.877817 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-aaf4ec9c-88fb-4ac1-8169-924cbf39310f None None] MFA Rules not processed for user `75cd9652625a4935a9af31bd4549ccf1`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:57:19.880310 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-aaf4ec9c-88fb-4ac1-8169-924cbf39310f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:20.128828 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1223/2430] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:57:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:57:21.274423 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa3725-5436-4f8f-a463-7cf0ce06f479 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:21.275304 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa3725-5436-4f8f-a463-7cf0ce06f479 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:21.275598 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa3725-5436-4f8f-a463-7cf0ce06f479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:21.321620 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-1aaa3725-5436-4f8f-a463-7cf0ce06f479 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:57:21.323800 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-1aaa3725-5436-4f8f-a463-7cf0ce06f479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:21.459590 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:21.477790 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1208/2431] 10.222.0.112 () {58 vars in 1017 bytes} [Thu Sep 8 13:57:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:57:21.955800 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4ec9c-88fb-4ac1-8169-924cbf39310f None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:57:21.958159 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-aaf4ec9c-88fb-4ac1-8169-924cbf39310f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:22.136784 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf4ec9c-88fb-4ac1-8169-924cbf39310f None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:57:22.162853 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269351b2-d502-4bd5-ba07-b79cf9f3d547 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:57:22.163613 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269351b2-d502-4bd5-ba07-b79cf9f3d547 service nova] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:22.164138 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269351b2-d502-4bd5-ba07-b79cf9f3d547 service nova] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:22.168238 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269351b2-d502-4bd5-ba07-b79cf9f3d547 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:22.194081 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269351b2-d502-4bd5-ba07-b79cf9f3d547 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:57:22.199746 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269351b2-d502-4bd5-ba07-b79cf9f3d547 service nova] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:57:22.214710 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1224/2432] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:57:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:57:28.188932 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10d8a5-b920-4644-b5b6-8536f2e22a4d None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:28.189831 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10d8a5-b920-4644-b5b6-8536f2e22a4d None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:28.189831 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10d8a5-b920-4644-b5b6-8536f2e22a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:28.222845 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-1a10d8a5-b920-4644-b5b6-8536f2e22a4d None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:57:28.226042 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-1a10d8a5-b920-4644-b5b6-8536f2e22a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:28.240956 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1209/2433] 10.222.0.112 () {58 vars in 1017 bytes} [Thu Sep 8 13:57:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:57:28.404220 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269351b2-d502-4bd5-ba07-b79cf9f3d547 service nova] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:57:28.406427 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-269351b2-d502-4bd5-ba07-b79cf9f3d547 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:28.433668 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269351b2-d502-4bd5-ba07-b79cf9f3d547 service nova] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:57:28.447404 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe956d-120e-4950-a6d7-321eaab068c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:57:28.451103 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe956d-120e-4950-a6d7-321eaab068c0 service nova] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:28.451103 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe956d-120e-4950-a6d7-321eaab068c0 service nova] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:28.451103 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe956d-120e-4950-a6d7-321eaab068c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:28.467353 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe956d-120e-4950-a6d7-321eaab068c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:57:28.470503 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe956d-120e-4950-a6d7-321eaab068c0 service nova] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:57:28.490029 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1225/2434] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:57:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:57:28.685289 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10d8a5-b920-4644-b5b6-8536f2e22a4d None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:57:28.687630 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-1a10d8a5-b920-4644-b5b6-8536f2e22a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:28.825495 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10d8a5-b920-4644-b5b6-8536f2e22a4d None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:57:28.832536 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9026a-9849-4295-a3d2-86393403aab3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:57:28.834413 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9026a-9849-4295-a3d2-86393403aab3 service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:28.834413 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9026a-9849-4295-a3d2-86393403aab3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:28.834852 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9026a-9849-4295-a3d2-86393403aab3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:28.853584 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-c4c9026a-9849-4295-a3d2-86393403aab3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:28.897055 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c9026a-9849-4295-a3d2-86393403aab3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:57:28.907061 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c9026a-9849-4295-a3d2-86393403aab3 service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:57:28.933631 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1210/2435] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:57:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:57:31.559768 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe956d-120e-4950-a6d7-321eaab068c0 service nova] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:57:31.600387 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe956d-120e-4950-a6d7-321eaab068c0 service nova] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:57:31.611294 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13269d4f-17d8-483a-a98c-bb802fd558a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:57:31.612413 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13269d4f-17d8-483a-a98c-bb802fd558a6 service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:31.612892 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13269d4f-17d8-483a-a98c-bb802fd558a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:31.613602 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13269d4f-17d8-483a-a98c-bb802fd558a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:31.616740 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-13269d4f-17d8-483a-a98c-bb802fd558a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:31.642750 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13269d4f-17d8-483a-a98c-bb802fd558a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:57:31.645493 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13269d4f-17d8-483a-a98c-bb802fd558a6 service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:57:31.670131 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1226/2436] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:57:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:57:32.319397 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20847788-1dd6-4333-a772-1ba4bdd95afb None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:32.319397 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20847788-1dd6-4333-a772-1ba4bdd95afb None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:32.319397 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20847788-1dd6-4333-a772-1ba4bdd95afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:32.373764 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-20847788-1dd6-4333-a772-1ba4bdd95afb None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:57:32.376290 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-20847788-1dd6-4333-a772-1ba4bdd95afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:32.394046 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1211/2437] 10.222.0.112 () {58 vars in 1017 bytes} [Thu Sep 8 13:57:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:57:32.466956 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13269d4f-17d8-483a-a98c-bb802fd558a6 service neutron] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:57:32.511099 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13269d4f-17d8-483a-a98c-bb802fd558a6 service neutron] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:57:32.540046 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd32355-677c-427b-b0e3-3ebc6b5bca20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:57:32.541089 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd32355-677c-427b-b0e3-3ebc6b5bca20 service nova] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:32.541869 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd32355-677c-427b-b0e3-3ebc6b5bca20 service nova] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:32.542374 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd32355-677c-427b-b0e3-3ebc6b5bca20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:32.575554 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd32355-677c-427b-b0e3-3ebc6b5bca20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:57:32.580493 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd32355-677c-427b-b0e3-3ebc6b5bca20 service nova] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:57:32.610017 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1227/2438] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:57:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:57:36.057258 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd010a-1cb0-44ec-b9bf-9e3f609e264b None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:36.058170 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd010a-1cb0-44ec-b9bf-9e3f609e264b None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:36.058170 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd010a-1cb0-44ec-b9bf-9e3f609e264b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:36.088119 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-8acd010a-1cb0-44ec-b9bf-9e3f609e264b None None] MFA Rules not processed for user `cb73a0582bdd46cfa2a350eff014bbc1`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:57:36.091069 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-8acd010a-1cb0-44ec-b9bf-9e3f609e264b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:36.243720 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1212/2439] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:57:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:57:36.656944 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888cc0ae-ff63-4889-ab61-a4527839cd27 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:36.657897 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888cc0ae-ff63-4889-ab61-a4527839cd27 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:36.657897 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888cc0ae-ff63-4889-ab61-a4527839cd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:36.686362 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-888cc0ae-ff63-4889-ab61-a4527839cd27 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:57:36.688263 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-888cc0ae-ff63-4889-ab61-a4527839cd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:36.704508 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1228/2440] 10.222.0.112 () {58 vars in 1017 bytes} [Thu Sep 8 13:57:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:57:36.741944 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd010a-1cb0-44ec-b9bf-9e3f609e264b None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:57:36.775417 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd010a-1cb0-44ec-b9bf-9e3f609e264b None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:57:36.786588 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae769d-87ee-4e52-a636-e0655ddb191e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:57:36.787247 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae769d-87ee-4e52-a636-e0655ddb191e service nova] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:36.787645 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae769d-87ee-4e52-a636-e0655ddb191e service nova] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:36.788038 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae769d-87ee-4e52-a636-e0655ddb191e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:36.799880 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ae769d-87ee-4e52-a636-e0655ddb191e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:57:36.801942 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ae769d-87ee-4e52-a636-e0655ddb191e service nova] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:57:36.818508 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1213/2441] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:57:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:57:40.674786 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888cc0ae-ff63-4889-ab61-a4527839cd27 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:57:40.692997 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888cc0ae-ff63-4889-ab61-a4527839cd27 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:57:40.700630 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca8167-6c80-4199-9935-c99d541d5d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:57:40.702398 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca8167-6c80-4199-9935-c99d541d5d47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:40.702824 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca8167-6c80-4199-9935-c99d541d5d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:40.703233 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca8167-6c80-4199-9935-c99d541d5d47 admin admin] PATH_INFO: `/v3/users/25956684bd674b008637f0a22b03aa6f` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:40.705563 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ca8167-6c80-4199-9935-c99d541d5d47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25956684bd674b008637f0a22b03aa6f)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:57:40.708846 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ca8167-6c80-4199-9935-c99d541d5d47 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:57:40.770061 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:40.803829 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-f4ca8167-6c80-4199-9935-c99d541d5d47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25956684bd674b008637f0a22b03aa6f'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:57:40.805203 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-f4ca8167-6c80-4199-9935-c99d541d5d47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25956684bd674b008637f0a22b03aa6f'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:57:40.806330 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-f4ca8167-6c80-4199-9935-c99d541d5d47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25956684bd674b008637f0a22b03aa6f'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:57:40.823411 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-f4ca8167-6c80-4199-9935-c99d541d5d47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25956684bd674b008637f0a22b03aa6f'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:57:40.843312 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-f4ca8167-6c80-4199-9935-c99d541d5d47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25956684bd674b008637f0a22b03aa6f'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:57:40.864517 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1229/2442] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:57:40 2022] DELETE /identity/v3/users/25956684bd674b008637f0a22b03aa6f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:57:40.870498 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0dec29-3ec8-432b-8bcc-2f9234c97af7 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:40.871472 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0dec29-3ec8-432b-8bcc-2f9234c97af7 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:40.872669 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0dec29-3ec8-432b-8bcc-2f9234c97af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:40.903462 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-af0dec29-3ec8-432b-8bcc-2f9234c97af7 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:57:40.906245 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-af0dec29-3ec8-432b-8bcc-2f9234c97af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:41.072941 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1214/2443] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:57:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:57:41.087803 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca8167-6c80-4199-9935-c99d541d5d47 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:57:41.090866 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-f4ca8167-6c80-4199-9935-c99d541d5d47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:41.129589 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461de34-5ca9-4de0-8522-fcb7a97132c6 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:41.130081 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461de34-5ca9-4de0-8522-fcb7a97132c6 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:41.130589 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461de34-5ca9-4de0-8522-fcb7a97132c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:41.168962 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-6461de34-5ca9-4de0-8522-fcb7a97132c6 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:57:41.171458 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-6461de34-5ca9-4de0-8522-fcb7a97132c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:41.189530 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1215/2444] 10.222.0.112 () {58 vars in 1017 bytes} [Thu Sep 8 13:57:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:57:41.224559 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6461de34-5ca9-4de0-8522-fcb7a97132c6 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:57:41.226431 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-6461de34-5ca9-4de0-8522-fcb7a97132c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:41.228628 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca8167-6c80-4199-9935-c99d541d5d47 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:57:41.237108 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74fedd-03da-46f7-a9cb-10022239daef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:57:41.238559 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74fedd-03da-46f7-a9cb-10022239daef service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:41.239183 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74fedd-03da-46f7-a9cb-10022239daef service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:41.239829 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74fedd-03da-46f7-a9cb-10022239daef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:41.259241 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:41.269343 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a74fedd-03da-46f7-a9cb-10022239daef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:57:41.273591 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a74fedd-03da-46f7-a9cb-10022239daef service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:57:41.297724 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1230/2445] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:57:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:57:41.375879 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6461de34-5ca9-4de0-8522-fcb7a97132c6 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:57:41.387717 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d13cf-7f5d-48b1-99a5-4b0f6d7965d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:57:41.388940 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d13cf-7f5d-48b1-99a5-4b0f6d7965d4 service nova] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:41.389401 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d13cf-7f5d-48b1-99a5-4b0f6d7965d4 service nova] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:41.389883 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d13cf-7f5d-48b1-99a5-4b0f6d7965d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:41.408444 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d13cf-7f5d-48b1-99a5-4b0f6d7965d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:57:41.411914 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d13cf-7f5d-48b1-99a5-4b0f6d7965d4 service nova] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:57:41.435215 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1216/2446] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:57:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:57:41.897926 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74fedd-03da-46f7-a9cb-10022239daef service neutron] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:57:41.900735 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-2a74fedd-03da-46f7-a9cb-10022239daef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:41.922227 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74fedd-03da-46f7-a9cb-10022239daef service neutron] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:57:41.932291 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9cc268-ed79-4c5d-b013-b1d52ed5aab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:57:41.933877 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9cc268-ed79-4c5d-b013-b1d52ed5aab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:41.934598 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9cc268-ed79-4c5d-b013-b1d52ed5aab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:41.935227 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9cc268-ed79-4c5d-b013-b1d52ed5aab7 admin admin] PATH_INFO: `/v3/projects/a91049dc331b4f3a9dda116b082cf7c4` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:41.937938 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9cc268-ed79-4c5d-b013-b1d52ed5aab7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a91049dc331b4f3a9dda116b082cf7c4)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:57:41.941829 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9cc268-ed79-4c5d-b013-b1d52ed5aab7 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:57:42.019266 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-5a9cc268-ed79-4c5d-b013-b1d52ed5aab7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a91049dc331b4f3a9dda116b082cf7c4', 'request_id': 'req-5a9cc268-ed79-4c5d-b013-b1d52ed5aab7'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:57:42.026746 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-5a9cc268-ed79-4c5d-b013-b1d52ed5aab7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a91049dc331b4f3a9dda116b082cf7c4', 'request_id': 'req-5a9cc268-ed79-4c5d-b013-b1d52ed5aab7'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:57:42.035768 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-5a9cc268-ed79-4c5d-b013-b1d52ed5aab7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a91049dc331b4f3a9dda116b082cf7c4', 'request_id': 'req-5a9cc268-ed79-4c5d-b013-b1d52ed5aab7'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:57:42.053113 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-5a9cc268-ed79-4c5d-b013-b1d52ed5aab7 admin admin] The token cache is being invalidate because project a91049dc331b4f3a9dda116b082cf7c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:57:42.053485 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-5a9cc268-ed79-4c5d-b013-b1d52ed5aab7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:57:42.054120 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-5a9cc268-ed79-4c5d-b013-b1d52ed5aab7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:57:42.055674 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1231/2447] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:57:41 2022] DELETE /identity/v3/projects/a91049dc331b4f3a9dda116b082cf7c4 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:57:42.060881 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0c78b-69cf-4150-bce3-c83790f51562 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:42.061464 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0c78b-69cf-4150-bce3-c83790f51562 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:42.061464 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0c78b-69cf-4150-bce3-c83790f51562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:42.099517 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-7bf0c78b-69cf-4150-bce3-c83790f51562 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:57:42.101932 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-7bf0c78b-69cf-4150-bce3-c83790f51562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:42.236457 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6d392-758c-4e21-8eab-9830a2101279 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:42.236946 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6d392-758c-4e21-8eab-9830a2101279 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:42.237603 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f6d392-758c-4e21-8eab-9830a2101279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:42.238086 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1217/2448] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:57:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:57:42.278536 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-d3f6d392-758c-4e21-8eab-9830a2101279 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:57:42.281954 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-d3f6d392-758c-4e21-8eab-9830a2101279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:42.299743 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1232/2449] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:57:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:57:42.306696 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf0c78b-69cf-4150-bce3-c83790f51562 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:57:42.326908 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf0c78b-69cf-4150-bce3-c83790f51562 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:57:42.339892 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d9f18-c89e-40f0-8fbb-30b44eaee782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:57:42.341608 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d9f18-c89e-40f0-8fbb-30b44eaee782 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:42.342341 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d9f18-c89e-40f0-8fbb-30b44eaee782 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:42.343175 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d9f18-c89e-40f0-8fbb-30b44eaee782 admin admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:42.344366 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7d9f18-c89e-40f0-8fbb-30b44eaee782 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:57:42.344813 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7d9f18-c89e-40f0-8fbb-30b44eaee782 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:57:42.347697 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7d9f18-c89e-40f0-8fbb-30b44eaee782 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:57:42.381505 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1218/2450] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 13:57:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:57:42.387532 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f6d392-758c-4e21-8eab-9830a2101279 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:57:42.402604 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f6d392-758c-4e21-8eab-9830a2101279 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:57:42.410033 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2064491-fbe3-4028-b713-a9b97dc90dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:57:42.411287 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2064491-fbe3-4028-b713-a9b97dc90dad admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:42.411718 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2064491-fbe3-4028-b713-a9b97dc90dad admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:42.412082 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2064491-fbe3-4028-b713-a9b97dc90dad admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:42.412852 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2064491-fbe3-4028-b713-a9b97dc90dad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:57:42.415024 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2064491-fbe3-4028-b713-a9b97dc90dad admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:57:42.451770 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:42.471136 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1233/2451] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:57:42 2022] POST /identity/v3/projects => generated 375 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:57:42.472380 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d9f18-c89e-40f0-8fbb-30b44eaee782 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:57:42.487863 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d9f18-c89e-40f0-8fbb-30b44eaee782 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:57:42.571837 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2c41f-882f-4b96-8544-0b298f0e6733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:57:42.571837 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2c41f-882f-4b96-8544-0b298f0e6733 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:42.571837 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2c41f-882f-4b96-8544-0b298f0e6733 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:42.571837 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2c41f-882f-4b96-8544-0b298f0e6733 admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:42.572534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e2c41f-882f-4b96-8544-0b298f0e6733 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:57:42.572534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e2c41f-882f-4b96-8544-0b298f0e6733 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:57:42.601462 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1219/2452] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:57:42 2022] POST /identity/v3/users => generated 288 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:57:42.607676 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2064491-fbe3-4028-b713-a9b97dc90dad admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:57:42.622968 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2064491-fbe3-4028-b713-a9b97dc90dad admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:57:42.631022 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72334376-4728-4bc0-a095-cb46833510fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:57:42.631994 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72334376-4728-4bc0-a095-cb46833510fd admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:42.632470 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72334376-4728-4bc0-a095-cb46833510fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:42.632935 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72334376-4728-4bc0-a095-cb46833510fd admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:42.634288 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72334376-4728-4bc0-a095-cb46833510fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:57:42.637317 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72334376-4728-4bc0-a095-cb46833510fd admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:57:42.656488 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1234/2453] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:57:42.661907 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2c41f-882f-4b96-8544-0b298f0e6733 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:57:42.683366 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2c41f-882f-4b96-8544-0b298f0e6733 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:57:42.697436 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88146ec-0a7a-484f-9c53-232cf005db8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:57:42.697436 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88146ec-0a7a-484f-9c53-232cf005db8d admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:42.698205 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88146ec-0a7a-484f-9c53-232cf005db8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:42.701250 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88146ec-0a7a-484f-9c53-232cf005db8d admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:42.701250 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88146ec-0a7a-484f-9c53-232cf005db8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:57:42.702122 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88146ec-0a7a-484f-9c53-232cf005db8d admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:57:42.731614 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1220/2454] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:57:42.734257 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72334376-4728-4bc0-a095-cb46833510fd admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:57:42.753177 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72334376-4728-4bc0-a095-cb46833510fd admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:57:42.761045 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07267b77-48e6-4920-8a9b-afe7f1d7b656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:57:42.762226 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07267b77-48e6-4920-8a9b-afe7f1d7b656 admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:42.762668 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07267b77-48e6-4920-8a9b-afe7f1d7b656 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:42.763123 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07267b77-48e6-4920-8a9b-afe7f1d7b656 admin admin] PATH_INFO: `/v3/projects/ff656795b29049ecbff139ceadb1d6d5/users/5dde5157f255408ea21ca7320840fffb/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:42.784960 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07267b77-48e6-4920-8a9b-afe7f1d7b656 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff656795b29049ecbff139ceadb1d6d5, user_id=5dde5157f255408ea21ca7320840fffb, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:57:42.789879 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07267b77-48e6-4920-8a9b-afe7f1d7b656 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:57:42.817799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1235/2455] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:57:42 2022] PUT /identity/v3/projects/ff656795b29049ecbff139ceadb1d6d5/users/5dde5157f255408ea21ca7320840fffb/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:57:42.833271 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8e897-88a9-43f3-839d-17020111826f None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:42.833679 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8e897-88a9-43f3-839d-17020111826f None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:42.833962 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be8e897-88a9-43f3-839d-17020111826f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:42.851880 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:42.876896 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-9be8e897-88a9-43f3-839d-17020111826f None None] MFA Rules not processed for user `5dde5157f255408ea21ca7320840fffb`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:57:42.878782 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-9be8e897-88a9-43f3-839d-17020111826f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:43.011485 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1221/2456] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:57:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:57:43.031570 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07267b77-48e6-4920-8a9b-afe7f1d7b656 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:57:43.034533 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-07267b77-48e6-4920-8a9b-afe7f1d7b656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:43.164764 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07267b77-48e6-4920-8a9b-afe7f1d7b656 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:57:43.178820 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350ee44-b04b-47f3-9168-cb5398012438 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:57:43.179861 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350ee44-b04b-47f3-9168-cb5398012438 service cinder] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:43.180337 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350ee44-b04b-47f3-9168-cb5398012438 service cinder] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:43.180783 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e350ee44-b04b-47f3-9168-cb5398012438 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:43.195250 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350ee44-b04b-47f3-9168-cb5398012438 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:57:43.198239 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e350ee44-b04b-47f3-9168-cb5398012438 service cinder] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:57:43.223613 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1236/2457] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:57:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:57:45.119780 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c020df-3794-4aa5-87af-ed296e85d157 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:45.121410 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c020df-3794-4aa5-87af-ed296e85d157 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:45.121940 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c020df-3794-4aa5-87af-ed296e85d157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:45.158707 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-b8c020df-3794-4aa5-87af-ed296e85d157 None None] MFA Rules not processed for user `5dde5157f255408ea21ca7320840fffb`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:57:45.160995 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-b8c020df-3794-4aa5-87af-ed296e85d157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:45.174334 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1222/2458] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:57:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:57:53.214127 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=41,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:55.149029 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=32 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:57.224741 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350ee44-b04b-47f3-9168-cb5398012438 service cinder] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:57:57.227120 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-e350ee44-b04b-47f3-9168-cb5398012438 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:57.400164 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e350ee44-b04b-47f3-9168-cb5398012438 service cinder] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:57:57.408535 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0068d7-3b79-4b99-9a09-2343ca45204c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:57:57.409880 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0068d7-3b79-4b99-9a09-2343ca45204c service nova] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:57:57.410576 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0068d7-3b79-4b99-9a09-2343ca45204c service nova] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:57:57.411030 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0068d7-3b79-4b99-9a09-2343ca45204c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:57:57.413824 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-ed0068d7-3b79-4b99-9a09-2343ca45204c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:57:57.528365 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0068d7-3b79-4b99-9a09-2343ca45204c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:57:57.531519 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0068d7-3b79-4b99-9a09-2343ca45204c service nova] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:57:57.550735 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1237/2459] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:57:57 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:58:01.868357 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d5bfe-ead1-4e94-9cfc-f77902c184cf None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:01.869228 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d5bfe-ead1-4e94-9cfc-f77902c184cf None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:01.869420 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d5bfe-ead1-4e94-9cfc-f77902c184cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:01.909712 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-dd0d5bfe-ead1-4e94-9cfc-f77902c184cf None None] MFA Rules not processed for user `5eb6e03e874d4b28aaf21c5b36f7bb98`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:58:01.913353 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-dd0d5bfe-ead1-4e94-9cfc-f77902c184cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:01.933412 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1223/2460] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:58:01 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:58:04.730687 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0068d7-3b79-4b99-9a09-2343ca45204c service nova] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:58:04.733063 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-ed0068d7-3b79-4b99-9a09-2343ca45204c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:04.854741 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0068d7-3b79-4b99-9a09-2343ca45204c service nova] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:58:04.864594 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc08ca0-bce4-4502-83a3-7ad1d1669ea8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:58:04.865799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc08ca0-bce4-4502-83a3-7ad1d1669ea8 service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:04.870606 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc08ca0-bce4-4502-83a3-7ad1d1669ea8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:04.871091 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc08ca0-bce4-4502-83a3-7ad1d1669ea8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:04.874097 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-acc08ca0-bce4-4502-83a3-7ad1d1669ea8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:04.961918 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:04.982514 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc08ca0-bce4-4502-83a3-7ad1d1669ea8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:58:04.984110 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc08ca0-bce4-4502-83a3-7ad1d1669ea8 service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:58:04.998158 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1238/2461] 10.222.0.69 () {60 vars in 1396 bytes} [Thu Sep 8 13:58:04 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3264 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:58:11.892889 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=3 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:12.946893 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d5bfe-ead1-4e94-9cfc-f77902c184cf None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:58:13.077354 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d5bfe-ead1-4e94-9cfc-f77902c184cf None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:58:13.089545 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6452d394-f646-4685-bd2a-7f67c71a7aca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:58:13.091681 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452d394-f646-4685-bd2a-7f67c71a7aca service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:13.092042 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452d394-f646-4685-bd2a-7f67c71a7aca service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:13.092987 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452d394-f646-4685-bd2a-7f67c71a7aca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:13.097132 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-6452d394-f646-4685-bd2a-7f67c71a7aca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:13.193352 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6452d394-f646-4685-bd2a-7f67c71a7aca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:58:13.199423 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6452d394-f646-4685-bd2a-7f67c71a7aca service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:58:13.228867 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1224/2462] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:58:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:58:14.991008 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=4 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:20.638210 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bad1cc-368d-4ee8-909c-0fc104464e61 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:20.639975 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bad1cc-368d-4ee8-909c-0fc104464e61 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:20.648993 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bad1cc-368d-4ee8-909c-0fc104464e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:20.696224 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-19bad1cc-368d-4ee8-909c-0fc104464e61 None None] MFA Rules not processed for user `c38575a2f7bc408f8b5eb58ad513c078`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:58:20.699582 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-19bad1cc-368d-4ee8-909c-0fc104464e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:20.737067 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1239/2463] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:58:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:58:21.629301 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6452d394-f646-4685-bd2a-7f67c71a7aca service neutron] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:58:21.651398 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6452d394-f646-4685-bd2a-7f67c71a7aca service neutron] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:58:21.669214 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b8658-39ab-4e49-996b-b4a5e7d7c480 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:58:21.670623 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b8658-39ab-4e49-996b-b4a5e7d7c480 service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:21.671301 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b8658-39ab-4e49-996b-b4a5e7d7c480 service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:21.671986 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b8658-39ab-4e49-996b-b4a5e7d7c480 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:21.677897 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-076b8658-39ab-4e49-996b-b4a5e7d7c480 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:21.724187 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b8658-39ab-4e49-996b-b4a5e7d7c480 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:58:21.727271 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b8658-39ab-4e49-996b-b4a5e7d7c480 service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:58:21.754409 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1225/2464] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:58:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:58:22.409897 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bad1cc-368d-4ee8-909c-0fc104464e61 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:58:22.412426 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-19bad1cc-368d-4ee8-909c-0fc104464e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:22.582654 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bad1cc-368d-4ee8-909c-0fc104464e61 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:58:22.593416 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90c637-8b6c-4d13-a5b6-98ffdfd81446 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733797f12a1741e1a55332991e867aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:58:22.593416 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90c637-8b6c-4d13-a5b6-98ffdfd81446 service placement] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:22.593416 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90c637-8b6c-4d13-a5b6-98ffdfd81446 service placement] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:22.594011 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90c637-8b6c-4d13-a5b6-98ffdfd81446 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:22.597889 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-fe90c637-8b6c-4d13-a5b6-98ffdfd81446 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:22.630514 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe90c637-8b6c-4d13-a5b6-98ffdfd81446 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:58:22.640851 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe90c637-8b6c-4d13-a5b6-98ffdfd81446 service placement] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:58:22.690716 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1240/2465] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:58:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:58:22.755028 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f7ac6-1b20-4d00-80a5-9a96dfd37bbe None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:22.756695 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f7ac6-1b20-4d00-80a5-9a96dfd37bbe None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:22.756695 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f7ac6-1b20-4d00-80a5-9a96dfd37bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:22.814757 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-f76f7ac6-1b20-4d00-80a5-9a96dfd37bbe None None] MFA Rules not processed for user `6d2dd101d1a14e5ab95f272ab1bbeb94`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:58:22.816934 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-f76f7ac6-1b20-4d00-80a5-9a96dfd37bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:23.005886 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1226/2466] 10.222.0.69 () {58 vars in 1009 bytes} [Thu Sep 8 13:58:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:58:23.101788 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90c637-8b6c-4d13-a5b6-98ffdfd81446 service placement] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:58:23.104207 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-fe90c637-8b6c-4d13-a5b6-98ffdfd81446 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:23.310682 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90c637-8b6c-4d13-a5b6-98ffdfd81446 service placement] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:58:23.321036 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf4755c-dd59-4d3f-88b6-6efaaa40af84 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9b97592a6840c3865d7dcf886221e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:58:23.322344 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4755c-dd59-4d3f-88b6-6efaaa40af84 service swift] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:23.322749 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4755c-dd59-4d3f-88b6-6efaaa40af84 service swift] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:23.323310 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4755c-dd59-4d3f-88b6-6efaaa40af84 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:23.340316 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf4755c-dd59-4d3f-88b6-6efaaa40af84 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:58:23.343792 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf4755c-dd59-4d3f-88b6-6efaaa40af84 service swift] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:58:23.366670 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1241/2467] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Sep 8 13:58:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 13:58:28.672575 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f7ac6-1b20-4d00-80a5-9a96dfd37bbe None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:58:28.674967 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-f76f7ac6-1b20-4d00-80a5-9a96dfd37bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:29.140575 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:29.163647 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f7ac6-1b20-4d00-80a5-9a96dfd37bbe None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:58:29.179760 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e9967-c029-4cb9-b56c-f55335e520d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:58:29.181041 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e9967-c029-4cb9-b56c-f55335e520d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:29.181775 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e9967-c029-4cb9-b56c-f55335e520d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:29.182282 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e9967-c029-4cb9-b56c-f55335e520d8 admin admin] PATH_INFO: `/v3/users/cfe716e6e4fe4b82bcecd0e701e8a012` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:29.184667 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804e9967-c029-4cb9-b56c-f55335e520d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfe716e6e4fe4b82bcecd0e701e8a012)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:58:29.188584 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804e9967-c029-4cb9-b56c-f55335e520d8 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:58:29.383947 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-804e9967-c029-4cb9-b56c-f55335e520d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfe716e6e4fe4b82bcecd0e701e8a012'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:58:29.385565 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-804e9967-c029-4cb9-b56c-f55335e520d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfe716e6e4fe4b82bcecd0e701e8a012'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:58:29.423670 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-804e9967-c029-4cb9-b56c-f55335e520d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfe716e6e4fe4b82bcecd0e701e8a012'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:58:29.478949 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-804e9967-c029-4cb9-b56c-f55335e520d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfe716e6e4fe4b82bcecd0e701e8a012'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:58:29.481149 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-804e9967-c029-4cb9-b56c-f55335e520d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfe716e6e4fe4b82bcecd0e701e8a012'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:58:29.525707 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1227/2468] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:58:28 2022] DELETE /identity/v3/users/cfe716e6e4fe4b82bcecd0e701e8a012 => generated 0 bytes in 854 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:58:29.734044 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf4755c-dd59-4d3f-88b6-6efaaa40af84 service swift] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:58:29.746157 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-acf4755c-dd59-4d3f-88b6-6efaaa40af84 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:29.813213 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf4755c-dd59-4d3f-88b6-6efaaa40af84 service swift] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:58:30.002856 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:30.078851 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a105fe0-f564-4d3e-b6f8-21caff8384f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:58:30.082622 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a105fe0-f564-4d3e-b6f8-21caff8384f5 service nova] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:30.083332 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a105fe0-f564-4d3e-b6f8-21caff8384f5 service nova] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:30.083815 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a105fe0-f564-4d3e-b6f8-21caff8384f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:30.089594 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-2a105fe0-f564-4d3e-b6f8-21caff8384f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:30.123234 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a105fe0-f564-4d3e-b6f8-21caff8384f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:58:30.127428 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a105fe0-f564-4d3e-b6f8-21caff8384f5 service nova] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:58:30.162430 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1242/2469] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:58:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:58:31.363816 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e9967-c029-4cb9-b56c-f55335e520d8 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:58:31.367019 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-804e9967-c029-4cb9-b56c-f55335e520d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:31.664363 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e9967-c029-4cb9-b56c-f55335e520d8 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:58:31.691471 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e483696-30b6-433f-8190-69b3abb65b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:58:31.704453 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e483696-30b6-433f-8190-69b3abb65b76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:31.705520 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e483696-30b6-433f-8190-69b3abb65b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:31.706339 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e483696-30b6-433f-8190-69b3abb65b76 admin admin] PATH_INFO: `/v3/projects/cc8a5f7d4d3346afada6c8e4e5c88a43` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:31.708961 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e483696-30b6-433f-8190-69b3abb65b76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc8a5f7d4d3346afada6c8e4e5c88a43)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:58:31.719260 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e483696-30b6-433f-8190-69b3abb65b76 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:58:31.904168 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-6e483696-30b6-433f-8190-69b3abb65b76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc8a5f7d4d3346afada6c8e4e5c88a43', 'request_id': 'req-6e483696-30b6-433f-8190-69b3abb65b76'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:58:31.933514 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-6e483696-30b6-433f-8190-69b3abb65b76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc8a5f7d4d3346afada6c8e4e5c88a43', 'request_id': 'req-6e483696-30b6-433f-8190-69b3abb65b76'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:58:31.973211 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-6e483696-30b6-433f-8190-69b3abb65b76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc8a5f7d4d3346afada6c8e4e5c88a43', 'request_id': 'req-6e483696-30b6-433f-8190-69b3abb65b76'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:58:32.022356 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-6e483696-30b6-433f-8190-69b3abb65b76 admin admin] The token cache is being invalidate because project cc8a5f7d4d3346afada6c8e4e5c88a43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:58:32.024071 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-6e483696-30b6-433f-8190-69b3abb65b76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:58:32.025722 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-6e483696-30b6-433f-8190-69b3abb65b76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:58:32.030624 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1228/2470] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:58:31 2022] DELETE /identity/v3/projects/cc8a5f7d4d3346afada6c8e4e5c88a43 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:58:34.093312 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a105fe0-f564-4d3e-b6f8-21caff8384f5 service nova] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:58:34.098916 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-2a105fe0-f564-4d3e-b6f8-21caff8384f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:34.156667 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a105fe0-f564-4d3e-b6f8-21caff8384f5 service nova] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:58:34.489097 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecbff7e-d61c-49e6-98ee-901e9c5ec5f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:58:34.490267 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbff7e-d61c-49e6-98ee-901e9c5ec5f2 service nova] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:34.490770 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbff7e-d61c-49e6-98ee-901e9c5ec5f2 service nova] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:34.491257 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbff7e-d61c-49e6-98ee-901e9c5ec5f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:34.502840 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-8ecbff7e-d61c-49e6-98ee-901e9c5ec5f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:34.544563 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecbff7e-d61c-49e6-98ee-901e9c5ec5f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:58:34.549568 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecbff7e-d61c-49e6-98ee-901e9c5ec5f2 service nova] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:58:34.590797 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1243/2471] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:58:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:58:36.748759 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b502930-a7ab-4b7d-b0d5-4c713066ade4 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:36.750346 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b502930-a7ab-4b7d-b0d5-4c713066ade4 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:36.752405 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b502930-a7ab-4b7d-b0d5-4c713066ade4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:36.784094 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:36.828430 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-0b502930-a7ab-4b7d-b0d5-4c713066ade4 None None] MFA Rules not processed for user `6d2dd101d1a14e5ab95f272ab1bbeb94`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:58:36.829542 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-0b502930-a7ab-4b7d-b0d5-4c713066ade4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:36.994096 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1229/2472] 10.222.0.69 () {58 vars in 1009 bytes} [Thu Sep 8 13:58:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:58:37.022217 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecbff7e-d61c-49e6-98ee-901e9c5ec5f2 service nova] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:58:37.026538 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-8ecbff7e-d61c-49e6-98ee-901e9c5ec5f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:37.354782 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecbff7e-d61c-49e6-98ee-901e9c5ec5f2 service nova] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:58:37.363605 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86d708-9407-4c69-9bf4-b0395882635e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9b97592a6840c3865d7dcf886221e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:58:37.365857 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86d708-9407-4c69-9bf4-b0395882635e service swift] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:37.365857 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86d708-9407-4c69-9bf4-b0395882635e service swift] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:37.366203 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86d708-9407-4c69-9bf4-b0395882635e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:37.384677 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a86d708-9407-4c69-9bf4-b0395882635e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:58:37.387892 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a86d708-9407-4c69-9bf4-b0395882635e service swift] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:58:37.406561 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1244/2473] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Sep 8 13:58:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 13:58:38.999499 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab538c-772a-4fd8-9e5d-05c3b24bbe4d None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:39.000348 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab538c-772a-4fd8-9e5d-05c3b24bbe4d None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:39.000764 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab538c-772a-4fd8-9e5d-05c3b24bbe4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:39.063450 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-c5ab538c-772a-4fd8-9e5d-05c3b24bbe4d None None] MFA Rules not processed for user `6d2dd101d1a14e5ab95f272ab1bbeb94`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:58:39.066382 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-c5ab538c-772a-4fd8-9e5d-05c3b24bbe4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:39.091662 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1230/2474] 10.222.0.69 () {58 vars in 967 bytes} [Thu Sep 8 13:58:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:58:39.124532 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86d708-9407-4c69-9bf4-b0395882635e service swift] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:58:39.150320 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86d708-9407-4c69-9bf4-b0395882635e service swift] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:58:39.161907 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6615286-cdd6-436b-9e03-843943defad7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9b97592a6840c3865d7dcf886221e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:58:39.163599 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6615286-cdd6-436b-9e03-843943defad7 service swift] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:39.164522 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6615286-cdd6-436b-9e03-843943defad7 service swift] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:39.165342 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6615286-cdd6-436b-9e03-843943defad7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:39.194214 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6615286-cdd6-436b-9e03-843943defad7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:58:39.199887 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6615286-cdd6-436b-9e03-843943defad7 service swift] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:58:39.231562 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1245/2475] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Sep 8 13:58:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 13:58:39.712027 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f66e5-ead1-40aa-8075-dd77d5af592d None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:39.712482 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f66e5-ead1-40aa-8075-dd77d5af592d None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:39.712939 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f66e5-ead1-40aa-8075-dd77d5af592d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:39.763766 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-432f66e5-ead1-40aa-8075-dd77d5af592d None None] MFA Rules not processed for user `6d2dd101d1a14e5ab95f272ab1bbeb94`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:58:39.766434 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-432f66e5-ead1-40aa-8075-dd77d5af592d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:39.782217 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1231/2476] 10.222.0.69 () {58 vars in 1009 bytes} [Thu Sep 8 13:58:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:58:39.820266 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6615286-cdd6-436b-9e03-843943defad7 service swift] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:58:39.843018 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6615286-cdd6-436b-9e03-843943defad7 service swift] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:58:39.852420 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3a02f-4765-4e48-936b-3405903f9f4f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9b97592a6840c3865d7dcf886221e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:58:39.853899 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3a02f-4765-4e48-936b-3405903f9f4f service swift] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:39.854965 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3a02f-4765-4e48-936b-3405903f9f4f service swift] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:39.855693 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3a02f-4765-4e48-936b-3405903f9f4f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:39.884495 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb3a02f-4765-4e48-936b-3405903f9f4f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:58:39.887075 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb3a02f-4765-4e48-936b-3405903f9f4f service swift] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:58:39.915273 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1246/2477] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Sep 8 13:58:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 13:58:40.899713 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc2a9e-f141-41f4-a0ed-793c81663e0e None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:40.901615 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc2a9e-f141-41f4-a0ed-793c81663e0e None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:40.902443 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc2a9e-f141-41f4-a0ed-793c81663e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:40.933066 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-4cbc2a9e-f141-41f4-a0ed-793c81663e0e None None] MFA Rules not processed for user `6d2dd101d1a14e5ab95f272ab1bbeb94`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:58:40.935475 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-4cbc2a9e-f141-41f4-a0ed-793c81663e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:40.957858 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1232/2478] 10.222.0.69 () {58 vars in 967 bytes} [Thu Sep 8 13:58:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:58:41.005716 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3a02f-4765-4e48-936b-3405903f9f4f service swift] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:58:41.045801 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3a02f-4765-4e48-936b-3405903f9f4f service swift] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:58:41.061197 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eedc5e-c49a-4fbc-820f-6999944253bc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9b97592a6840c3865d7dcf886221e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:58:41.062758 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eedc5e-c49a-4fbc-820f-6999944253bc service swift] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:41.063602 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eedc5e-c49a-4fbc-820f-6999944253bc service swift] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:41.064299 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eedc5e-c49a-4fbc-820f-6999944253bc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:41.095203 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eedc5e-c49a-4fbc-820f-6999944253bc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:58:41.099835 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eedc5e-c49a-4fbc-820f-6999944253bc service swift] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:58:41.127681 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1247/2479] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Sep 8 13:58:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 13:58:43.970872 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc2a9e-f141-41f4-a0ed-793c81663e0e None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:58:43.973996 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-4cbc2a9e-f141-41f4-a0ed-793c81663e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:44.042038 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc2a9e-f141-41f4-a0ed-793c81663e0e None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:58:44.069686 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449f8b2-4572-410a-9601-fb7e7ff4f09e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:58:44.071203 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449f8b2-4572-410a-9601-fb7e7ff4f09e service nova] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:44.071992 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449f8b2-4572-410a-9601-fb7e7ff4f09e service nova] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:44.073305 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449f8b2-4572-410a-9601-fb7e7ff4f09e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:44.085942 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-a449f8b2-4572-410a-9601-fb7e7ff4f09e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:44.113184 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449f8b2-4572-410a-9601-fb7e7ff4f09e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:58:44.116034 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449f8b2-4572-410a-9601-fb7e7ff4f09e service nova] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:58:44.152688 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1233/2480] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:58:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:58:44.211708 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eedc5e-c49a-4fbc-820f-6999944253bc service swift] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:58:44.215869 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-26eedc5e-c49a-4fbc-820f-6999944253bc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:44.279307 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eedc5e-c49a-4fbc-820f-6999944253bc service swift] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:58:44.315265 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b048d1-8962-4464-b93e-65c9fe655460 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:58:44.320036 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b048d1-8962-4464-b93e-65c9fe655460 service nova] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:44.323605 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b048d1-8962-4464-b93e-65c9fe655460 service nova] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:44.325356 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b048d1-8962-4464-b93e-65c9fe655460 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:44.330230 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-89b048d1-8962-4464-b93e-65c9fe655460 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:44.394241 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=100 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:44.674249 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b048d1-8962-4464-b93e-65c9fe655460 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:58:44.678221 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b048d1-8962-4464-b93e-65c9fe655460 service nova] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:58:44.716015 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1248/2481] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:58:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:58:45.417873 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60fe93-5006-44d9-a323-e1fc82ae6a61 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:45.418976 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60fe93-5006-44d9-a323-e1fc82ae6a61 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:45.418976 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60fe93-5006-44d9-a323-e1fc82ae6a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:45.504267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-dd60fe93-5006-44d9-a323-e1fc82ae6a61 None None] MFA Rules not processed for user `6d2dd101d1a14e5ab95f272ab1bbeb94`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:58:45.507728 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-dd60fe93-5006-44d9-a323-e1fc82ae6a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:45.528000 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1234/2482] 10.222.0.69 () {58 vars in 967 bytes} [Thu Sep 8 13:58:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:58:45.571032 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b048d1-8962-4464-b93e-65c9fe655460 service nova] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:58:45.633042 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b048d1-8962-4464-b93e-65c9fe655460 service nova] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:58:45.634478 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60fe93-5006-44d9-a323-e1fc82ae6a61 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:58:45.638288 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-dd60fe93-5006-44d9-a323-e1fc82ae6a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:45.670156 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e9580-40cd-4864-8f66-2de5e146e17f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9b97592a6840c3865d7dcf886221e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:58:45.672039 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e9580-40cd-4864-8f66-2de5e146e17f service swift] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:45.672871 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e9580-40cd-4864-8f66-2de5e146e17f service swift] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:45.673740 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e9580-40cd-4864-8f66-2de5e146e17f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:45.711740 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17e9580-40cd-4864-8f66-2de5e146e17f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:58:45.718276 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17e9580-40cd-4864-8f66-2de5e146e17f service swift] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:58:45.776461 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1249/2483] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Sep 8 13:58:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 13:58:46.024229 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60fe93-5006-44d9-a323-e1fc82ae6a61 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:58:46.039940 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6abeb-c0cf-498d-b619-26342b8cd371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:58:46.039940 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6abeb-c0cf-498d-b619-26342b8cd371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:46.040585 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6abeb-c0cf-498d-b619-26342b8cd371 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:46.040747 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6abeb-c0cf-498d-b619-26342b8cd371 admin admin] PATH_INFO: `/v3/users/5dde5157f255408ea21ca7320840fffb` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:46.044077 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d6abeb-c0cf-498d-b619-26342b8cd371 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dde5157f255408ea21ca7320840fffb)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:58:46.047849 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d6abeb-c0cf-498d-b619-26342b8cd371 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:58:46.225859 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-74d6abeb-c0cf-498d-b619-26342b8cd371 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dde5157f255408ea21ca7320840fffb'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:58:46.229771 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-74d6abeb-c0cf-498d-b619-26342b8cd371 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dde5157f255408ea21ca7320840fffb'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:58:46.245172 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-74d6abeb-c0cf-498d-b619-26342b8cd371 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dde5157f255408ea21ca7320840fffb'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:58:46.267155 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:46.271824 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-74d6abeb-c0cf-498d-b619-26342b8cd371 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dde5157f255408ea21ca7320840fffb'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:58:46.274022 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-74d6abeb-c0cf-498d-b619-26342b8cd371 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dde5157f255408ea21ca7320840fffb'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:58:46.313165 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1235/2484] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:58:45 2022] DELETE /identity/v3/users/5dde5157f255408ea21ca7320840fffb => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:58:46.320260 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ac199-3a8a-48be-9199-26baa159c506 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:46.320813 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ac199-3a8a-48be-9199-26baa159c506 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:46.320970 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436ac199-3a8a-48be-9199-26baa159c506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:46.403550 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-436ac199-3a8a-48be-9199-26baa159c506 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:58:46.406020 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-436ac199-3a8a-48be-9199-26baa159c506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:46.631563 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1250/2485] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:58:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:58:46.633629 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6abeb-c0cf-498d-b619-26342b8cd371 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:58:46.637858 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-74d6abeb-c0cf-498d-b619-26342b8cd371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:46.818042 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6abeb-c0cf-498d-b619-26342b8cd371 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:58:46.839913 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0fe37e-af76-40cb-a5de-0052cd40bd41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:58:46.841455 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fe37e-af76-40cb-a5de-0052cd40bd41 service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:46.841912 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fe37e-af76-40cb-a5de-0052cd40bd41 service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:46.842910 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fe37e-af76-40cb-a5de-0052cd40bd41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:46.921518 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0fe37e-af76-40cb-a5de-0052cd40bd41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:58:46.923891 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0fe37e-af76-40cb-a5de-0052cd40bd41 service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:58:46.953426 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1236/2486] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:58:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:58:48.120256 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ac199-3a8a-48be-9199-26baa159c506 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:58:48.122702 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-436ac199-3a8a-48be-9199-26baa159c506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:48.152776 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436ac199-3a8a-48be-9199-26baa159c506 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:58:48.163827 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904611a0-7ad4-446e-9247-b5e08104eeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:58:48.165580 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904611a0-7ad4-446e-9247-b5e08104eeae admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:48.166627 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904611a0-7ad4-446e-9247-b5e08104eeae admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:48.167786 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904611a0-7ad4-446e-9247-b5e08104eeae admin admin] PATH_INFO: `/v3/projects/ff656795b29049ecbff139ceadb1d6d5` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:48.171768 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904611a0-7ad4-446e-9247-b5e08104eeae admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff656795b29049ecbff139ceadb1d6d5)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:58:48.180081 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904611a0-7ad4-446e-9247-b5e08104eeae admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:58:48.353696 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-904611a0-7ad4-446e-9247-b5e08104eeae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff656795b29049ecbff139ceadb1d6d5', 'request_id': 'req-904611a0-7ad4-446e-9247-b5e08104eeae'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:58:48.374978 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-904611a0-7ad4-446e-9247-b5e08104eeae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff656795b29049ecbff139ceadb1d6d5', 'request_id': 'req-904611a0-7ad4-446e-9247-b5e08104eeae'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:58:48.402111 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-904611a0-7ad4-446e-9247-b5e08104eeae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff656795b29049ecbff139ceadb1d6d5', 'request_id': 'req-904611a0-7ad4-446e-9247-b5e08104eeae'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:58:48.470854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-904611a0-7ad4-446e-9247-b5e08104eeae admin admin] The token cache is being invalidate because project ff656795b29049ecbff139ceadb1d6d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:58:48.473303 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-904611a0-7ad4-446e-9247-b5e08104eeae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:58:48.475603 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-904611a0-7ad4-446e-9247-b5e08104eeae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:58:48.488441 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1251/2487] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:58:48 2022] DELETE /identity/v3/projects/ff656795b29049ecbff139ceadb1d6d5 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:58:48.502202 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac79cbd-2d06-46a6-97f2-ddce3c77cf47 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:48.504031 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac79cbd-2d06-46a6-97f2-ddce3c77cf47 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:48.504906 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac79cbd-2d06-46a6-97f2-ddce3c77cf47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:48.688958 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-8ac79cbd-2d06-46a6-97f2-ddce3c77cf47 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:58:48.691648 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-8ac79cbd-2d06-46a6-97f2-ddce3c77cf47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:48.850356 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1237/2488] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:58:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:58:48.860332 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387e456-7acf-488e-a4c0-bd04ddc6c2b6 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:48.861666 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387e456-7acf-488e-a4c0-bd04ddc6c2b6 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:48.862833 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387e456-7acf-488e-a4c0-bd04ddc6c2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:48.903475 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-e387e456-7acf-488e-a4c0-bd04ddc6c2b6 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:58:48.906483 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-e387e456-7acf-488e-a4c0-bd04ddc6c2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:48.959195 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac79cbd-2d06-46a6-97f2-ddce3c77cf47 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:58:48.961581 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1252/2489] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:58:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:58:48.999652 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac79cbd-2d06-46a6-97f2-ddce3c77cf47 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:58:49.016445 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc3576-9f1b-49d2-9334-b26fc59d770b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:58:49.018024 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc3576-9f1b-49d2-9334-b26fc59d770b admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:49.018735 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc3576-9f1b-49d2-9334-b26fc59d770b admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:49.019478 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc3576-9f1b-49d2-9334-b26fc59d770b admin admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:49.022853 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc3576-9f1b-49d2-9334-b26fc59d770b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:58:49.023946 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc3576-9f1b-49d2-9334-b26fc59d770b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:58:49.029555 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc3576-9f1b-49d2-9334-b26fc59d770b admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:58:49.081134 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1238/2490] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 13:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:58:49.083756 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387e456-7acf-488e-a4c0-bd04ddc6c2b6 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:58:49.114042 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387e456-7acf-488e-a4c0-bd04ddc6c2b6 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:58:49.132836 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c76c5c-9f74-4bfb-8d01-b8248820cfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:58:49.134494 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c76c5c-9f74-4bfb-8d01-b8248820cfe2 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:49.138521 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c76c5c-9f74-4bfb-8d01-b8248820cfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:49.139276 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c76c5c-9f74-4bfb-8d01-b8248820cfe2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:49.141424 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c76c5c-9f74-4bfb-8d01-b8248820cfe2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:58:49.144461 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c76c5c-9f74-4bfb-8d01-b8248820cfe2 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:58:49.152126 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:49.257477 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1253/2491] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:58:49 2022] POST /identity/v3/projects => generated 397 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:58:49.260756 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc3576-9f1b-49d2-9334-b26fc59d770b admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:58:49.299012 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc3576-9f1b-49d2-9334-b26fc59d770b admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:58:49.431352 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:49.456818 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3ecce-e563-4b9a-857f-6d1970e482c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:58:49.458434 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3ecce-e563-4b9a-857f-6d1970e482c0 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:49.460423 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3ecce-e563-4b9a-857f-6d1970e482c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:49.461654 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3ecce-e563-4b9a-857f-6d1970e482c0 admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:49.465168 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e3ecce-e563-4b9a-857f-6d1970e482c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:58:49.470169 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e3ecce-e563-4b9a-857f-6d1970e482c0 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:58:49.537548 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1239/2492] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:58:49 2022] POST /identity/v3/users => generated 299 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:58:49.544407 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c76c5c-9f74-4bfb-8d01-b8248820cfe2 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:58:49.569933 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c76c5c-9f74-4bfb-8d01-b8248820cfe2 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:58:49.592787 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4af2f-7a63-4032-85a2-25ac8d57e1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:58:49.594854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4af2f-7a63-4032-85a2-25ac8d57e1a3 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:49.595618 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4af2f-7a63-4032-85a2-25ac8d57e1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:49.596498 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4af2f-7a63-4032-85a2-25ac8d57e1a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:49.599611 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab4af2f-7a63-4032-85a2-25ac8d57e1a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:58:49.607250 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab4af2f-7a63-4032-85a2-25ac8d57e1a3 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:58:49.651947 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1254/2493] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:58:49.654347 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3ecce-e563-4b9a-857f-6d1970e482c0 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:58:49.720093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3ecce-e563-4b9a-857f-6d1970e482c0 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:58:49.744362 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc72d25-0308-4823-bed4-b2560a05d2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:58:49.746060 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc72d25-0308-4823-bed4-b2560a05d2ac admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:49.746823 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc72d25-0308-4823-bed4-b2560a05d2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:49.747414 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc72d25-0308-4823-bed4-b2560a05d2ac admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:49.748412 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc72d25-0308-4823-bed4-b2560a05d2ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:58:49.753705 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc72d25-0308-4823-bed4-b2560a05d2ac admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:58:49.811181 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1240/2494] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:58:49.819232 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4af2f-7a63-4032-85a2-25ac8d57e1a3 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:58:49.862895 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4af2f-7a63-4032-85a2-25ac8d57e1a3 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:58:49.896154 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f689e-0b0f-4c06-9cb4-d5560d05df38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:58:49.898538 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f689e-0b0f-4c06-9cb4-d5560d05df38 admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:49.898538 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f689e-0b0f-4c06-9cb4-d5560d05df38 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:49.898538 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f689e-0b0f-4c06-9cb4-d5560d05df38 admin admin] PATH_INFO: `/v3/projects/39bfb1b9522c48b6aadbd3cd0b9b7f42/users/9a002cef846e45eb8d0bcb7f94762753/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:49.996707 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f689e-0b0f-4c06-9cb4-d5560d05df38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39bfb1b9522c48b6aadbd3cd0b9b7f42, user_id=9a002cef846e45eb8d0bcb7f94762753, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:58:50.002840 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f689e-0b0f-4c06-9cb4-d5560d05df38 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:58:50.042611 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1255/2495] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:58:49 2022] PUT /identity/v3/projects/39bfb1b9522c48b6aadbd3cd0b9b7f42/users/9a002cef846e45eb8d0bcb7f94762753/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:58:50.048635 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2cfb3d-38fb-4517-b04c-4170919aae8f None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:50.049097 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2cfb3d-38fb-4517-b04c-4170919aae8f None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:50.049577 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2cfb3d-38fb-4517-b04c-4170919aae8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:50.109094 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-9c2cfb3d-38fb-4517-b04c-4170919aae8f None None] MFA Rules not processed for user `9a002cef846e45eb8d0bcb7f94762753`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:58:50.110674 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-9c2cfb3d-38fb-4517-b04c-4170919aae8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:50.294094 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1241/2496] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:58:50 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:58:50.312061 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f689e-0b0f-4c06-9cb4-d5560d05df38 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:58:50.322553 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-ac0f689e-0b0f-4c06-9cb4-d5560d05df38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:50.572259 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f689e-0b0f-4c06-9cb4-d5560d05df38 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:58:50.587266 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d32a2-3e53-409e-a156-b0e0154a44e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:58:50.589338 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d32a2-3e53-409e-a156-b0e0154a44e1 service cinder] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:50.592993 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d32a2-3e53-409e-a156-b0e0154a44e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:50.593562 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d32a2-3e53-409e-a156-b0e0154a44e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:50.612665 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d32a2-3e53-409e-a156-b0e0154a44e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:58:50.615482 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d32a2-3e53-409e-a156-b0e0154a44e1 service cinder] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:58:50.633327 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1256/2497] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:58:50 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:58:57.910601 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2cfb3d-38fb-4517-b04c-4170919aae8f None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:58:57.918306 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-9c2cfb3d-38fb-4517-b04c-4170919aae8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:58.241950 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2cfb3d-38fb-4517-b04c-4170919aae8f None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:58:58.290097 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a740036-25f7-4343-9077-db202b8ae70f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733797f12a1741e1a55332991e867aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:58:58.291973 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a740036-25f7-4343-9077-db202b8ae70f service placement] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:58.292976 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a740036-25f7-4343-9077-db202b8ae70f service placement] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:58.293510 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a740036-25f7-4343-9077-db202b8ae70f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:58.297967 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-5a740036-25f7-4343-9077-db202b8ae70f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:58.318494 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a740036-25f7-4343-9077-db202b8ae70f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:58:58.326566 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a740036-25f7-4343-9077-db202b8ae70f service placement] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:58:58.381399 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1242/2498] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:58:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:58:58.603956 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d32a2-3e53-409e-a156-b0e0154a44e1 service cinder] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:58:58.841107 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d32a2-3e53-409e-a156-b0e0154a44e1 service cinder] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:58:58.851488 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d44133-faa4-4e29-b98a-26cc248efb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:58:58.852630 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d44133-faa4-4e29-b98a-26cc248efb3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:58.853114 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d44133-faa4-4e29-b98a-26cc248efb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:58.854189 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d44133-faa4-4e29-b98a-26cc248efb3f admin admin] PATH_INFO: `/v3/users/9a002cef846e45eb8d0bcb7f94762753` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:58.856753 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d44133-faa4-4e29-b98a-26cc248efb3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a002cef846e45eb8d0bcb7f94762753)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:58:58.861233 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d44133-faa4-4e29-b98a-26cc248efb3f admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:58:58.939431 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:58.994912 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-f9d44133-faa4-4e29-b98a-26cc248efb3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a002cef846e45eb8d0bcb7f94762753'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:58:58.996589 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-f9d44133-faa4-4e29-b98a-26cc248efb3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a002cef846e45eb8d0bcb7f94762753'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:58:58.998995 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-f9d44133-faa4-4e29-b98a-26cc248efb3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a002cef846e45eb8d0bcb7f94762753'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:58:59.032829 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-f9d44133-faa4-4e29-b98a-26cc248efb3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a002cef846e45eb8d0bcb7f94762753'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:58:59.078278 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-f9d44133-faa4-4e29-b98a-26cc248efb3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a002cef846e45eb8d0bcb7f94762753'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:58:59.115687 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1257/2499] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:58:58 2022] DELETE /identity/v3/users/9a002cef846e45eb8d0bcb7f94762753 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:58:59.126948 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3aacd8-06db-4125-a492-00333c09c140 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:59.127894 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3aacd8-06db-4125-a492-00333c09c140 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:59.127894 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3aacd8-06db-4125-a492-00333c09c140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:59.164445 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-9b3aacd8-06db-4125-a492-00333c09c140 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:58:59.167009 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-9b3aacd8-06db-4125-a492-00333c09c140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:59.272615 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:59.305458 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1243/2500] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:58:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:58:59.324808 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d44133-faa4-4e29-b98a-26cc248efb3f admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:58:59.327353 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-f9d44133-faa4-4e29-b98a-26cc248efb3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:58:59.457729 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d44133-faa4-4e29-b98a-26cc248efb3f admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:58:59.464109 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88dd52-c245-4b02-9aa5-c0e05d70368f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:58:59.465102 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88dd52-c245-4b02-9aa5-c0e05d70368f service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:58:59.465587 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88dd52-c245-4b02-9aa5-c0e05d70368f service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:58:59.465955 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88dd52-c245-4b02-9aa5-c0e05d70368f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:58:59.483816 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88dd52-c245-4b02-9aa5-c0e05d70368f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:58:59.486146 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88dd52-c245-4b02-9aa5-c0e05d70368f service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:58:59.524736 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1258/2501] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:58:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:59:00.230857 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3aacd8-06db-4125-a492-00333c09c140 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:00.233143 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-9b3aacd8-06db-4125-a492-00333c09c140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:00.283197 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3aacd8-06db-4125-a492-00333c09c140 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:00.297461 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf24bca-ec61-41dd-9fa2-e3271c6de8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:00.298735 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf24bca-ec61-41dd-9fa2-e3271c6de8dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:00.299245 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf24bca-ec61-41dd-9fa2-e3271c6de8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:00.299722 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf24bca-ec61-41dd-9fa2-e3271c6de8dd admin admin] PATH_INFO: `/v3/projects/39bfb1b9522c48b6aadbd3cd0b9b7f42` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:00.305863 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf24bca-ec61-41dd-9fa2-e3271c6de8dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=39bfb1b9522c48b6aadbd3cd0b9b7f42)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:00.311527 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf24bca-ec61-41dd-9fa2-e3271c6de8dd admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:00.480026 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-bbf24bca-ec61-41dd-9fa2-e3271c6de8dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39bfb1b9522c48b6aadbd3cd0b9b7f42', 'request_id': 'req-bbf24bca-ec61-41dd-9fa2-e3271c6de8dd'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:00.492589 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-bbf24bca-ec61-41dd-9fa2-e3271c6de8dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39bfb1b9522c48b6aadbd3cd0b9b7f42', 'request_id': 'req-bbf24bca-ec61-41dd-9fa2-e3271c6de8dd'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:00.503986 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-bbf24bca-ec61-41dd-9fa2-e3271c6de8dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39bfb1b9522c48b6aadbd3cd0b9b7f42', 'request_id': 'req-bbf24bca-ec61-41dd-9fa2-e3271c6de8dd'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:00.537744 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-bbf24bca-ec61-41dd-9fa2-e3271c6de8dd admin admin] The token cache is being invalidate because project 39bfb1b9522c48b6aadbd3cd0b9b7f42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:59:00.538224 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-bbf24bca-ec61-41dd-9fa2-e3271c6de8dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:00.539203 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-bbf24bca-ec61-41dd-9fa2-e3271c6de8dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:00.542100 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1244/2502] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:59:00 2022] DELETE /identity/v3/projects/39bfb1b9522c48b6aadbd3cd0b9b7f42 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:59:03.340255 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a38f4de-29c6-411a-9840-42ba013cb644 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:03.341095 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a38f4de-29c6-411a-9840-42ba013cb644 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:03.341691 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a38f4de-29c6-411a-9840-42ba013cb644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:03.394870 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-7a38f4de-29c6-411a-9840-42ba013cb644 None None] MFA Rules not processed for user `6d2dd101d1a14e5ab95f272ab1bbeb94`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:59:03.397357 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-7a38f4de-29c6-411a-9840-42ba013cb644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:03.553657 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1259/2503] 10.222.0.69 () {58 vars in 967 bytes} [Thu Sep 8 13:59:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:59:03.574461 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf24bca-ec61-41dd-9fa2-e3271c6de8dd admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:03.578145 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-bbf24bca-ec61-41dd-9fa2-e3271c6de8dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:03.783941 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf24bca-ec61-41dd-9fa2-e3271c6de8dd admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:03.796792 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5eb9c4-9407-4f4b-86f9-8aae54935278 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9b97592a6840c3865d7dcf886221e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:03.798360 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5eb9c4-9407-4f4b-86f9-8aae54935278 service swift] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:03.799096 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5eb9c4-9407-4f4b-86f9-8aae54935278 service swift] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:03.799763 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5eb9c4-9407-4f4b-86f9-8aae54935278 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:03.817934 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5eb9c4-9407-4f4b-86f9-8aae54935278 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:03.822314 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5eb9c4-9407-4f4b-86f9-8aae54935278 service swift] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:03.852553 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1245/2504] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Sep 8 13:59:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 13:59:07.752858 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a38f4de-29c6-411a-9840-42ba013cb644 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:07.755383 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-7a38f4de-29c6-411a-9840-42ba013cb644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:07.960452 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:08.010806 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a38f4de-29c6-411a-9840-42ba013cb644 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:08.031143 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ab109-e849-4f5c-8c7e-907b6f9e6a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:08.032151 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ab109-e849-4f5c-8c7e-907b6f9e6a8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:08.032515 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ab109-e849-4f5c-8c7e-907b6f9e6a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:08.037263 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ab109-e849-4f5c-8c7e-907b6f9e6a8c admin admin] PATH_INFO: `/v3/users/cb73a0582bdd46cfa2a350eff014bbc1` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:08.040331 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3ab109-e849-4f5c-8c7e-907b6f9e6a8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb73a0582bdd46cfa2a350eff014bbc1)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:08.045766 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3ab109-e849-4f5c-8c7e-907b6f9e6a8c admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:08.268631 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-fa3ab109-e849-4f5c-8c7e-907b6f9e6a8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb73a0582bdd46cfa2a350eff014bbc1'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:08.274845 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-fa3ab109-e849-4f5c-8c7e-907b6f9e6a8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb73a0582bdd46cfa2a350eff014bbc1'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:08.276793 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-fa3ab109-e849-4f5c-8c7e-907b6f9e6a8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb73a0582bdd46cfa2a350eff014bbc1'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:08.303301 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-fa3ab109-e849-4f5c-8c7e-907b6f9e6a8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb73a0582bdd46cfa2a350eff014bbc1'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:08.349130 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-fa3ab109-e849-4f5c-8c7e-907b6f9e6a8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb73a0582bdd46cfa2a350eff014bbc1'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:08.399142 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1260/2505] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:59:07 2022] DELETE /identity/v3/users/cb73a0582bdd46cfa2a350eff014bbc1 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:59:08.934761 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5eb9c4-9407-4f4b-86f9-8aae54935278 service swift] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:08.939051 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-3d5eb9c4-9407-4f4b-86f9-8aae54935278 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:09.032851 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5eb9c4-9407-4f4b-86f9-8aae54935278 service swift] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:09.217169 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91588c-c0e1-47f4-ba5a-693458d98851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:09.218558 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91588c-c0e1-47f4-ba5a-693458d98851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:09.219662 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91588c-c0e1-47f4-ba5a-693458d98851 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:09.220292 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91588c-c0e1-47f4-ba5a-693458d98851 admin admin] PATH_INFO: `/v3/users/5d4f11a98f39401183a1317c92d3d3af` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:09.223016 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca91588c-c0e1-47f4-ba5a-693458d98851 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d4f11a98f39401183a1317c92d3d3af)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:09.226592 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca91588c-c0e1-47f4-ba5a-693458d98851 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:09.252491 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:09.388291 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ab109-e849-4f5c-8c7e-907b6f9e6a8c admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:09.392568 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-fa3ab109-e849-4f5c-8c7e-907b6f9e6a8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:09.399546 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-ca91588c-c0e1-47f4-ba5a-693458d98851 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d4f11a98f39401183a1317c92d3d3af'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:09.401317 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-ca91588c-c0e1-47f4-ba5a-693458d98851 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d4f11a98f39401183a1317c92d3d3af'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:09.420376 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-ca91588c-c0e1-47f4-ba5a-693458d98851 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d4f11a98f39401183a1317c92d3d3af'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:09.456445 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ab109-e849-4f5c-8c7e-907b6f9e6a8c admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:09.478159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-ca91588c-c0e1-47f4-ba5a-693458d98851 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d4f11a98f39401183a1317c92d3d3af'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:09.479496 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-ca91588c-c0e1-47f4-ba5a-693458d98851 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d4f11a98f39401183a1317c92d3d3af'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:09.496767 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a560a-b9a0-4d52-a4e8-60e2f2dde787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:09.498201 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a560a-b9a0-4d52-a4e8-60e2f2dde787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:09.499227 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a560a-b9a0-4d52-a4e8-60e2f2dde787 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:09.499362 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a560a-b9a0-4d52-a4e8-60e2f2dde787 admin admin] PATH_INFO: `/v3/projects/be8e3993e0c746a2adb7a5f0f304e26a` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:09.510534 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a560a-b9a0-4d52-a4e8-60e2f2dde787 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be8e3993e0c746a2adb7a5f0f304e26a)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:09.517047 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445a560a-b9a0-4d52-a4e8-60e2f2dde787 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:09.523333 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1246/2506] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:59:08 2022] DELETE /identity/v3/users/5d4f11a98f39401183a1317c92d3d3af => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:59:09.636061 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-445a560a-b9a0-4d52-a4e8-60e2f2dde787 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be8e3993e0c746a2adb7a5f0f304e26a', 'request_id': 'req-445a560a-b9a0-4d52-a4e8-60e2f2dde787'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:09.654243 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-445a560a-b9a0-4d52-a4e8-60e2f2dde787 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be8e3993e0c746a2adb7a5f0f304e26a', 'request_id': 'req-445a560a-b9a0-4d52-a4e8-60e2f2dde787'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:09.671499 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-445a560a-b9a0-4d52-a4e8-60e2f2dde787 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be8e3993e0c746a2adb7a5f0f304e26a', 'request_id': 'req-445a560a-b9a0-4d52-a4e8-60e2f2dde787'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:09.701637 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-445a560a-b9a0-4d52-a4e8-60e2f2dde787 admin admin] The token cache is being invalidate because project be8e3993e0c746a2adb7a5f0f304e26a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:59:09.702044 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-445a560a-b9a0-4d52-a4e8-60e2f2dde787 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:09.703406 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-445a560a-b9a0-4d52-a4e8-60e2f2dde787 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:09.721689 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1261/2507] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:59:09 2022] DELETE /identity/v3/projects/be8e3993e0c746a2adb7a5f0f304e26a => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:59:09.972196 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91588c-c0e1-47f4-ba5a-693458d98851 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:09.975589 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-ca91588c-c0e1-47f4-ba5a-693458d98851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:10.128720 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91588c-c0e1-47f4-ba5a-693458d98851 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:10.250797 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88280ed7-aedc-428a-9009-1b7bee396105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:10.251360 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88280ed7-aedc-428a-9009-1b7bee396105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:10.251652 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88280ed7-aedc-428a-9009-1b7bee396105 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:10.251939 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88280ed7-aedc-428a-9009-1b7bee396105 admin admin] PATH_INFO: `/v3/projects/37cc1647d3db48afb5c1fdea0f15a630` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:10.253730 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88280ed7-aedc-428a-9009-1b7bee396105 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37cc1647d3db48afb5c1fdea0f15a630)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:10.256014 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88280ed7-aedc-428a-9009-1b7bee396105 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:10.328656 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:10.355266 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-88280ed7-aedc-428a-9009-1b7bee396105 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37cc1647d3db48afb5c1fdea0f15a630', 'request_id': 'req-88280ed7-aedc-428a-9009-1b7bee396105'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:10.366584 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-88280ed7-aedc-428a-9009-1b7bee396105 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37cc1647d3db48afb5c1fdea0f15a630', 'request_id': 'req-88280ed7-aedc-428a-9009-1b7bee396105'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:10.377594 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-88280ed7-aedc-428a-9009-1b7bee396105 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37cc1647d3db48afb5c1fdea0f15a630', 'request_id': 'req-88280ed7-aedc-428a-9009-1b7bee396105'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:10.410196 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-88280ed7-aedc-428a-9009-1b7bee396105 admin admin] The token cache is being invalidate because project 37cc1647d3db48afb5c1fdea0f15a630 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:59:10.410493 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-88280ed7-aedc-428a-9009-1b7bee396105 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:10.411480 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-88280ed7-aedc-428a-9009-1b7bee396105 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:10.414369 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1247/2508] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:59:09 2022] DELETE /identity/v3/projects/37cc1647d3db48afb5c1fdea0f15a630 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:59:10.419076 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a560a-b9a0-4d52-a4e8-60e2f2dde787 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:10.421297 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-445a560a-b9a0-4d52-a4e8-60e2f2dde787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:10.437670 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445a560a-b9a0-4d52-a4e8-60e2f2dde787 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:10.543015 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:10.556929 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a104ac-250d-413b-b25d-57e4c8dbb0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:10.556929 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a104ac-250d-413b-b25d-57e4c8dbb0d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:10.558074 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a104ac-250d-413b-b25d-57e4c8dbb0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:10.558447 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a104ac-250d-413b-b25d-57e4c8dbb0d2 admin admin] PATH_INFO: `/v3/users/35b5ae01a4894129a2029fd6aa78ddc3` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:10.559996 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a104ac-250d-413b-b25d-57e4c8dbb0d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35b5ae01a4894129a2029fd6aa78ddc3)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:10.562317 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a104ac-250d-413b-b25d-57e4c8dbb0d2 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:10.684638 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-64a104ac-250d-413b-b25d-57e4c8dbb0d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35b5ae01a4894129a2029fd6aa78ddc3'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:10.686098 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-64a104ac-250d-413b-b25d-57e4c8dbb0d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35b5ae01a4894129a2029fd6aa78ddc3'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:10.688581 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-64a104ac-250d-413b-b25d-57e4c8dbb0d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35b5ae01a4894129a2029fd6aa78ddc3'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:10.708851 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-64a104ac-250d-413b-b25d-57e4c8dbb0d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35b5ae01a4894129a2029fd6aa78ddc3'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:10.751105 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-64a104ac-250d-413b-b25d-57e4c8dbb0d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35b5ae01a4894129a2029fd6aa78ddc3'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:10.781982 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1262/2509] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:59:10 2022] DELETE /identity/v3/users/35b5ae01a4894129a2029fd6aa78ddc3 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:59:11.144195 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88280ed7-aedc-428a-9009-1b7bee396105 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:11.146555 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-88280ed7-aedc-428a-9009-1b7bee396105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:11.178003 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88280ed7-aedc-428a-9009-1b7bee396105 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:11.310200 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a62876-a034-41eb-a9e1-5bf53eb06b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:11.311326 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a62876-a034-41eb-a9e1-5bf53eb06b85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:11.312016 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a62876-a034-41eb-a9e1-5bf53eb06b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:11.312510 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a62876-a034-41eb-a9e1-5bf53eb06b85 admin admin] PATH_INFO: `/v3/projects/2716321b31b649e9804894352702f6fc` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:11.314505 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a62876-a034-41eb-a9e1-5bf53eb06b85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2716321b31b649e9804894352702f6fc)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:11.317063 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a62876-a034-41eb-a9e1-5bf53eb06b85 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:11.342225 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac170347-2aed-411e-821a-3d95f91a31e9 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:11.342723 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac170347-2aed-411e-821a-3d95f91a31e9 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:11.343295 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac170347-2aed-411e-821a-3d95f91a31e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:11.378083 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-ac170347-2aed-411e-821a-3d95f91a31e9 None None] MFA Rules not processed for user `75cd9652625a4935a9af31bd4549ccf1`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:59:11.380140 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-ac170347-2aed-411e-821a-3d95f91a31e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:11.393577 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-44a62876-a034-41eb-a9e1-5bf53eb06b85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2716321b31b649e9804894352702f6fc', 'request_id': 'req-44a62876-a034-41eb-a9e1-5bf53eb06b85'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:11.401446 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-44a62876-a034-41eb-a9e1-5bf53eb06b85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2716321b31b649e9804894352702f6fc', 'request_id': 'req-44a62876-a034-41eb-a9e1-5bf53eb06b85'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:11.411783 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-44a62876-a034-41eb-a9e1-5bf53eb06b85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2716321b31b649e9804894352702f6fc', 'request_id': 'req-44a62876-a034-41eb-a9e1-5bf53eb06b85'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:11.439643 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-44a62876-a034-41eb-a9e1-5bf53eb06b85 admin admin] The token cache is being invalidate because project 2716321b31b649e9804894352702f6fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:59:11.440213 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-44a62876-a034-41eb-a9e1-5bf53eb06b85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:11.443702 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-44a62876-a034-41eb-a9e1-5bf53eb06b85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:11.445973 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1248/2510] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:59:11 2022] DELETE /identity/v3/projects/2716321b31b649e9804894352702f6fc => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:59:11.513958 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1263/2511] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:59:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:59:21.439533 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:DELETE=12,keystone:SELECT=62,keystone:INSERT=2 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:21.498164 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=53,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:23.694819 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a62876-a034-41eb-a9e1-5bf53eb06b85 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:23.696505 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-44a62876-a034-41eb-a9e1-5bf53eb06b85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:23.810560 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a62876-a034-41eb-a9e1-5bf53eb06b85 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:23.817313 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9eb47-216b-42d7-b396-f8acc971fa9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:23.818826 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9eb47-216b-42d7-b396-f8acc971fa9c service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:23.819074 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9eb47-216b-42d7-b396-f8acc971fa9c service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:23.819472 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9eb47-216b-42d7-b396-f8acc971fa9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:23.823255 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-97f9eb47-216b-42d7-b396-f8acc971fa9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:23.940836 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f9eb47-216b-42d7-b396-f8acc971fa9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:23.943770 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f9eb47-216b-42d7-b396-f8acc971fa9c service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:23.965200 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1249/2512] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:59:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:59:29.638498 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac170347-2aed-411e-821a-3d95f91a31e9 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:29.641668 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-ac170347-2aed-411e-821a-3d95f91a31e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:29.754106 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9eb47-216b-42d7-b396-f8acc971fa9c service neutron] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:29.755948 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-97f9eb47-216b-42d7-b396-f8acc971fa9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:29.777447 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9eb47-216b-42d7-b396-f8acc971fa9c service neutron] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:29.786024 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34751566-e676-48b7-b5de-9a6be75d3a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:29.787122 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34751566-e676-48b7-b5de-9a6be75d3a54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:29.787629 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34751566-e676-48b7-b5de-9a6be75d3a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:29.788123 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34751566-e676-48b7-b5de-9a6be75d3a54 admin admin] PATH_INFO: `/v3/users/5eb6e03e874d4b28aaf21c5b36f7bb98` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:29.790417 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34751566-e676-48b7-b5de-9a6be75d3a54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5eb6e03e874d4b28aaf21c5b36f7bb98)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:29.791985 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac170347-2aed-411e-821a-3d95f91a31e9 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:29.794501 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34751566-e676-48b7-b5de-9a6be75d3a54 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:29.800780 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192a6bc-a7f3-4d1d-be55-a1f52ca2b05c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733797f12a1741e1a55332991e867aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:29.801700 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192a6bc-a7f3-4d1d-be55-a1f52ca2b05c service placement] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:29.802203 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192a6bc-a7f3-4d1d-be55-a1f52ca2b05c service placement] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:29.802661 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192a6bc-a7f3-4d1d-be55-a1f52ca2b05c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:29.805672 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-8192a6bc-a7f3-4d1d-be55-a1f52ca2b05c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:29.828653 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8192a6bc-a7f3-4d1d-be55-a1f52ca2b05c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:29.831992 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8192a6bc-a7f3-4d1d-be55-a1f52ca2b05c service placement] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:29.857826 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1264/2513] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:59:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:59:29.907705 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-34751566-e676-48b7-b5de-9a6be75d3a54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5eb6e03e874d4b28aaf21c5b36f7bb98'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:29.914098 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-34751566-e676-48b7-b5de-9a6be75d3a54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5eb6e03e874d4b28aaf21c5b36f7bb98'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:29.926207 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-34751566-e676-48b7-b5de-9a6be75d3a54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5eb6e03e874d4b28aaf21c5b36f7bb98'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:29.958279 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-34751566-e676-48b7-b5de-9a6be75d3a54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5eb6e03e874d4b28aaf21c5b36f7bb98'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:29.959562 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-34751566-e676-48b7-b5de-9a6be75d3a54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5eb6e03e874d4b28aaf21c5b36f7bb98'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:29.994702 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1250/2514] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:59:29 2022] DELETE /identity/v3/users/5eb6e03e874d4b28aaf21c5b36f7bb98 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:59:30.328926 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192a6bc-a7f3-4d1d-be55-a1f52ca2b05c service placement] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:30.355467 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192a6bc-a7f3-4d1d-be55-a1f52ca2b05c service placement] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:30.500724 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d058e288-451e-40fd-83f6-0ad63dd8371f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:30.501856 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058e288-451e-40fd-83f6-0ad63dd8371f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:30.502416 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058e288-451e-40fd-83f6-0ad63dd8371f admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:30.502812 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d058e288-451e-40fd-83f6-0ad63dd8371f admin admin] PATH_INFO: `/v3/projects/735551d6d52b4b8790e5be1b94e4041f` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:30.504815 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d058e288-451e-40fd-83f6-0ad63dd8371f admin admin] RBAC: Authorizing `identity:delete_project(project_id=735551d6d52b4b8790e5be1b94e4041f)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:30.507892 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d058e288-451e-40fd-83f6-0ad63dd8371f admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:30.605029 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-d058e288-451e-40fd-83f6-0ad63dd8371f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '735551d6d52b4b8790e5be1b94e4041f', 'request_id': 'req-d058e288-451e-40fd-83f6-0ad63dd8371f'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:30.616421 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-d058e288-451e-40fd-83f6-0ad63dd8371f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '735551d6d52b4b8790e5be1b94e4041f', 'request_id': 'req-d058e288-451e-40fd-83f6-0ad63dd8371f'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:30.631108 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-d058e288-451e-40fd-83f6-0ad63dd8371f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '735551d6d52b4b8790e5be1b94e4041f', 'request_id': 'req-d058e288-451e-40fd-83f6-0ad63dd8371f'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:30.653883 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-d058e288-451e-40fd-83f6-0ad63dd8371f admin admin] The token cache is being invalidate because project 735551d6d52b4b8790e5be1b94e4041f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:59:30.658505 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-d058e288-451e-40fd-83f6-0ad63dd8371f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:30.661318 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-d058e288-451e-40fd-83f6-0ad63dd8371f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:30.678256 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1265/2515] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:59:30 2022] DELETE /identity/v3/projects/735551d6d52b4b8790e5be1b94e4041f => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:59:30.683905 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c92a8-793d-4e56-803a-7dc5e6f32c4b None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:30.684395 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c92a8-793d-4e56-803a-7dc5e6f32c4b None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:30.684873 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c92a8-793d-4e56-803a-7dc5e6f32c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:30.745316 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-698c92a8-793d-4e56-803a-7dc5e6f32c4b None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:59:30.748096 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-698c92a8-793d-4e56-803a-7dc5e6f32c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:30.789674 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:30.898066 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1251/2516] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:59:30.911508 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d6ca6-099a-4cb1-ab80-eb613ed919e1 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:30.911699 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d6ca6-099a-4cb1-ab80-eb613ed919e1 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:30.912041 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d6ca6-099a-4cb1-ab80-eb613ed919e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:30.943701 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-fa9d6ca6-099a-4cb1-ab80-eb613ed919e1 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:59:30.945535 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-fa9d6ca6-099a-4cb1-ab80-eb613ed919e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:30.959109 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1266/2517] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:59:30.966534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c92a8-793d-4e56-803a-7dc5e6f32c4b None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:30.986615 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c92a8-793d-4e56-803a-7dc5e6f32c4b None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:30.996064 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f85e94-b3fb-4e7f-b391-78d9d81eee6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:30.997130 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f85e94-b3fb-4e7f-b391-78d9d81eee6d admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:30.997724 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f85e94-b3fb-4e7f-b391-78d9d81eee6d admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:30.998236 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f85e94-b3fb-4e7f-b391-78d9d81eee6d admin admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:30.999731 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f85e94-b3fb-4e7f-b391-78d9d81eee6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:59:31.000005 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f85e94-b3fb-4e7f-b391-78d9d81eee6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:31.003307 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f85e94-b3fb-4e7f-b391-78d9d81eee6d admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:31.030006 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1252/2518] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 13:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:59:31.037542 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d6ca6-099a-4cb1-ab80-eb613ed919e1 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:31.057408 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d6ca6-099a-4cb1-ab80-eb613ed919e1 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:31.066470 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed2eb8-96dc-4c67-9fd9-23c9b99ef85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:31.067406 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed2eb8-96dc-4c67-9fd9-23c9b99ef85e admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:31.067964 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed2eb8-96dc-4c67-9fd9-23c9b99ef85e admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:31.068347 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed2eb8-96dc-4c67-9fd9-23c9b99ef85e admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:31.069684 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed2eb8-96dc-4c67-9fd9-23c9b99ef85e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:31.074020 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed2eb8-96dc-4c67-9fd9-23c9b99ef85e admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:31.097402 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:31.131312 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1267/2519] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:59:31 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:59:31.138746 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f85e94-b3fb-4e7f-b391-78d9d81eee6d admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:31.162192 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f85e94-b3fb-4e7f-b391-78d9d81eee6d admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:31.287564 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131cc54-06cf-40b1-8ec6-5f687bef3498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:31.289052 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131cc54-06cf-40b1-8ec6-5f687bef3498 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:31.289603 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131cc54-06cf-40b1-8ec6-5f687bef3498 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:31.290156 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131cc54-06cf-40b1-8ec6-5f687bef3498 admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:31.291916 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8131cc54-06cf-40b1-8ec6-5f687bef3498 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:31.295868 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8131cc54-06cf-40b1-8ec6-5f687bef3498 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:31.339566 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1253/2520] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:59:31 2022] POST /identity/v3/users => generated 290 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:59:31.342687 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed2eb8-96dc-4c67-9fd9-23c9b99ef85e admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:31.362608 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed2eb8-96dc-4c67-9fd9-23c9b99ef85e admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:31.371931 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4041381-2fdc-4063-875a-3238eeb0191a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:31.372967 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4041381-2fdc-4063-875a-3238eeb0191a admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:31.373508 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4041381-2fdc-4063-875a-3238eeb0191a admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:31.373997 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4041381-2fdc-4063-875a-3238eeb0191a admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:31.375250 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4041381-2fdc-4063-875a-3238eeb0191a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:31.378594 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4041381-2fdc-4063-875a-3238eeb0191a admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:31.400617 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1268/2521] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 13:59:31.407127 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131cc54-06cf-40b1-8ec6-5f687bef3498 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:31.428676 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131cc54-06cf-40b1-8ec6-5f687bef3498 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:31.438625 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1597e1-3d40-49f6-8409-83e1923e88fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:31.439889 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1597e1-3d40-49f6-8409-83e1923e88fb admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:31.440399 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1597e1-3d40-49f6-8409-83e1923e88fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:31.440893 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1597e1-3d40-49f6-8409-83e1923e88fb admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:31.442113 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1597e1-3d40-49f6-8409-83e1923e88fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:31.445278 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1597e1-3d40-49f6-8409-83e1923e88fb admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:31.472283 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1254/2522] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:59:31.481654 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4041381-2fdc-4063-875a-3238eeb0191a admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:31.501113 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4041381-2fdc-4063-875a-3238eeb0191a admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:31.509922 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a02df-b126-4caa-9bd8-276b88bf0d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:31.511059 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a02df-b126-4caa-9bd8-276b88bf0d23 admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:31.511557 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a02df-b126-4caa-9bd8-276b88bf0d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:31.512034 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a02df-b126-4caa-9bd8-276b88bf0d23 admin admin] PATH_INFO: `/v3/projects/31a4b2df56454024a7119fe3c6914006/users/3dfb67ba08094571a8b403108470e8f8/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:31.545168 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a02df-b126-4caa-9bd8-276b88bf0d23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31a4b2df56454024a7119fe3c6914006, user_id=3dfb67ba08094571a8b403108470e8f8, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:31.550970 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a02df-b126-4caa-9bd8-276b88bf0d23 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:31.582278 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1269/2523] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:59:31 2022] PUT /identity/v3/projects/31a4b2df56454024a7119fe3c6914006/users/3dfb67ba08094571a8b403108470e8f8/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:59:31.595866 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f7b19-fbd4-44ed-9c8b-ffd5812a03b7 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:31.596430 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f7b19-fbd4-44ed-9c8b-ffd5812a03b7 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:31.596964 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f7b19-fbd4-44ed-9c8b-ffd5812a03b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:31.648818 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-602f7b19-fbd4-44ed-9c8b-ffd5812a03b7 None None] MFA Rules not processed for user `3dfb67ba08094571a8b403108470e8f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:59:31.651428 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-602f7b19-fbd4-44ed-9c8b-ffd5812a03b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:31.795360 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1255/2524] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:59:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:59:31.814738 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a02df-b126-4caa-9bd8-276b88bf0d23 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:31.957301 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a02df-b126-4caa-9bd8-276b88bf0d23 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:31.969586 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9b72c-8836-4846-b283-73d5ef38f6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:31.970227 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9b72c-8836-4846-b283-73d5ef38f6bc admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:31.970565 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9b72c-8836-4846-b283-73d5ef38f6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:31.971059 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9b72c-8836-4846-b283-73d5ef38f6bc admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:31.971774 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe9b72c-8836-4846-b283-73d5ef38f6bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:31.974515 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe9b72c-8836-4846-b283-73d5ef38f6bc admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:32.026980 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1270/2525] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:59:31 2022] POST /identity/v3/projects => generated 379 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:59:32.032416 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f7b19-fbd4-44ed-9c8b-ffd5812a03b7 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:32.048684 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f7b19-fbd4-44ed-9c8b-ffd5812a03b7 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:32.068742 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:32.167613 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d785b-f88d-496c-b0b1-a4023c05b759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:32.170945 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d785b-f88d-496c-b0b1-a4023c05b759 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:32.171396 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d785b-f88d-496c-b0b1-a4023c05b759 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:32.171846 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d785b-f88d-496c-b0b1-a4023c05b759 admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:32.172813 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d785b-f88d-496c-b0b1-a4023c05b759 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:32.175002 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d785b-f88d-496c-b0b1-a4023c05b759 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:32.213052 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1256/2526] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:59:32 2022] POST /identity/v3/users => generated 296 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:59:32.215236 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9b72c-8836-4846-b283-73d5ef38f6bc admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:32.232261 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9b72c-8836-4846-b283-73d5ef38f6bc admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:32.240949 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37ec0e-3ed7-4556-aa04-d69286b6cc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:32.246728 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37ec0e-3ed7-4556-aa04-d69286b6cc40 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:32.246728 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37ec0e-3ed7-4556-aa04-d69286b6cc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:32.246728 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37ec0e-3ed7-4556-aa04-d69286b6cc40 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:32.246728 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37ec0e-3ed7-4556-aa04-d69286b6cc40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:32.248562 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37ec0e-3ed7-4556-aa04-d69286b6cc40 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:32.272876 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1271/2527] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:59:32.279953 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d785b-f88d-496c-b0b1-a4023c05b759 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:32.299648 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d785b-f88d-496c-b0b1-a4023c05b759 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:32.310169 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ea571-8d5a-4242-82dd-4e3d676b9e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:32.311192 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ea571-8d5a-4242-82dd-4e3d676b9e0b admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:32.311711 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ea571-8d5a-4242-82dd-4e3d676b9e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:32.312257 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ea571-8d5a-4242-82dd-4e3d676b9e0b admin admin] PATH_INFO: `/v3/projects/fee36a4742764358b16b20f6f2c11def/users/7fbc5093f1d74662afc6157cf90af646/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:32.343686 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ea571-8d5a-4242-82dd-4e3d676b9e0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fee36a4742764358b16b20f6f2c11def, user_id=7fbc5093f1d74662afc6157cf90af646, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:32.347089 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ea571-8d5a-4242-82dd-4e3d676b9e0b admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:32.377111 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1257/2528] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:59:32 2022] PUT /identity/v3/projects/fee36a4742764358b16b20f6f2c11def/users/7fbc5093f1d74662afc6157cf90af646/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:59:32.382632 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37ec0e-3ed7-4556-aa04-d69286b6cc40 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:32.416104 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37ec0e-3ed7-4556-aa04-d69286b6cc40 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:32.552492 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef085e0b-e288-4f96-9eff-66dd75b49d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:32.553411 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef085e0b-e288-4f96-9eff-66dd75b49d1b admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:32.553823 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef085e0b-e288-4f96-9eff-66dd75b49d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:32.554245 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef085e0b-e288-4f96-9eff-66dd75b49d1b admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:32.555367 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef085e0b-e288-4f96-9eff-66dd75b49d1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:32.559392 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef085e0b-e288-4f96-9eff-66dd75b49d1b admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:32.578736 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1272/2529] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:59:32.584086 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ea571-8d5a-4242-82dd-4e3d676b9e0b admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:32.604966 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ea571-8d5a-4242-82dd-4e3d676b9e0b admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:32.611913 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6bf11-423b-407e-bbd5-805174e3c8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:32.613006 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6bf11-423b-407e-bbd5-805174e3c8b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:32.613402 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6bf11-423b-407e-bbd5-805174e3c8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:32.613867 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6bf11-423b-407e-bbd5-805174e3c8b5 admin admin] PATH_INFO: `/v3/projects/fee36a4742764358b16b20f6f2c11def/users/7fbc5093f1d74662afc6157cf90af646/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:32.616534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6bf11-423b-407e-bbd5-805174e3c8b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fee36a4742764358b16b20f6f2c11def, user_id=7fbc5093f1d74662afc6157cf90af646, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:32.620280 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6bf11-423b-407e-bbd5-805174e3c8b5 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:32.646029 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1258/2530] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:59:32 2022] PUT /identity/v3/projects/fee36a4742764358b16b20f6f2c11def/users/7fbc5093f1d74662afc6157cf90af646/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:59:32.669743 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be863e6c-e400-45ba-b95d-6ba0d9adf259 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:32.670610 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be863e6c-e400-45ba-b95d-6ba0d9adf259 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:32.671196 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be863e6c-e400-45ba-b95d-6ba0d9adf259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:32.721862 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-be863e6c-e400-45ba-b95d-6ba0d9adf259 None None] MFA Rules not processed for user `7fbc5093f1d74662afc6157cf90af646`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:59:32.723505 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-be863e6c-e400-45ba-b95d-6ba0d9adf259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:32.757437 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:32.957466 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1273/2531] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:59:32 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:59:32.987777 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6bf11-423b-407e-bbd5-805174e3c8b5 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:32.990557 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-86a6bf11-423b-407e-bbd5-805174e3c8b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:33.189753 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6bf11-423b-407e-bbd5-805174e3c8b5 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:33.198672 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216474f-cded-4069-8711-c59abbfa4811 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:33.199635 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216474f-cded-4069-8711-c59abbfa4811 service cinder] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:33.200106 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216474f-cded-4069-8711-c59abbfa4811 service cinder] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:33.200546 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216474f-cded-4069-8711-c59abbfa4811 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:33.218254 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216474f-cded-4069-8711-c59abbfa4811 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:33.220117 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216474f-cded-4069-8711-c59abbfa4811 service cinder] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:33.253280 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1259/2532] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:59:32 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:59:33.449829 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be863e6c-e400-45ba-b95d-6ba0d9adf259 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:33.484623 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be863e6c-e400-45ba-b95d-6ba0d9adf259 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:33.493168 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba955d63-c97b-4571-bcce-8c96a405cc4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:33.495064 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba955d63-c97b-4571-bcce-8c96a405cc4c service cinder] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:33.495064 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba955d63-c97b-4571-bcce-8c96a405cc4c service cinder] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:33.495064 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba955d63-c97b-4571-bcce-8c96a405cc4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:33.692843 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba955d63-c97b-4571-bcce-8c96a405cc4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:33.697756 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba955d63-c97b-4571-bcce-8c96a405cc4c service cinder] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:33.717611 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1274/2533] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:59:33 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:59:42.343804 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216474f-cded-4069-8711-c59abbfa4811 service cinder] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:42.455547 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216474f-cded-4069-8711-c59abbfa4811 service cinder] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:42.464815 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61168e7d-c0ee-4d66-9fc7-182da5237166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:42.465898 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61168e7d-c0ee-4d66-9fc7-182da5237166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:42.466333 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61168e7d-c0ee-4d66-9fc7-182da5237166 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:42.466695 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61168e7d-c0ee-4d66-9fc7-182da5237166 admin admin] PATH_INFO: `/v3/users/3dfb67ba08094571a8b403108470e8f8` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:42.468595 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61168e7d-c0ee-4d66-9fc7-182da5237166 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dfb67ba08094571a8b403108470e8f8)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:42.471746 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61168e7d-c0ee-4d66-9fc7-182da5237166 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:42.500260 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:42.574920 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-61168e7d-c0ee-4d66-9fc7-182da5237166 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dfb67ba08094571a8b403108470e8f8'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:42.575776 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-61168e7d-c0ee-4d66-9fc7-182da5237166 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dfb67ba08094571a8b403108470e8f8'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:42.587877 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-61168e7d-c0ee-4d66-9fc7-182da5237166 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dfb67ba08094571a8b403108470e8f8'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:42.608558 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-61168e7d-c0ee-4d66-9fc7-182da5237166 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dfb67ba08094571a8b403108470e8f8'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:42.608558 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-61168e7d-c0ee-4d66-9fc7-182da5237166 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dfb67ba08094571a8b403108470e8f8'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:42.641841 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1260/2534] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:59:42 2022] DELETE /identity/v3/users/3dfb67ba08094571a8b403108470e8f8 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:59:42.648066 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0889872-168a-418c-99bc-74002d26a0e3 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:42.650116 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0889872-168a-418c-99bc-74002d26a0e3 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:42.650116 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0889872-168a-418c-99bc-74002d26a0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:42.687749 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-b0889872-168a-418c-99bc-74002d26a0e3 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:59:42.689655 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-b0889872-168a-418c-99bc-74002d26a0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:42.798926 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1275/2535] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:59:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:59:42.814249 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61168e7d-c0ee-4d66-9fc7-182da5237166 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:42.816669 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-61168e7d-c0ee-4d66-9fc7-182da5237166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:42.924363 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61168e7d-c0ee-4d66-9fc7-182da5237166 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:42.932213 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7535a-225a-4599-8090-4ea9005576aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:42.933335 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7535a-225a-4599-8090-4ea9005576aa service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:42.933913 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7535a-225a-4599-8090-4ea9005576aa service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:42.934399 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7535a-225a-4599-8090-4ea9005576aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:42.952661 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be7535a-225a-4599-8090-4ea9005576aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:42.955359 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be7535a-225a-4599-8090-4ea9005576aa service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:42.977077 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1261/2536] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:59:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:59:43.444831 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0889872-168a-418c-99bc-74002d26a0e3 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:43.447683 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-b0889872-168a-418c-99bc-74002d26a0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:43.467664 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0889872-168a-418c-99bc-74002d26a0e3 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:43.475915 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe192c9-20db-4141-8c0f-539832f94d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:43.476881 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe192c9-20db-4141-8c0f-539832f94d70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:43.477346 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe192c9-20db-4141-8c0f-539832f94d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:43.478491 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe192c9-20db-4141-8c0f-539832f94d70 admin admin] PATH_INFO: `/v3/projects/31a4b2df56454024a7119fe3c6914006` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:43.480483 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe192c9-20db-4141-8c0f-539832f94d70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31a4b2df56454024a7119fe3c6914006)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:43.484293 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe192c9-20db-4141-8c0f-539832f94d70 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:43.581755 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:43.590440 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-8fe192c9-20db-4141-8c0f-539832f94d70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31a4b2df56454024a7119fe3c6914006', 'request_id': 'req-8fe192c9-20db-4141-8c0f-539832f94d70'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:43.603718 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-8fe192c9-20db-4141-8c0f-539832f94d70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31a4b2df56454024a7119fe3c6914006', 'request_id': 'req-8fe192c9-20db-4141-8c0f-539832f94d70'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:43.613706 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-8fe192c9-20db-4141-8c0f-539832f94d70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31a4b2df56454024a7119fe3c6914006', 'request_id': 'req-8fe192c9-20db-4141-8c0f-539832f94d70'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:43.632315 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-8fe192c9-20db-4141-8c0f-539832f94d70 admin admin] The token cache is being invalidate because project 31a4b2df56454024a7119fe3c6914006 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:59:43.632705 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-8fe192c9-20db-4141-8c0f-539832f94d70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:43.633506 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-8fe192c9-20db-4141-8c0f-539832f94d70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:43.636063 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1276/2537] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:59:43 2022] DELETE /identity/v3/projects/31a4b2df56454024a7119fe3c6914006 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:59:43.642027 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7535a-225a-4599-8090-4ea9005576aa service neutron] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:43.656695 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7535a-225a-4599-8090-4ea9005576aa service neutron] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:43.766554 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f85843-7256-4495-9bee-d030e2ed0d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:43.767447 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f85843-7256-4495-9bee-d030e2ed0d68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:43.767869 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f85843-7256-4495-9bee-d030e2ed0d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:43.768330 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f85843-7256-4495-9bee-d030e2ed0d68 admin admin] PATH_INFO: `/v3/users/7fbc5093f1d74662afc6157cf90af646` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:43.769697 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f85843-7256-4495-9bee-d030e2ed0d68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fbc5093f1d74662afc6157cf90af646)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:43.771725 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f85843-7256-4495-9bee-d030e2ed0d68 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:43.848134 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:43.869210 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-07f85843-7256-4495-9bee-d030e2ed0d68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fbc5093f1d74662afc6157cf90af646'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:43.872279 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-07f85843-7256-4495-9bee-d030e2ed0d68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fbc5093f1d74662afc6157cf90af646'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:43.882771 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-07f85843-7256-4495-9bee-d030e2ed0d68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fbc5093f1d74662afc6157cf90af646'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:43.905449 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-07f85843-7256-4495-9bee-d030e2ed0d68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fbc5093f1d74662afc6157cf90af646'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:43.906688 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-07f85843-7256-4495-9bee-d030e2ed0d68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fbc5093f1d74662afc6157cf90af646'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:43.936952 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1262/2538] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:59:43 2022] DELETE /identity/v3/users/7fbc5093f1d74662afc6157cf90af646 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:59:44.352445 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe192c9-20db-4141-8c0f-539832f94d70 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:44.355197 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-8fe192c9-20db-4141-8c0f-539832f94d70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:44.374954 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe192c9-20db-4141-8c0f-539832f94d70 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:44.465701 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe80d96-2ab0-4287-8b51-689df5e677bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:44.466512 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe80d96-2ab0-4287-8b51-689df5e677bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:44.466895 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe80d96-2ab0-4287-8b51-689df5e677bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:44.467274 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe80d96-2ab0-4287-8b51-689df5e677bb admin admin] PATH_INFO: `/v3/projects/fee36a4742764358b16b20f6f2c11def` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:44.468896 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe80d96-2ab0-4287-8b51-689df5e677bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=fee36a4742764358b16b20f6f2c11def)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:44.471042 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe80d96-2ab0-4287-8b51-689df5e677bb admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:44.550172 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-9fe80d96-2ab0-4287-8b51-689df5e677bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fee36a4742764358b16b20f6f2c11def', 'request_id': 'req-9fe80d96-2ab0-4287-8b51-689df5e677bb'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:44.557328 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-9fe80d96-2ab0-4287-8b51-689df5e677bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fee36a4742764358b16b20f6f2c11def', 'request_id': 'req-9fe80d96-2ab0-4287-8b51-689df5e677bb'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:44.565250 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-9fe80d96-2ab0-4287-8b51-689df5e677bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fee36a4742764358b16b20f6f2c11def', 'request_id': 'req-9fe80d96-2ab0-4287-8b51-689df5e677bb'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:44.590091 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-9fe80d96-2ab0-4287-8b51-689df5e677bb admin admin] The token cache is being invalidate because project fee36a4742764358b16b20f6f2c11def was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:59:44.590601 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-9fe80d96-2ab0-4287-8b51-689df5e677bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:44.591955 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-9fe80d96-2ab0-4287-8b51-689df5e677bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:44.594569 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1277/2539] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:59:44 2022] DELETE /identity/v3/projects/fee36a4742764358b16b20f6f2c11def => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:59:44.603489 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5628865-9242-4865-b8b8-618a46028565 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:44.604127 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5628865-9242-4865-b8b8-618a46028565 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:44.604742 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5628865-9242-4865-b8b8-618a46028565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:44.628626 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-a5628865-9242-4865-b8b8-618a46028565 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:59:44.630043 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-a5628865-9242-4865-b8b8-618a46028565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:44.726621 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1263/2540] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:59:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:59:44.737745 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b8ef0-a658-4d09-b8e5-1b87edc7bee1 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:44.738166 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b8ef0-a658-4d09-b8e5-1b87edc7bee1 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:44.738710 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b8ef0-a658-4d09-b8e5-1b87edc7bee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:44.772917 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-146b8ef0-a658-4d09-b8e5-1b87edc7bee1 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:59:44.775259 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-146b8ef0-a658-4d09-b8e5-1b87edc7bee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:44.788999 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1278/2541] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:59:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:59:44.796167 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5628865-9242-4865-b8b8-618a46028565 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:44.809674 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5628865-9242-4865-b8b8-618a46028565 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:44.817950 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f0d1d-dd60-432e-b29a-69bb57c8c3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:44.818594 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f0d1d-dd60-432e-b29a-69bb57c8c3d3 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:44.818874 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f0d1d-dd60-432e-b29a-69bb57c8c3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:44.819139 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f0d1d-dd60-432e-b29a-69bb57c8c3d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:44.819949 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068f0d1d-dd60-432e-b29a-69bb57c8c3d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:59:44.820253 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068f0d1d-dd60-432e-b29a-69bb57c8c3d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:44.822023 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068f0d1d-dd60-432e-b29a-69bb57c8c3d3 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:44.837528 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1264/2542] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 13:59:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 13:59:44.842522 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b8ef0-a658-4d09-b8e5-1b87edc7bee1 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:44.855150 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b8ef0-a658-4d09-b8e5-1b87edc7bee1 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:44.863045 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbe78c-9252-415f-906f-e5b432614f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:44.863691 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbe78c-9252-415f-906f-e5b432614f87 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:44.864031 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbe78c-9252-415f-906f-e5b432614f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:44.864331 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbe78c-9252-415f-906f-e5b432614f87 admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:44.864975 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cbe78c-9252-415f-906f-e5b432614f87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:44.867330 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cbe78c-9252-415f-906f-e5b432614f87 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:44.913169 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1279/2543] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:59:44 2022] POST /identity/v3/projects => generated 381 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:59:44.921150 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f0d1d-dd60-432e-b29a-69bb57c8c3d3 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:44.938649 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f0d1d-dd60-432e-b29a-69bb57c8c3d3 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:45.023889 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3e94e-7cb8-412f-bda9-da31cd15f460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:45.025083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3e94e-7cb8-412f-bda9-da31cd15f460 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:45.025548 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3e94e-7cb8-412f-bda9-da31cd15f460 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:45.026082 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb3e94e-7cb8-412f-bda9-da31cd15f460 admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:45.026903 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb3e94e-7cb8-412f-bda9-da31cd15f460 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:45.029025 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb3e94e-7cb8-412f-bda9-da31cd15f460 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:45.064113 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1265/2544] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:59:44 2022] POST /identity/v3/users => generated 291 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:59:45.068369 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbe78c-9252-415f-906f-e5b432614f87 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:45.081201 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbe78c-9252-415f-906f-e5b432614f87 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:45.089176 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66800028-b5bd-4233-b59d-2ef53b93b6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:45.089856 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66800028-b5bd-4233-b59d-2ef53b93b6df admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:45.090131 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66800028-b5bd-4233-b59d-2ef53b93b6df admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:45.090403 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66800028-b5bd-4233-b59d-2ef53b93b6df admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:45.091083 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66800028-b5bd-4233-b59d-2ef53b93b6df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:45.092737 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66800028-b5bd-4233-b59d-2ef53b93b6df admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:45.112310 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1280/2545] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:59:45.116764 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3e94e-7cb8-412f-bda9-da31cd15f460 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:45.131045 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb3e94e-7cb8-412f-bda9-da31cd15f460 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:45.138112 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89619ffd-5c18-4f70-a1fd-d87399ce1575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:45.138795 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89619ffd-5c18-4f70-a1fd-d87399ce1575 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:45.139217 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89619ffd-5c18-4f70-a1fd-d87399ce1575 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:45.139536 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89619ffd-5c18-4f70-a1fd-d87399ce1575 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:45.140526 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89619ffd-5c18-4f70-a1fd-d87399ce1575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:45.143070 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89619ffd-5c18-4f70-a1fd-d87399ce1575 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:45.156816 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1266/2546] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:59:45.162741 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66800028-b5bd-4233-b59d-2ef53b93b6df admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:45.184444 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66800028-b5bd-4233-b59d-2ef53b93b6df admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:45.192230 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe1d9d4-6905-4843-b447-f76c3279924f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:45.193130 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1d9d4-6905-4843-b447-f76c3279924f admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:45.193593 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1d9d4-6905-4843-b447-f76c3279924f admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:45.193937 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe1d9d4-6905-4843-b447-f76c3279924f admin admin] PATH_INFO: `/v3/projects/185722b1e522484da0b048e71b6d62d1/users/7d3f54289786433ba4b88906d18dbaef/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:45.220967 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe1d9d4-6905-4843-b447-f76c3279924f admin admin] RBAC: Authorizing `identity:create_grant(project_id=185722b1e522484da0b048e71b6d62d1, user_id=7d3f54289786433ba4b88906d18dbaef, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:45.226476 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe1d9d4-6905-4843-b447-f76c3279924f admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:45.245763 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:45.260204 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1281/2547] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:59:45 2022] PUT /identity/v3/projects/185722b1e522484da0b048e71b6d62d1/users/7d3f54289786433ba4b88906d18dbaef/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:59:45.281030 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc16af-a210-4d5e-ba20-b87a852bdb1e None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:45.281867 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc16af-a210-4d5e-ba20-b87a852bdb1e None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:45.282215 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc16af-a210-4d5e-ba20-b87a852bdb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:45.330390 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-bccc16af-a210-4d5e-ba20-b87a852bdb1e None None] MFA Rules not processed for user `7d3f54289786433ba4b88906d18dbaef`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:59:45.331909 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-bccc16af-a210-4d5e-ba20-b87a852bdb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:45.347169 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:45.457698 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1267/2548] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:59:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:59:45.464730 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe1d9d4-6905-4843-b447-f76c3279924f admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:45.569328 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe1d9d4-6905-4843-b447-f76c3279924f admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:45.577811 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6a5d4-3bd0-4a0a-8572-8d8b12c15950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:45.578699 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6a5d4-3bd0-4a0a-8572-8d8b12c15950 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:45.579147 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6a5d4-3bd0-4a0a-8572-8d8b12c15950 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:45.579561 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6a5d4-3bd0-4a0a-8572-8d8b12c15950 admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:45.581075 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6a5d4-3bd0-4a0a-8572-8d8b12c15950 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:45.585131 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6a5d4-3bd0-4a0a-8572-8d8b12c15950 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:45.635764 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1282/2549] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:59:45 2022] POST /identity/v3/projects => generated 381 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:59:45.642503 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc16af-a210-4d5e-ba20-b87a852bdb1e None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:45.663295 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc16af-a210-4d5e-ba20-b87a852bdb1e None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:45.791806 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b213c53-9606-4d45-8c9f-080d4cea7d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:45.792543 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b213c53-9606-4d45-8c9f-080d4cea7d42 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:45.792700 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b213c53-9606-4d45-8c9f-080d4cea7d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:45.792978 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b213c53-9606-4d45-8c9f-080d4cea7d42 admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:45.793673 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b213c53-9606-4d45-8c9f-080d4cea7d42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:45.795647 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b213c53-9606-4d45-8c9f-080d4cea7d42 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:45.827442 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1268/2550] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:59:45 2022] POST /identity/v3/users => generated 297 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:59:45.833897 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6a5d4-3bd0-4a0a-8572-8d8b12c15950 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:45.848595 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6a5d4-3bd0-4a0a-8572-8d8b12c15950 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:45.856499 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febefbbd-099f-461b-8c8a-7d9634a60b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:45.857188 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febefbbd-099f-461b-8c8a-7d9634a60b83 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:45.857553 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febefbbd-099f-461b-8c8a-7d9634a60b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:45.857791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febefbbd-099f-461b-8c8a-7d9634a60b83 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:45.858490 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febefbbd-099f-461b-8c8a-7d9634a60b83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:45.860592 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febefbbd-099f-461b-8c8a-7d9634a60b83 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:45.876083 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1283/2551] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:59:45.881942 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b213c53-9606-4d45-8c9f-080d4cea7d42 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:45.898953 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b213c53-9606-4d45-8c9f-080d4cea7d42 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:45.907259 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31053a9-33e9-422f-a95c-0afcd9966d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:45.908172 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31053a9-33e9-422f-a95c-0afcd9966d1f admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:45.908543 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31053a9-33e9-422f-a95c-0afcd9966d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:45.908878 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31053a9-33e9-422f-a95c-0afcd9966d1f admin admin] PATH_INFO: `/v3/projects/0d17140c39ba43e9855778cace2fbab1/users/3ae27c389625427f958a86476e03b0c6/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:45.931866 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31053a9-33e9-422f-a95c-0afcd9966d1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d17140c39ba43e9855778cace2fbab1, user_id=3ae27c389625427f958a86476e03b0c6, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:45.935159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31053a9-33e9-422f-a95c-0afcd9966d1f admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:45.954024 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1269/2552] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:59:45 2022] PUT /identity/v3/projects/0d17140c39ba43e9855778cace2fbab1/users/3ae27c389625427f958a86476e03b0c6/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:59:45.958885 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febefbbd-099f-461b-8c8a-7d9634a60b83 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:45.978781 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febefbbd-099f-461b-8c8a-7d9634a60b83 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:46.083517 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa47ab2-3ed4-48f0-9f83-787ed8bcd3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:46.084527 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa47ab2-3ed4-48f0-9f83-787ed8bcd3ee admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:46.084875 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa47ab2-3ed4-48f0-9f83-787ed8bcd3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:46.085291 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa47ab2-3ed4-48f0-9f83-787ed8bcd3ee admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:46.086476 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa47ab2-3ed4-48f0-9f83-787ed8bcd3ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:46.089745 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa47ab2-3ed4-48f0-9f83-787ed8bcd3ee admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:46.107832 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1284/2553] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 13:59:46.114648 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31053a9-33e9-422f-a95c-0afcd9966d1f admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:46.127866 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31053a9-33e9-422f-a95c-0afcd9966d1f admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:46.134444 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0d1aa-77e7-43cf-bcf4-cb3283661f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:46.135294 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0d1aa-77e7-43cf-bcf4-cb3283661f0d admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:46.135702 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0d1aa-77e7-43cf-bcf4-cb3283661f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:46.135997 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0d1aa-77e7-43cf-bcf4-cb3283661f0d admin admin] PATH_INFO: `/v3/projects/0d17140c39ba43e9855778cace2fbab1/users/3ae27c389625427f958a86476e03b0c6/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:46.138773 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a0d1aa-77e7-43cf-bcf4-cb3283661f0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d17140c39ba43e9855778cace2fbab1, user_id=3ae27c389625427f958a86476e03b0c6, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:46.142336 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a0d1aa-77e7-43cf-bcf4-cb3283661f0d admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:46.158586 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1270/2554] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:59:46 2022] PUT /identity/v3/projects/0d17140c39ba43e9855778cace2fbab1/users/3ae27c389625427f958a86476e03b0c6/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:59:46.174693 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47c307-25a9-4320-90d4-3a18de0c16cf None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:46.175158 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47c307-25a9-4320-90d4-3a18de0c16cf None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:46.176186 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47c307-25a9-4320-90d4-3a18de0c16cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:46.233524 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-3c47c307-25a9-4320-90d4-3a18de0c16cf None None] MFA Rules not processed for user `3ae27c389625427f958a86476e03b0c6`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:59:46.234891 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-3c47c307-25a9-4320-90d4-3a18de0c16cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:46.356573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:46.376919 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1285/2555] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:59:46 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:59:46.392606 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0d1aa-77e7-43cf-bcf4-cb3283661f0d admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:46.394884 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-b4a0d1aa-77e7-43cf-bcf4-cb3283661f0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:46.532708 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0d1aa-77e7-43cf-bcf4-cb3283661f0d admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:46.538252 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0643fe45-6dee-4503-aeaa-f66e19a3940f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:46.539195 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643fe45-6dee-4503-aeaa-f66e19a3940f service cinder] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:46.539608 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643fe45-6dee-4503-aeaa-f66e19a3940f service cinder] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:46.540749 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643fe45-6dee-4503-aeaa-f66e19a3940f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:46.555179 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0643fe45-6dee-4503-aeaa-f66e19a3940f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:46.557435 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0643fe45-6dee-4503-aeaa-f66e19a3940f service cinder] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:46.572956 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1271/2556] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:59:46 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:59:46.772226 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47c307-25a9-4320-90d4-3a18de0c16cf None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:46.786771 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47c307-25a9-4320-90d4-3a18de0c16cf None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:46.792853 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce6b6e-626d-479d-9db0-96d1ca3c0a0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:46.793840 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce6b6e-626d-479d-9db0-96d1ca3c0a0a service cinder] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:46.794297 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce6b6e-626d-479d-9db0-96d1ca3c0a0a service cinder] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:46.794678 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce6b6e-626d-479d-9db0-96d1ca3c0a0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:46.917334 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce6b6e-626d-479d-9db0-96d1ca3c0a0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:46.918976 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ce6b6e-626d-479d-9db0-96d1ca3c0a0a service cinder] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:46.931388 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1286/2557] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:59:46 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:59:49.951437 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0643fe45-6dee-4503-aeaa-f66e19a3940f service cinder] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:49.958466 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:50.064635 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0643fe45-6dee-4503-aeaa-f66e19a3940f service cinder] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:50.079601 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ded5c0-3d8f-4e7e-b107-dc704812180c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:50.080743 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ded5c0-3d8f-4e7e-b107-dc704812180c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:50.081236 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ded5c0-3d8f-4e7e-b107-dc704812180c admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:50.081792 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ded5c0-3d8f-4e7e-b107-dc704812180c admin admin] PATH_INFO: `/v3/users/7d3f54289786433ba4b88906d18dbaef` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:50.084042 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ded5c0-3d8f-4e7e-b107-dc704812180c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d3f54289786433ba4b88906d18dbaef)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:50.087926 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ded5c0-3d8f-4e7e-b107-dc704812180c admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:50.172448 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-70ded5c0-3d8f-4e7e-b107-dc704812180c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d3f54289786433ba4b88906d18dbaef'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:50.173308 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-70ded5c0-3d8f-4e7e-b107-dc704812180c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d3f54289786433ba4b88906d18dbaef'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:50.184980 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-70ded5c0-3d8f-4e7e-b107-dc704812180c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d3f54289786433ba4b88906d18dbaef'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:50.208385 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-70ded5c0-3d8f-4e7e-b107-dc704812180c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d3f54289786433ba4b88906d18dbaef'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:50.209631 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-70ded5c0-3d8f-4e7e-b107-dc704812180c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d3f54289786433ba4b88906d18dbaef'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:50.236836 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1272/2558] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:59:49 2022] DELETE /identity/v3/users/7d3f54289786433ba4b88906d18dbaef => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:59:50.242579 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184abe82-b640-4b29-b739-af165b34f449 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:50.243853 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184abe82-b640-4b29-b739-af165b34f449 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:50.243853 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184abe82-b640-4b29-b739-af165b34f449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:50.268130 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-184abe82-b640-4b29-b739-af165b34f449 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:59:50.270344 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-184abe82-b640-4b29-b739-af165b34f449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:50.378724 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1287/2559] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:59:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:59:50.396451 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ded5c0-3d8f-4e7e-b107-dc704812180c admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:50.398856 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-70ded5c0-3d8f-4e7e-b107-dc704812180c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:50.505062 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ded5c0-3d8f-4e7e-b107-dc704812180c admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:50.510917 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b10d9-fac7-437a-a29b-fcb6837ba5c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:50.511552 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b10d9-fac7-437a-a29b-fcb6837ba5c3 service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:50.511825 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b10d9-fac7-437a-a29b-fcb6837ba5c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:50.512093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b10d9-fac7-437a-a29b-fcb6837ba5c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:50.526252 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216b10d9-fac7-437a-a29b-fcb6837ba5c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:50.528298 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216b10d9-fac7-437a-a29b-fcb6837ba5c3 service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:50.541290 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1273/2560] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:59:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:59:51.029705 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184abe82-b640-4b29-b739-af165b34f449 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:51.033260 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-184abe82-b640-4b29-b739-af165b34f449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:51.062379 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184abe82-b640-4b29-b739-af165b34f449 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:51.070537 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ddb374-72b5-4fd5-a0a2-90107441aaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:51.072760 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddb374-72b5-4fd5-a0a2-90107441aaee admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:51.073269 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddb374-72b5-4fd5-a0a2-90107441aaee admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:51.073747 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddb374-72b5-4fd5-a0a2-90107441aaee admin admin] PATH_INFO: `/v3/projects/185722b1e522484da0b048e71b6d62d1` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:51.076074 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ddb374-72b5-4fd5-a0a2-90107441aaee admin admin] RBAC: Authorizing `identity:delete_project(project_id=185722b1e522484da0b048e71b6d62d1)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:51.080328 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ddb374-72b5-4fd5-a0a2-90107441aaee admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:51.153577 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-43ddb374-72b5-4fd5-a0a2-90107441aaee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '185722b1e522484da0b048e71b6d62d1', 'request_id': 'req-43ddb374-72b5-4fd5-a0a2-90107441aaee'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:51.161701 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-43ddb374-72b5-4fd5-a0a2-90107441aaee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '185722b1e522484da0b048e71b6d62d1', 'request_id': 'req-43ddb374-72b5-4fd5-a0a2-90107441aaee'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:51.170544 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-43ddb374-72b5-4fd5-a0a2-90107441aaee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '185722b1e522484da0b048e71b6d62d1', 'request_id': 'req-43ddb374-72b5-4fd5-a0a2-90107441aaee'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:51.191388 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-43ddb374-72b5-4fd5-a0a2-90107441aaee admin admin] The token cache is being invalidate because project 185722b1e522484da0b048e71b6d62d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:59:51.191981 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-43ddb374-72b5-4fd5-a0a2-90107441aaee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:51.193257 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-43ddb374-72b5-4fd5-a0a2-90107441aaee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:51.196079 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1288/2561] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:59:51 2022] DELETE /identity/v3/projects/185722b1e522484da0b048e71b6d62d1 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:59:51.202950 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b10d9-fac7-437a-a29b-fcb6837ba5c3 service neutron] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:51.221405 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b10d9-fac7-437a-a29b-fcb6837ba5c3 service neutron] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:51.256440 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:51.325918 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd9a78e-46f9-442d-bddb-cad35f5c018c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:51.326531 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9a78e-46f9-442d-bddb-cad35f5c018c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:51.326813 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9a78e-46f9-442d-bddb-cad35f5c018c admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:51.327093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9a78e-46f9-442d-bddb-cad35f5c018c admin admin] PATH_INFO: `/v3/users/3ae27c389625427f958a86476e03b0c6` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:51.328377 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd9a78e-46f9-442d-bddb-cad35f5c018c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ae27c389625427f958a86476e03b0c6)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:51.330435 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd9a78e-46f9-442d-bddb-cad35f5c018c admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:51.407925 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-0fd9a78e-46f9-442d-bddb-cad35f5c018c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ae27c389625427f958a86476e03b0c6'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:51.409182 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-0fd9a78e-46f9-442d-bddb-cad35f5c018c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ae27c389625427f958a86476e03b0c6'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:51.420903 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-0fd9a78e-46f9-442d-bddb-cad35f5c018c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ae27c389625427f958a86476e03b0c6'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:51.444079 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-0fd9a78e-46f9-442d-bddb-cad35f5c018c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ae27c389625427f958a86476e03b0c6'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:51.445048 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-0fd9a78e-46f9-442d-bddb-cad35f5c018c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ae27c389625427f958a86476e03b0c6'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:51.483822 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1274/2562] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:59:51 2022] DELETE /identity/v3/users/3ae27c389625427f958a86476e03b0c6 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:59:52.210717 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ddb374-72b5-4fd5-a0a2-90107441aaee admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:52.212962 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-43ddb374-72b5-4fd5-a0a2-90107441aaee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:52.233744 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ddb374-72b5-4fd5-a0a2-90107441aaee admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:52.265486 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:52.353696 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e776a06-1bdd-48f8-9623-a114938f935b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:52.354594 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e776a06-1bdd-48f8-9623-a114938f935b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:52.354902 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e776a06-1bdd-48f8-9623-a114938f935b admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:52.355220 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e776a06-1bdd-48f8-9623-a114938f935b admin admin] PATH_INFO: `/v3/projects/0d17140c39ba43e9855778cace2fbab1` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:52.356713 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e776a06-1bdd-48f8-9623-a114938f935b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d17140c39ba43e9855778cace2fbab1)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:52.358835 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e776a06-1bdd-48f8-9623-a114938f935b admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:52.425280 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-8e776a06-1bdd-48f8-9623-a114938f935b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d17140c39ba43e9855778cace2fbab1', 'request_id': 'req-8e776a06-1bdd-48f8-9623-a114938f935b'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:52.433736 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-8e776a06-1bdd-48f8-9623-a114938f935b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d17140c39ba43e9855778cace2fbab1', 'request_id': 'req-8e776a06-1bdd-48f8-9623-a114938f935b'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:52.441682 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-8e776a06-1bdd-48f8-9623-a114938f935b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d17140c39ba43e9855778cace2fbab1', 'request_id': 'req-8e776a06-1bdd-48f8-9623-a114938f935b'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:52.460642 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-8e776a06-1bdd-48f8-9623-a114938f935b admin admin] The token cache is being invalidate because project 0d17140c39ba43e9855778cace2fbab1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:59:52.460973 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-8e776a06-1bdd-48f8-9623-a114938f935b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:52.463059 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-8e776a06-1bdd-48f8-9623-a114938f935b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:52.465358 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1289/2563] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:59:52 2022] DELETE /identity/v3/projects/0d17140c39ba43e9855778cace2fbab1 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:59:52.472466 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c84b7a-3840-40d2-8c0b-e3193e676d11 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:52.473427 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c84b7a-3840-40d2-8c0b-e3193e676d11 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:52.473427 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c84b7a-3840-40d2-8c0b-e3193e676d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:52.507680 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-26c84b7a-3840-40d2-8c0b-e3193e676d11 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:59:52.510219 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-26c84b7a-3840-40d2-8c0b-e3193e676d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:52.626140 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1275/2564] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:59:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:59:52.635339 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52babc7-672a-43f5-8a9a-09370cc34dcb None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:52.635647 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52babc7-672a-43f5-8a9a-09370cc34dcb None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:52.635932 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52babc7-672a-43f5-8a9a-09370cc34dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:52.667500 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-d52babc7-672a-43f5-8a9a-09370cc34dcb None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:59:52.668972 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-d52babc7-672a-43f5-8a9a-09370cc34dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:52.680062 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1290/2565] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:59:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:59:52.685954 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c84b7a-3840-40d2-8c0b-e3193e676d11 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:52.703931 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c84b7a-3840-40d2-8c0b-e3193e676d11 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:52.709637 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c3e75-2beb-4ba7-a1fe-45f1b42473c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:52.710269 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c3e75-2beb-4ba7-a1fe-45f1b42473c8 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:52.710546 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c3e75-2beb-4ba7-a1fe-45f1b42473c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:52.710893 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c3e75-2beb-4ba7-a1fe-45f1b42473c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:52.712519 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c3e75-2beb-4ba7-a1fe-45f1b42473c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:59:52.712933 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c3e75-2beb-4ba7-a1fe-45f1b42473c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:52.714810 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c3e75-2beb-4ba7-a1fe-45f1b42473c8 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:52.741854 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1276/2566] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 13:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:59:52.748578 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52babc7-672a-43f5-8a9a-09370cc34dcb None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:52.761267 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52babc7-672a-43f5-8a9a-09370cc34dcb None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:52.767744 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec43932-7134-4bde-bd5f-fae0c38342f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:52.768582 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec43932-7134-4bde-bd5f-fae0c38342f9 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:52.768939 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec43932-7134-4bde-bd5f-fae0c38342f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:52.769214 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec43932-7134-4bde-bd5f-fae0c38342f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:52.769903 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec43932-7134-4bde-bd5f-fae0c38342f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:52.772103 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec43932-7134-4bde-bd5f-fae0c38342f9 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:52.820308 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1291/2567] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:59:52 2022] POST /identity/v3/projects => generated 387 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:59:52.828374 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c3e75-2beb-4ba7-a1fe-45f1b42473c8 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:52.848514 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c3e75-2beb-4ba7-a1fe-45f1b42473c8 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:52.903236 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:52.954790 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be2ff0-eb65-4fce-bcb1-3021e937b077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:52.955867 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be2ff0-eb65-4fce-bcb1-3021e937b077 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:52.956354 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be2ff0-eb65-4fce-bcb1-3021e937b077 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:52.956832 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be2ff0-eb65-4fce-bcb1-3021e937b077 admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:52.958298 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be2ff0-eb65-4fce-bcb1-3021e937b077 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:52.962307 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be2ff0-eb65-4fce-bcb1-3021e937b077 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:53.005002 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1277/2568] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:59:52 2022] POST /identity/v3/users => generated 294 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:59:53.011173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec43932-7134-4bde-bd5f-fae0c38342f9 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:53.022761 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec43932-7134-4bde-bd5f-fae0c38342f9 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:53.028931 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e09e6-eb14-4f40-961f-1a2f29c74b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:53.029594 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e09e6-eb14-4f40-961f-1a2f29c74b29 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:53.029868 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e09e6-eb14-4f40-961f-1a2f29c74b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:53.030143 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e09e6-eb14-4f40-961f-1a2f29c74b29 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:53.030994 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26e09e6-eb14-4f40-961f-1a2f29c74b29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:53.034195 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26e09e6-eb14-4f40-961f-1a2f29c74b29 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:53.051106 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1292/2569] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:59:53.056753 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be2ff0-eb65-4fce-bcb1-3021e937b077 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:53.076552 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be2ff0-eb65-4fce-bcb1-3021e937b077 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:53.085055 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014fd56-8761-403a-89e0-7016a9d2d613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:53.086257 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014fd56-8761-403a-89e0-7016a9d2d613 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:53.089029 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014fd56-8761-403a-89e0-7016a9d2d613 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:53.089029 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014fd56-8761-403a-89e0-7016a9d2d613 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:53.089520 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014fd56-8761-403a-89e0-7016a9d2d613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:53.092334 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014fd56-8761-403a-89e0-7016a9d2d613 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:53.114047 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1278/2570] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:59:53.122257 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e09e6-eb14-4f40-961f-1a2f29c74b29 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:53.147668 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e09e6-eb14-4f40-961f-1a2f29c74b29 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:53.156977 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a8204-1108-4955-9314-f826be736cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:53.158135 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a8204-1108-4955-9314-f826be736cd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:53.158135 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a8204-1108-4955-9314-f826be736cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:53.159125 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a8204-1108-4955-9314-f826be736cd6 admin admin] PATH_INFO: `/v3/projects/f34ee16b1b8e4f5b9f0299c9bbede79b/users/c099531e8a7a477692404df59e5aa9cb/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:53.199835 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894a8204-1108-4955-9314-f826be736cd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f34ee16b1b8e4f5b9f0299c9bbede79b, user_id=c099531e8a7a477692404df59e5aa9cb, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:53.203578 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894a8204-1108-4955-9314-f826be736cd6 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:53.229815 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1293/2571] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:59:53 2022] PUT /identity/v3/projects/f34ee16b1b8e4f5b9f0299c9bbede79b/users/c099531e8a7a477692404df59e5aa9cb/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:59:53.251560 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c7796-ef3e-479c-8e84-ffccaba7e0b8 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:53.252491 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c7796-ef3e-479c-8e84-ffccaba7e0b8 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:53.253060 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c7796-ef3e-479c-8e84-ffccaba7e0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:53.314053 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-ae6c7796-ef3e-479c-8e84-ffccaba7e0b8 None None] MFA Rules not processed for user `c099531e8a7a477692404df59e5aa9cb`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:59:53.315959 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-ae6c7796-ef3e-479c-8e84-ffccaba7e0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:53.479620 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1279/2572] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:59:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:59:53.495078 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a8204-1108-4955-9314-f826be736cd6 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:53.605802 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:53.651737 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a8204-1108-4955-9314-f826be736cd6 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:53.657988 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c15b5a8-697a-4f8c-a6c4-d4ed79b4ddd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:53.658701 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15b5a8-697a-4f8c-a6c4-d4ed79b4ddd6 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:53.659037 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15b5a8-697a-4f8c-a6c4-d4ed79b4ddd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:53.659431 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15b5a8-697a-4f8c-a6c4-d4ed79b4ddd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:53.660220 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c15b5a8-697a-4f8c-a6c4-d4ed79b4ddd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:53.662781 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c15b5a8-697a-4f8c-a6c4-d4ed79b4ddd6 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:53.718532 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1294/2573] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:59:53 2022] POST /identity/v3/projects => generated 389 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:59:53.729334 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c7796-ef3e-479c-8e84-ffccaba7e0b8 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:53.764915 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c7796-ef3e-479c-8e84-ffccaba7e0b8 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:53.868813 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598ffc2-ddb2-4cb3-a9a3-7f7b5f749a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:53.869983 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598ffc2-ddb2-4cb3-a9a3-7f7b5f749a21 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:53.870743 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598ffc2-ddb2-4cb3-a9a3-7f7b5f749a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:53.870989 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598ffc2-ddb2-4cb3-a9a3-7f7b5f749a21 admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:53.871793 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f598ffc2-ddb2-4cb3-a9a3-7f7b5f749a21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:53.874799 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f598ffc2-ddb2-4cb3-a9a3-7f7b5f749a21 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:53.919048 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1280/2574] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:59:53 2022] POST /identity/v3/users => generated 301 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:59:53.925119 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c15b5a8-697a-4f8c-a6c4-d4ed79b4ddd6 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:53.948839 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c15b5a8-697a-4f8c-a6c4-d4ed79b4ddd6 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:53.957784 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea4dd0-b54e-4e0f-8e51-24faa859f406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:53.960046 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea4dd0-b54e-4e0f-8e51-24faa859f406 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:53.960046 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea4dd0-b54e-4e0f-8e51-24faa859f406 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:53.960046 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea4dd0-b54e-4e0f-8e51-24faa859f406 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:53.962368 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea4dd0-b54e-4e0f-8e51-24faa859f406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:53.963261 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea4dd0-b54e-4e0f-8e51-24faa859f406 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:53.978650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1295/2575] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:59:53.984775 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598ffc2-ddb2-4cb3-a9a3-7f7b5f749a21 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:53.999110 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598ffc2-ddb2-4cb3-a9a3-7f7b5f749a21 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:54.005161 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157de2a-1d18-4e8b-8ea0-f9ace262e7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:54.006025 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157de2a-1d18-4e8b-8ea0-f9ace262e7c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:54.006316 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157de2a-1d18-4e8b-8ea0-f9ace262e7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:54.006598 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157de2a-1d18-4e8b-8ea0-f9ace262e7c7 admin admin] PATH_INFO: `/v3/projects/bd0e73892c304a8898693efbfeb47d81/users/f6c7b91a23c04b54919ec75a4019bf52/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:54.029437 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0157de2a-1d18-4e8b-8ea0-f9ace262e7c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd0e73892c304a8898693efbfeb47d81, user_id=f6c7b91a23c04b54919ec75a4019bf52, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:54.032459 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0157de2a-1d18-4e8b-8ea0-f9ace262e7c7 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:54.050713 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1281/2576] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:59:53 2022] PUT /identity/v3/projects/bd0e73892c304a8898693efbfeb47d81/users/f6c7b91a23c04b54919ec75a4019bf52/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:59:54.055855 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea4dd0-b54e-4e0f-8e51-24faa859f406 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:54.067687 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea4dd0-b54e-4e0f-8e51-24faa859f406 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:54.175387 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c631847d-bd38-46ae-8630-04089f8f0211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:54.176435 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631847d-bd38-46ae-8630-04089f8f0211 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:54.176912 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631847d-bd38-46ae-8630-04089f8f0211 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:54.177326 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631847d-bd38-46ae-8630-04089f8f0211 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:54.181353 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c631847d-bd38-46ae-8630-04089f8f0211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:54.181353 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c631847d-bd38-46ae-8630-04089f8f0211 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:54.198208 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1296/2577] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:59:54 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:59:54.203163 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157de2a-1d18-4e8b-8ea0-f9ace262e7c7 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:54.224063 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157de2a-1d18-4e8b-8ea0-f9ace262e7c7 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:54.233330 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6f3fe-34c8-4cdd-916b-eec8699cfeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:54.234551 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6f3fe-34c8-4cdd-916b-eec8699cfeff admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:54.235060 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6f3fe-34c8-4cdd-916b-eec8699cfeff admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:54.235625 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6f3fe-34c8-4cdd-916b-eec8699cfeff admin admin] PATH_INFO: `/v3/projects/bd0e73892c304a8898693efbfeb47d81/users/f6c7b91a23c04b54919ec75a4019bf52/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:54.239924 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e6f3fe-34c8-4cdd-916b-eec8699cfeff admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd0e73892c304a8898693efbfeb47d81, user_id=f6c7b91a23c04b54919ec75a4019bf52, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:54.246328 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e6f3fe-34c8-4cdd-916b-eec8699cfeff admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:54.251048 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:54.280518 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1282/2578] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:59:54 2022] PUT /identity/v3/projects/bd0e73892c304a8898693efbfeb47d81/users/f6c7b91a23c04b54919ec75a4019bf52/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:59:54.295241 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41392f0d-cf1e-47a7-9c13-ed00e8fff50f None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:54.296203 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41392f0d-cf1e-47a7-9c13-ed00e8fff50f None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:54.296484 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41392f0d-cf1e-47a7-9c13-ed00e8fff50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:54.351504 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-41392f0d-cf1e-47a7-9c13-ed00e8fff50f None None] MFA Rules not processed for user `f6c7b91a23c04b54919ec75a4019bf52`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:59:54.354627 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-41392f0d-cf1e-47a7-9c13-ed00e8fff50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:54.506297 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1297/2579] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:59:54 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:59:54.520637 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6f3fe-34c8-4cdd-916b-eec8699cfeff admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:54.522750 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-05e6f3fe-34c8-4cdd-916b-eec8699cfeff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:54.621713 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6f3fe-34c8-4cdd-916b-eec8699cfeff admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:54.627090 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d00012e-1f82-446d-8853-7cb3c6f8c805 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:54.628426 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00012e-1f82-446d-8853-7cb3c6f8c805 service cinder] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:54.628930 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00012e-1f82-446d-8853-7cb3c6f8c805 service cinder] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:54.629443 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00012e-1f82-446d-8853-7cb3c6f8c805 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:54.655795 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d00012e-1f82-446d-8853-7cb3c6f8c805 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:54.659159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d00012e-1f82-446d-8853-7cb3c6f8c805 service cinder] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:54.686935 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1283/2580] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:59:54 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 13:59:54.966819 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41392f0d-cf1e-47a7-9c13-ed00e8fff50f None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:55.048495 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:55.093217 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41392f0d-cf1e-47a7-9c13-ed00e8fff50f None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:55.099127 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4eb65-2300-4a87-9232-2e4a7526b111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:55.100155 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4eb65-2300-4a87-9232-2e4a7526b111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:55.100806 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4eb65-2300-4a87-9232-2e4a7526b111 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:55.101357 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4eb65-2300-4a87-9232-2e4a7526b111 admin admin] PATH_INFO: `/v3/users/c099531e8a7a477692404df59e5aa9cb` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:55.103632 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4eb65-2300-4a87-9232-2e4a7526b111 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c099531e8a7a477692404df59e5aa9cb)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:55.106967 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4eb65-2300-4a87-9232-2e4a7526b111 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:55.230751 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-bdd4eb65-2300-4a87-9232-2e4a7526b111 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c099531e8a7a477692404df59e5aa9cb'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:55.231955 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-bdd4eb65-2300-4a87-9232-2e4a7526b111 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c099531e8a7a477692404df59e5aa9cb'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:55.232988 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-bdd4eb65-2300-4a87-9232-2e4a7526b111 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c099531e8a7a477692404df59e5aa9cb'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:55.265848 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-bdd4eb65-2300-4a87-9232-2e4a7526b111 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c099531e8a7a477692404df59e5aa9cb'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:55.299344 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-bdd4eb65-2300-4a87-9232-2e4a7526b111 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c099531e8a7a477692404df59e5aa9cb'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:55.329784 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1298/2581] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:59:54 2022] DELETE /identity/v3/users/c099531e8a7a477692404df59e5aa9cb => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:59:55.336007 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082f675-e28c-4a14-984a-f708e5455c9b None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:55.336578 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082f675-e28c-4a14-984a-f708e5455c9b None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:55.337308 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1082f675-e28c-4a14-984a-f708e5455c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:55.374354 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-1082f675-e28c-4a14-984a-f708e5455c9b None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:59:55.378109 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-1082f675-e28c-4a14-984a-f708e5455c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:55.395515 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f3e67-73b1-4433-a65a-f24fa4877e3d None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:55.396993 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f3e67-73b1-4433-a65a-f24fa4877e3d None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:55.397612 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f3e67-73b1-4433-a65a-f24fa4877e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:55.436930 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-f97f3e67-73b1-4433-a65a-f24fa4877e3d None None] MFA Rules not processed for user `6d2dd101d1a14e5ab95f272ab1bbeb94`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:59:55.448979 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-f97f3e67-73b1-4433-a65a-f24fa4877e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:55.542928 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1284/2582] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:59:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:59:55.559503 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1082f675-e28c-4a14-984a-f708e5455c9b None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:55.562215 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-1082f675-e28c-4a14-984a-f708e5455c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:55.582433 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1299/2583] 10.222.0.69 () {58 vars in 1009 bytes} [Thu Sep 8 13:59:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 13:59:55.622048 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f3e67-73b1-4433-a65a-f24fa4877e3d None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:55.624043 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-f97f3e67-73b1-4433-a65a-f24fa4877e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:55.692328 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1082f675-e28c-4a14-984a-f708e5455c9b None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:55.699237 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f700ae-eda8-42a0-8e02-a53481bcb65d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:55.700312 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f700ae-eda8-42a0-8e02-a53481bcb65d service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:55.700819 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f700ae-eda8-42a0-8e02-a53481bcb65d service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:55.701316 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f700ae-eda8-42a0-8e02-a53481bcb65d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:55.720560 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f700ae-eda8-42a0-8e02-a53481bcb65d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:55.723986 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f700ae-eda8-42a0-8e02-a53481bcb65d service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:55.739641 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f3e67-73b1-4433-a65a-f24fa4877e3d None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:55.745603 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1285/2584] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:59:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:59:55.750709 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3520dd-2c2a-4cb2-813f-f8c724b9eb2e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9b97592a6840c3865d7dcf886221e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:55.751939 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3520dd-2c2a-4cb2-813f-f8c724b9eb2e service swift] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:55.752644 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3520dd-2c2a-4cb2-813f-f8c724b9eb2e service swift] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:55.753043 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3520dd-2c2a-4cb2-813f-f8c724b9eb2e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:55.763670 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:55.773952 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3520dd-2c2a-4cb2-813f-f8c724b9eb2e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:55.776986 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3520dd-2c2a-4cb2-813f-f8c724b9eb2e service swift] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:55.797878 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1300/2585] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Sep 8 13:59:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 13:59:56.423530 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f700ae-eda8-42a0-8e02-a53481bcb65d service neutron] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:56.426612 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-c6f700ae-eda8-42a0-8e02-a53481bcb65d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:56.479937 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f700ae-eda8-42a0-8e02-a53481bcb65d service neutron] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:56.490969 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32cddd-d1a9-4207-b781-ef9aeae0da26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:56.492101 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32cddd-d1a9-4207-b781-ef9aeae0da26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:56.492539 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32cddd-d1a9-4207-b781-ef9aeae0da26 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:56.493010 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32cddd-d1a9-4207-b781-ef9aeae0da26 admin admin] PATH_INFO: `/v3/projects/f34ee16b1b8e4f5b9f0299c9bbede79b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:56.494883 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32cddd-d1a9-4207-b781-ef9aeae0da26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f34ee16b1b8e4f5b9f0299c9bbede79b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:56.497276 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32cddd-d1a9-4207-b781-ef9aeae0da26 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:56.587847 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:INSERT=1,keystone:SELECT=97,keystone:DELETE=2 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:56.619156 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-4e32cddd-d1a9-4207-b781-ef9aeae0da26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f34ee16b1b8e4f5b9f0299c9bbede79b', 'request_id': 'req-4e32cddd-d1a9-4207-b781-ef9aeae0da26'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:56.647450 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-4e32cddd-d1a9-4207-b781-ef9aeae0da26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f34ee16b1b8e4f5b9f0299c9bbede79b', 'request_id': 'req-4e32cddd-d1a9-4207-b781-ef9aeae0da26'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:56.664159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-4e32cddd-d1a9-4207-b781-ef9aeae0da26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f34ee16b1b8e4f5b9f0299c9bbede79b', 'request_id': 'req-4e32cddd-d1a9-4207-b781-ef9aeae0da26'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:56.690594 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-4e32cddd-d1a9-4207-b781-ef9aeae0da26 admin admin] The token cache is being invalidate because project f34ee16b1b8e4f5b9f0299c9bbede79b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:59:56.691072 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-4e32cddd-d1a9-4207-b781-ef9aeae0da26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:56.692209 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-4e32cddd-d1a9-4207-b781-ef9aeae0da26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:56.702162 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1286/2586] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:59:56 2022] DELETE /identity/v3/projects/f34ee16b1b8e4f5b9f0299c9bbede79b => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:59:56.703977 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3520dd-2c2a-4cb2-813f-f8c724b9eb2e service swift] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:56.728984 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3520dd-2c2a-4cb2-813f-f8c724b9eb2e service swift] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:56.866195 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60c915-4e45-43d3-8364-73c0069571f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:56.867352 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60c915-4e45-43d3-8364-73c0069571f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:56.867947 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60c915-4e45-43d3-8364-73c0069571f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:56.872859 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60c915-4e45-43d3-8364-73c0069571f8 admin admin] PATH_INFO: `/v3/users/f6c7b91a23c04b54919ec75a4019bf52` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:56.874863 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a60c915-4e45-43d3-8364-73c0069571f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6c7b91a23c04b54919ec75a4019bf52)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:56.878821 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a60c915-4e45-43d3-8364-73c0069571f8 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:56.990685 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-0a60c915-4e45-43d3-8364-73c0069571f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6c7b91a23c04b54919ec75a4019bf52'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:56.994693 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-0a60c915-4e45-43d3-8364-73c0069571f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6c7b91a23c04b54919ec75a4019bf52'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:56.995899 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-0a60c915-4e45-43d3-8364-73c0069571f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6c7b91a23c04b54919ec75a4019bf52'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:57.014770 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-0a60c915-4e45-43d3-8364-73c0069571f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6c7b91a23c04b54919ec75a4019bf52'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:57.046073 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-0a60c915-4e45-43d3-8364-73c0069571f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6c7b91a23c04b54919ec75a4019bf52'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:57.079978 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1301/2587] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:59:56 2022] DELETE /identity/v3/users/f6c7b91a23c04b54919ec75a4019bf52 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:59:57.709617 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32cddd-d1a9-4207-b781-ef9aeae0da26 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:57.712651 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-4e32cddd-d1a9-4207-b781-ef9aeae0da26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:57.768884 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32cddd-d1a9-4207-b781-ef9aeae0da26 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:57.922299 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017147ac-4fba-4117-addd-9aa3dc91cf3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:57.922882 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017147ac-4fba-4117-addd-9aa3dc91cf3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:57.923134 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017147ac-4fba-4117-addd-9aa3dc91cf3e admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:57.923597 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017147ac-4fba-4117-addd-9aa3dc91cf3e admin admin] PATH_INFO: `/v3/projects/bd0e73892c304a8898693efbfeb47d81` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:57.925802 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017147ac-4fba-4117-addd-9aa3dc91cf3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd0e73892c304a8898693efbfeb47d81)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:57.933267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017147ac-4fba-4117-addd-9aa3dc91cf3e admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:58.034298 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-017147ac-4fba-4117-addd-9aa3dc91cf3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd0e73892c304a8898693efbfeb47d81', 'request_id': 'req-017147ac-4fba-4117-addd-9aa3dc91cf3e'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:58.054224 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-017147ac-4fba-4117-addd-9aa3dc91cf3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd0e73892c304a8898693efbfeb47d81', 'request_id': 'req-017147ac-4fba-4117-addd-9aa3dc91cf3e'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:58.065166 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-017147ac-4fba-4117-addd-9aa3dc91cf3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd0e73892c304a8898693efbfeb47d81', 'request_id': 'req-017147ac-4fba-4117-addd-9aa3dc91cf3e'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:58.103811 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-017147ac-4fba-4117-addd-9aa3dc91cf3e admin admin] The token cache is being invalidate because project bd0e73892c304a8898693efbfeb47d81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 13:59:58.104308 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-017147ac-4fba-4117-addd-9aa3dc91cf3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:58.105497 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-017147ac-4fba-4117-addd-9aa3dc91cf3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:58.108306 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1287/2588] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 13:59:57 2022] DELETE /identity/v3/projects/bd0e73892c304a8898693efbfeb47d81 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:59:58.113405 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae83028-9740-4bd6-863d-a61f80068f9d None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:58.114035 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae83028-9740-4bd6-863d-a61f80068f9d None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:58.114394 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae83028-9740-4bd6-863d-a61f80068f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:58.139815 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-dae83028-9740-4bd6-863d-a61f80068f9d None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:59:58.141856 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-dae83028-9740-4bd6-863d-a61f80068f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:58.312912 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1302/2589] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:59:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:59:58.325456 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37413e-6609-4abb-bf5a-9325529e0c0e None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:58.325963 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37413e-6609-4abb-bf5a-9325529e0c0e None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:58.326676 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37413e-6609-4abb-bf5a-9325529e0c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:58.364225 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-0c37413e-6609-4abb-bf5a-9325529e0c0e None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:59:58.366463 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-0c37413e-6609-4abb-bf5a-9325529e0c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:58.388552 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1288/2590] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:59:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:59:58.389881 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae83028-9740-4bd6-863d-a61f80068f9d None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:58.411236 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae83028-9740-4bd6-863d-a61f80068f9d None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:58.427864 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e5891-c89b-4c7b-a679-d4b3d3d3eb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:58.428645 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e5891-c89b-4c7b-a679-d4b3d3d3eb25 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:58.429049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e5891-c89b-4c7b-a679-d4b3d3d3eb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:58.429505 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e5891-c89b-4c7b-a679-d4b3d3d3eb25 admin admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:58.433636 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8e5891-c89b-4c7b-a679-d4b3d3d3eb25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 13:59:58.434953 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8e5891-c89b-4c7b-a679-d4b3d3d3eb25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:58.438058 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8e5891-c89b-4c7b-a679-d4b3d3d3eb25 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:58.454963 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:58.464225 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1303/2591] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 13:59:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 13:59:58.466699 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37413e-6609-4abb-bf5a-9325529e0c0e None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:58.484268 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37413e-6609-4abb-bf5a-9325529e0c0e None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:58.493587 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a22a0b-e74e-4580-b214-ef2228ed1815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:58.494643 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a22a0b-e74e-4580-b214-ef2228ed1815 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:58.495228 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a22a0b-e74e-4580-b214-ef2228ed1815 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:58.495785 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a22a0b-e74e-4580-b214-ef2228ed1815 admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:58.496840 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a22a0b-e74e-4580-b214-ef2228ed1815 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:58.499897 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a22a0b-e74e-4580-b214-ef2228ed1815 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:58.567325 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1289/2592] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 13:59:58 2022] POST /identity/v3/projects => generated 371 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 13:59:58.578849 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e5891-c89b-4c7b-a679-d4b3d3d3eb25 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:58.597975 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e5891-c89b-4c7b-a679-d4b3d3d3eb25 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:58.726385 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa20fe8-af2b-4437-bca4-78b16b30dc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:58.727926 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa20fe8-af2b-4437-bca4-78b16b30dc7a admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:58.728672 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa20fe8-af2b-4437-bca4-78b16b30dc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:58.729415 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa20fe8-af2b-4437-bca4-78b16b30dc7a admin admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:58.730857 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa20fe8-af2b-4437-bca4-78b16b30dc7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:58.735434 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa20fe8-af2b-4437-bca4-78b16b30dc7a admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:58.787520 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1304/2593] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 13:59:58 2022] POST /identity/v3/users => generated 286 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 13:59:58.795608 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a22a0b-e74e-4580-b214-ef2228ed1815 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:58.819372 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a22a0b-e74e-4580-b214-ef2228ed1815 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:58.829025 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd3194-ce5e-42a8-a0eb-cef4cd212bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:58.830297 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd3194-ce5e-42a8-a0eb-cef4cd212bf9 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:58.830984 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd3194-ce5e-42a8-a0eb-cef4cd212bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:58.831495 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd3194-ce5e-42a8-a0eb-cef4cd212bf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:58.832729 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd3194-ce5e-42a8-a0eb-cef4cd212bf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:58.836312 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd3194-ce5e-42a8-a0eb-cef4cd212bf9 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:58.868194 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1290/2594] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:59:58.870142 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa20fe8-af2b-4437-bca4-78b16b30dc7a admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:58.897752 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa20fe8-af2b-4437-bca4-78b16b30dc7a admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:58.906705 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebddb0d2-0dd4-499b-94ac-c14291436b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:58.907834 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebddb0d2-0dd4-499b-94ac-c14291436b30 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:58.908371 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebddb0d2-0dd4-499b-94ac-c14291436b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:58.908912 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebddb0d2-0dd4-499b-94ac-c14291436b30 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:58.910123 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebddb0d2-0dd4-499b-94ac-c14291436b30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:58.915154 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebddb0d2-0dd4-499b-94ac-c14291436b30 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:58.941422 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1305/2595] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 13:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 13:59:58.947936 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd3194-ce5e-42a8-a0eb-cef4cd212bf9 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:58.968328 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd3194-ce5e-42a8-a0eb-cef4cd212bf9 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:58.977961 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7276a-381d-4003-89ab-378d729dbe43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:58.979831 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7276a-381d-4003-89ab-378d729dbe43 admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:58.980624 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7276a-381d-4003-89ab-378d729dbe43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:58.981433 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7276a-381d-4003-89ab-378d729dbe43 admin admin] PATH_INFO: `/v3/projects/18a05635c1964798bde25ab2844bff14/users/d5b45c8d22894a80af82c000126beae4/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:59.009882 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:59.021239 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b7276a-381d-4003-89ab-378d729dbe43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18a05635c1964798bde25ab2844bff14, user_id=d5b45c8d22894a80af82c000126beae4, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:59.028736 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b7276a-381d-4003-89ab-378d729dbe43 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:59.062289 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1291/2596] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 13:59:58 2022] PUT /identity/v3/projects/18a05635c1964798bde25ab2844bff14/users/d5b45c8d22894a80af82c000126beae4/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 13:59:59.079416 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eae7a4-051b-412f-9b4d-a20e0e655687 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:59.079715 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eae7a4-051b-412f-9b4d-a20e0e655687 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:59.079914 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eae7a4-051b-412f-9b4d-a20e0e655687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:59.141100 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-f8eae7a4-051b-412f-9b4d-a20e0e655687 None None] MFA Rules not processed for user `d5b45c8d22894a80af82c000126beae4`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:59:59.144082 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-f8eae7a4-051b-412f-9b4d-a20e0e655687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:59.338224 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1306/2597] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:59:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 13:59:59.357913 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7276a-381d-4003-89ab-378d729dbe43 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:59.360804 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-04b7276a-381d-4003-89ab-378d729dbe43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:59.455372 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7276a-381d-4003-89ab-378d729dbe43 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:59.460287 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8fb4d6-b57e-4d38-9bc3-e3306ffd088f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:59.460901 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8fb4d6-b57e-4d38-9bc3-e3306ffd088f service cinder] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:59.461177 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8fb4d6-b57e-4d38-9bc3-e3306ffd088f service cinder] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:59.461525 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8fb4d6-b57e-4d38-9bc3-e3306ffd088f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:59.476494 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8fb4d6-b57e-4d38-9bc3-e3306ffd088f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:59.478458 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8fb4d6-b57e-4d38-9bc3-e3306ffd088f service cinder] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:59.501959 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1292/2598] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 13:59:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 13:59:59.526989 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eae7a4-051b-412f-9b4d-a20e0e655687 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 13:59:59.657300 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eae7a4-051b-412f-9b4d-a20e0e655687 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 13:59:59.662665 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb9fe97-0d6d-498a-a825-c78242dd7d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 13:59:59.663617 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb9fe97-0d6d-498a-a825-c78242dd7d83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:59.664080 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb9fe97-0d6d-498a-a825-c78242dd7d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:59.664594 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb9fe97-0d6d-498a-a825-c78242dd7d83 admin admin] PATH_INFO: `/v3/users/d5b45c8d22894a80af82c000126beae4` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:59.668480 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb9fe97-0d6d-498a-a825-c78242dd7d83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5b45c8d22894a80af82c000126beae4)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 13:59:59.671129 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb9fe97-0d6d-498a-a825-c78242dd7d83 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 13:59:59.692314 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:59.767751 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-8eb9fe97-0d6d-498a-a825-c78242dd7d83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5b45c8d22894a80af82c000126beae4'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:59.768592 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-8eb9fe97-0d6d-498a-a825-c78242dd7d83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5b45c8d22894a80af82c000126beae4'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:59.769246 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-8eb9fe97-0d6d-498a-a825-c78242dd7d83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5b45c8d22894a80af82c000126beae4'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:59.783084 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-8eb9fe97-0d6d-498a-a825-c78242dd7d83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5b45c8d22894a80af82c000126beae4'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:59.810182 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-8eb9fe97-0d6d-498a-a825-c78242dd7d83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5b45c8d22894a80af82c000126beae4'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 13:59:59.831389 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1307/2599] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 13:59:59 2022] DELETE /identity/v3/users/d5b45c8d22894a80af82c000126beae4 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 13:59:59.842767 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7c067-7cc4-4466-abcc-a23fdee208c5 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 13:59:59.843677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7c067-7cc4-4466-abcc-a23fdee208c5 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 13:59:59.844112 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f7c067-7cc4-4466-abcc-a23fdee208c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 13:59:59.873573 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-d4f7c067-7cc4-4466-abcc-a23fdee208c5 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 13:59:59.875078 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-d4f7c067-7cc4-4466-abcc-a23fdee208c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 13:59:59.986053 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1293/2600] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 13:59:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:00:00.006917 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb9fe97-0d6d-498a-a825-c78242dd7d83 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:00.011247 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-8eb9fe97-0d6d-498a-a825-c78242dd7d83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:00.177155 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb9fe97-0d6d-498a-a825-c78242dd7d83 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:00.185871 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41645a48-ba3f-4c35-b607-868bff94323a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:00.187192 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41645a48-ba3f-4c35-b607-868bff94323a service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:00.187676 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41645a48-ba3f-4c35-b607-868bff94323a service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:00.188350 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41645a48-ba3f-4c35-b607-868bff94323a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:00.207107 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41645a48-ba3f-4c35-b607-868bff94323a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:00.210240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41645a48-ba3f-4c35-b607-868bff94323a service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:00.241974 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1308/2601] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:00:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:00:00.981709 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f7c067-7cc4-4466-abcc-a23fdee208c5 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:00.984146 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-d4f7c067-7cc4-4466-abcc-a23fdee208c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:01.009171 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f7c067-7cc4-4466-abcc-a23fdee208c5 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:01.024925 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4923c9-ed8a-47f4-ba1b-7bdf2da0ecf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:01.027850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4923c9-ed8a-47f4-ba1b-7bdf2da0ecf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:01.029127 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4923c9-ed8a-47f4-ba1b-7bdf2da0ecf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:01.029698 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4923c9-ed8a-47f4-ba1b-7bdf2da0ecf5 admin admin] PATH_INFO: `/v3/projects/18a05635c1964798bde25ab2844bff14` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:01.032148 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4923c9-ed8a-47f4-ba1b-7bdf2da0ecf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18a05635c1964798bde25ab2844bff14)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:01.037159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4923c9-ed8a-47f4-ba1b-7bdf2da0ecf5 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:01.161096 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-7f4923c9-ed8a-47f4-ba1b-7bdf2da0ecf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18a05635c1964798bde25ab2844bff14', 'request_id': 'req-7f4923c9-ed8a-47f4-ba1b-7bdf2da0ecf5'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:01.176453 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-7f4923c9-ed8a-47f4-ba1b-7bdf2da0ecf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18a05635c1964798bde25ab2844bff14', 'request_id': 'req-7f4923c9-ed8a-47f4-ba1b-7bdf2da0ecf5'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:01.188340 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-7f4923c9-ed8a-47f4-ba1b-7bdf2da0ecf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18a05635c1964798bde25ab2844bff14', 'request_id': 'req-7f4923c9-ed8a-47f4-ba1b-7bdf2da0ecf5'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:01.216452 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-7f4923c9-ed8a-47f4-ba1b-7bdf2da0ecf5 admin admin] The token cache is being invalidate because project 18a05635c1964798bde25ab2844bff14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:00:01.216993 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-7f4923c9-ed8a-47f4-ba1b-7bdf2da0ecf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:01.218743 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-7f4923c9-ed8a-47f4-ba1b-7bdf2da0ecf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:01.225467 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1294/2602] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 14:00:00 2022] DELETE /identity/v3/projects/18a05635c1964798bde25ab2844bff14 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:00:01.229745 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65a611-85da-44ca-867e-bce0716c4835 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:01.230520 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65a611-85da-44ca-867e-bce0716c4835 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:01.230772 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65a611-85da-44ca-867e-bce0716c4835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:01.279814 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-cf65a611-85da-44ca-867e-bce0716c4835 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:00:01.282644 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-cf65a611-85da-44ca-867e-bce0716c4835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:01.395780 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1309/2603] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:00:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:00:01.407036 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a16f2-d98d-49fb-8e83-c75faf0352da None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:01.407319 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a16f2-d98d-49fb-8e83-c75faf0352da None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:01.407622 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a16f2-d98d-49fb-8e83-c75faf0352da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:01.447263 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-3b6a16f2-d98d-49fb-8e83-c75faf0352da None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:00:01.448878 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-3b6a16f2-d98d-49fb-8e83-c75faf0352da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:01.463633 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1295/2604] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:00:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:00:01.468767 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65a611-85da-44ca-867e-bce0716c4835 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:01.481613 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65a611-85da-44ca-867e-bce0716c4835 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:01.486727 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815fe17-d600-4d23-826d-92e285cad6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:01.487347 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815fe17-d600-4d23-826d-92e285cad6e1 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:01.487689 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815fe17-d600-4d23-826d-92e285cad6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:01.487874 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815fe17-d600-4d23-826d-92e285cad6e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:01.488613 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e815fe17-d600-4d23-826d-92e285cad6e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:00:01.488854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e815fe17-d600-4d23-826d-92e285cad6e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:01.490664 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e815fe17-d600-4d23-826d-92e285cad6e1 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:01.519333 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1310/2605] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 14:00:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 14:00:01.520992 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a16f2-d98d-49fb-8e83-c75faf0352da None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:01.538929 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a16f2-d98d-49fb-8e83-c75faf0352da None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:01.549718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a72995-db5c-48b9-9c5f-130eba3661d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:01.550601 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a72995-db5c-48b9-9c5f-130eba3661d7 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:01.550917 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a72995-db5c-48b9-9c5f-130eba3661d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:01.551402 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a72995-db5c-48b9-9c5f-130eba3661d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:01.552616 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a72995-db5c-48b9-9c5f-130eba3661d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:01.557045 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a72995-db5c-48b9-9c5f-130eba3661d7 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:01.568482 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:01.616936 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1296/2606] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 14:00:01 2022] POST /identity/v3/projects => generated 361 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:00:01.622990 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815fe17-d600-4d23-826d-92e285cad6e1 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:01.645593 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815fe17-d600-4d23-826d-92e285cad6e1 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:01.667896 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:01.817972 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ecc3a-157d-4acb-a7a2-d81ee88be564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:01.818869 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ecc3a-157d-4acb-a7a2-d81ee88be564 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:01.819539 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ecc3a-157d-4acb-a7a2-d81ee88be564 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:01.820037 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ecc3a-157d-4acb-a7a2-d81ee88be564 admin admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:01.822214 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ecc3a-157d-4acb-a7a2-d81ee88be564 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:01.825997 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ecc3a-157d-4acb-a7a2-d81ee88be564 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:01.875915 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1311/2607] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 14:00:01 2022] POST /identity/v3/users => generated 281 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:00:01.881300 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a72995-db5c-48b9-9c5f-130eba3661d7 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:01.903019 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a72995-db5c-48b9-9c5f-130eba3661d7 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:01.914717 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948c67f-5377-460a-b1d7-3bf8cd08f3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:01.916907 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948c67f-5377-460a-b1d7-3bf8cd08f3dc admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:01.917631 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948c67f-5377-460a-b1d7-3bf8cd08f3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:01.918854 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948c67f-5377-460a-b1d7-3bf8cd08f3dc admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:01.919771 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f948c67f-5377-460a-b1d7-3bf8cd08f3dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:01.923094 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f948c67f-5377-460a-b1d7-3bf8cd08f3dc admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:01.951578 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1297/2608] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 14:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:00:01.953503 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ecc3a-157d-4acb-a7a2-d81ee88be564 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:01.977680 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ecc3a-157d-4acb-a7a2-d81ee88be564 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:01.989001 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d70859-4b60-46a8-ad69-6aa7f4358ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:01.990329 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d70859-4b60-46a8-ad69-6aa7f4358ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:01.990862 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d70859-4b60-46a8-ad69-6aa7f4358ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:01.991267 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d70859-4b60-46a8-ad69-6aa7f4358ec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:01.992517 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d70859-4b60-46a8-ad69-6aa7f4358ec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:01.995743 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d70859-4b60-46a8-ad69-6aa7f4358ec0 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:02.021648 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1312/2609] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 14:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:00:02.028956 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948c67f-5377-460a-b1d7-3bf8cd08f3dc admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:02.060731 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948c67f-5377-460a-b1d7-3bf8cd08f3dc admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:02.076258 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acae6a3-18a3-43fd-8851-22d0c3b53540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:02.078148 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acae6a3-18a3-43fd-8851-22d0c3b53540 admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:02.078972 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acae6a3-18a3-43fd-8851-22d0c3b53540 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:02.079688 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acae6a3-18a3-43fd-8851-22d0c3b53540 admin admin] PATH_INFO: `/v3/projects/db0f0c1c64214780a7f74e1a41f7e2e9/users/8f1c5b58e90a47caad92ddfd194300d0/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:02.132090 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acae6a3-18a3-43fd-8851-22d0c3b53540 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db0f0c1c64214780a7f74e1a41f7e2e9, user_id=8f1c5b58e90a47caad92ddfd194300d0, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:02.138114 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acae6a3-18a3-43fd-8851-22d0c3b53540 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:02.173289 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1298/2610] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 14:00:02 2022] PUT /identity/v3/projects/db0f0c1c64214780a7f74e1a41f7e2e9/users/8f1c5b58e90a47caad92ddfd194300d0/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:00:02.194535 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59126c98-0884-49e2-9682-3f45f96efc3d None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:02.195424 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59126c98-0884-49e2-9682-3f45f96efc3d None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:02.196245 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59126c98-0884-49e2-9682-3f45f96efc3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:02.268729 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-59126c98-0884-49e2-9682-3f45f96efc3d None None] MFA Rules not processed for user `8f1c5b58e90a47caad92ddfd194300d0`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:00:02.272215 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-59126c98-0884-49e2-9682-3f45f96efc3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:02.471996 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1313/2611] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:00:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:00:02.534262 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acae6a3-18a3-43fd-8851-22d0c3b53540 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:02.537144 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-7acae6a3-18a3-43fd-8851-22d0c3b53540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:02.673278 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acae6a3-18a3-43fd-8851-22d0c3b53540 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:02.679880 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6103fa-a362-4c37-b98a-c1f23e22d7fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:02.681466 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6103fa-a362-4c37-b98a-c1f23e22d7fa service cinder] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:02.681982 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6103fa-a362-4c37-b98a-c1f23e22d7fa service cinder] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:02.682482 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6103fa-a362-4c37-b98a-c1f23e22d7fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:02.703216 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6103fa-a362-4c37-b98a-c1f23e22d7fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:02.706768 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6103fa-a362-4c37-b98a-c1f23e22d7fa service cinder] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:02.733482 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1299/2612] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:00:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:00:02.758626 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59126c98-0884-49e2-9682-3f45f96efc3d None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:02.910718 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59126c98-0884-49e2-9682-3f45f96efc3d None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:02.920326 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea511aea-2eb5-4ab0-b894-c51cb1e6c2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:02.921454 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea511aea-2eb5-4ab0-b894-c51cb1e6c2d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:02.921951 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea511aea-2eb5-4ab0-b894-c51cb1e6c2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:02.922440 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea511aea-2eb5-4ab0-b894-c51cb1e6c2d5 admin admin] PATH_INFO: `/v3/users/8f1c5b58e90a47caad92ddfd194300d0` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:02.924569 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea511aea-2eb5-4ab0-b894-c51cb1e6c2d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f1c5b58e90a47caad92ddfd194300d0)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:02.928749 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea511aea-2eb5-4ab0-b894-c51cb1e6c2d5 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:03.045245 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:03.120376 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-ea511aea-2eb5-4ab0-b894-c51cb1e6c2d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f1c5b58e90a47caad92ddfd194300d0'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:03.121707 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-ea511aea-2eb5-4ab0-b894-c51cb1e6c2d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f1c5b58e90a47caad92ddfd194300d0'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:03.122765 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-ea511aea-2eb5-4ab0-b894-c51cb1e6c2d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f1c5b58e90a47caad92ddfd194300d0'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:03.144769 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-ea511aea-2eb5-4ab0-b894-c51cb1e6c2d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f1c5b58e90a47caad92ddfd194300d0'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:03.201511 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-ea511aea-2eb5-4ab0-b894-c51cb1e6c2d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f1c5b58e90a47caad92ddfd194300d0'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:03.238246 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1314/2613] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 14:00:02 2022] DELETE /identity/v3/users/8f1c5b58e90a47caad92ddfd194300d0 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:00:03.245090 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce01a70-56b5-4ae2-acba-50bb036f71ba None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:03.246081 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce01a70-56b5-4ae2-acba-50bb036f71ba None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:03.246081 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce01a70-56b5-4ae2-acba-50bb036f71ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:03.338680 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-7ce01a70-56b5-4ae2-acba-50bb036f71ba None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:00:03.341208 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-7ce01a70-56b5-4ae2-acba-50bb036f71ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:03.522329 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1300/2614] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:00:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:00:03.531759 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea511aea-2eb5-4ab0-b894-c51cb1e6c2d5 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:03.535386 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-ea511aea-2eb5-4ab0-b894-c51cb1e6c2d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:03.656650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea511aea-2eb5-4ab0-b894-c51cb1e6c2d5 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:03.668347 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3e44d0-4104-4b8e-8c3d-01de1645dd01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:03.670221 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e44d0-4104-4b8e-8c3d-01de1645dd01 service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:03.670691 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e44d0-4104-4b8e-8c3d-01de1645dd01 service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:03.674027 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3e44d0-4104-4b8e-8c3d-01de1645dd01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:03.701986 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3e44d0-4104-4b8e-8c3d-01de1645dd01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:03.705597 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3e44d0-4104-4b8e-8c3d-01de1645dd01 service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:03.730514 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1315/2615] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:00:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:00:04.604736 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce01a70-56b5-4ae2-acba-50bb036f71ba None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:04.607605 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-7ce01a70-56b5-4ae2-acba-50bb036f71ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:04.625309 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce01a70-56b5-4ae2-acba-50bb036f71ba None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:04.634714 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018adc3b-e137-4012-80b7-2da63b783d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:04.636084 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018adc3b-e137-4012-80b7-2da63b783d2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:04.636699 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018adc3b-e137-4012-80b7-2da63b783d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:04.637230 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018adc3b-e137-4012-80b7-2da63b783d2a admin admin] PATH_INFO: `/v3/projects/db0f0c1c64214780a7f74e1a41f7e2e9` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:04.644718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018adc3b-e137-4012-80b7-2da63b783d2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=db0f0c1c64214780a7f74e1a41f7e2e9)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:04.650937 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018adc3b-e137-4012-80b7-2da63b783d2a admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:04.787091 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-018adc3b-e137-4012-80b7-2da63b783d2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db0f0c1c64214780a7f74e1a41f7e2e9', 'request_id': 'req-018adc3b-e137-4012-80b7-2da63b783d2a'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:04.789000 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:04.800098 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-018adc3b-e137-4012-80b7-2da63b783d2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db0f0c1c64214780a7f74e1a41f7e2e9', 'request_id': 'req-018adc3b-e137-4012-80b7-2da63b783d2a'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:04.809841 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-018adc3b-e137-4012-80b7-2da63b783d2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db0f0c1c64214780a7f74e1a41f7e2e9', 'request_id': 'req-018adc3b-e137-4012-80b7-2da63b783d2a'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:04.830471 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-018adc3b-e137-4012-80b7-2da63b783d2a admin admin] The token cache is being invalidate because project db0f0c1c64214780a7f74e1a41f7e2e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:00:04.830955 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-018adc3b-e137-4012-80b7-2da63b783d2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:04.831692 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-018adc3b-e137-4012-80b7-2da63b783d2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:04.834322 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1301/2616] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 14:00:04 2022] DELETE /identity/v3/projects/db0f0c1c64214780a7f74e1a41f7e2e9 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:00:04.841985 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a4c6b-0219-4000-8dcc-04afa5039622 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:04.842820 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a4c6b-0219-4000-8dcc-04afa5039622 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:04.842820 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a4c6b-0219-4000-8dcc-04afa5039622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:04.872251 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-8e6a4c6b-0219-4000-8dcc-04afa5039622 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:00:04.873540 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-8e6a4c6b-0219-4000-8dcc-04afa5039622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:05.068874 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1316/2617] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:00:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:00:05.072379 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165d98f-670e-48b8-96a9-5146186ca904 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:05.073193 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165d98f-670e-48b8-96a9-5146186ca904 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:05.073951 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165d98f-670e-48b8-96a9-5146186ca904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:05.121526 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-9165d98f-670e-48b8-96a9-5146186ca904 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:00:05.123990 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-9165d98f-670e-48b8-96a9-5146186ca904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:05.150343 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6a4c6b-0219-4000-8dcc-04afa5039622 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:05.159697 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1302/2618] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:00:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:00:05.170072 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6a4c6b-0219-4000-8dcc-04afa5039622 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:05.178418 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14605a-5020-4db6-a2c2-49aecfcddc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:05.179432 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14605a-5020-4db6-a2c2-49aecfcddc16 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:05.179934 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14605a-5020-4db6-a2c2-49aecfcddc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:05.181279 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14605a-5020-4db6-a2c2-49aecfcddc16 admin admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:05.182583 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14605a-5020-4db6-a2c2-49aecfcddc16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:00:05.183323 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14605a-5020-4db6-a2c2-49aecfcddc16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:05.186468 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14605a-5020-4db6-a2c2-49aecfcddc16 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:05.221611 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1317/2619] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 14:00:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 14:00:05.221945 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165d98f-670e-48b8-96a9-5146186ca904 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:05.263964 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165d98f-670e-48b8-96a9-5146186ca904 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:05.281099 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f76c73c-8a2b-441a-9774-4602e1bc1725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:05.282403 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76c73c-8a2b-441a-9774-4602e1bc1725 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:05.287875 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76c73c-8a2b-441a-9774-4602e1bc1725 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:05.287875 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f76c73c-8a2b-441a-9774-4602e1bc1725 admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:05.287875 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f76c73c-8a2b-441a-9774-4602e1bc1725 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:05.290581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f76c73c-8a2b-441a-9774-4602e1bc1725 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:05.358768 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1303/2620] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 14:00:05 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:00:05.360697 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14605a-5020-4db6-a2c2-49aecfcddc16 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:05.380152 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14605a-5020-4db6-a2c2-49aecfcddc16 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:05.481685 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:05.545521 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb83fa-9358-49d4-9e2c-438fc0f1e985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:05.546873 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb83fa-9358-49d4-9e2c-438fc0f1e985 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:05.547778 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb83fa-9358-49d4-9e2c-438fc0f1e985 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:05.548220 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb83fa-9358-49d4-9e2c-438fc0f1e985 admin admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:05.549397 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb83fa-9358-49d4-9e2c-438fc0f1e985 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:05.552196 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb83fa-9358-49d4-9e2c-438fc0f1e985 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:05.608357 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1318/2621] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 14:00:05 2022] POST /identity/v3/users => generated 286 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:00:05.614212 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f76c73c-8a2b-441a-9774-4602e1bc1725 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:05.631125 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f76c73c-8a2b-441a-9774-4602e1bc1725 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:05.637975 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de463deb-e281-4633-aa63-e169a92b0538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:05.640084 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de463deb-e281-4633-aa63-e169a92b0538 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:05.640565 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de463deb-e281-4633-aa63-e169a92b0538 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:05.641090 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de463deb-e281-4633-aa63-e169a92b0538 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:05.643489 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de463deb-e281-4633-aa63-e169a92b0538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:05.647103 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de463deb-e281-4633-aa63-e169a92b0538 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:05.671418 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1304/2622] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 14:00:05 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:00:05.677857 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb83fa-9358-49d4-9e2c-438fc0f1e985 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:05.698220 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb83fa-9358-49d4-9e2c-438fc0f1e985 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:05.713280 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6cdd49-02a5-4c6f-a25b-5a24ac160be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:05.714438 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cdd49-02a5-4c6f-a25b-5a24ac160be2 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:05.714914 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cdd49-02a5-4c6f-a25b-5a24ac160be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:05.715451 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cdd49-02a5-4c6f-a25b-5a24ac160be2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:05.716731 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6cdd49-02a5-4c6f-a25b-5a24ac160be2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:05.720078 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6cdd49-02a5-4c6f-a25b-5a24ac160be2 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:05.759995 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1319/2623] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 14:00:05 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:00:05.767913 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de463deb-e281-4633-aa63-e169a92b0538 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:05.787160 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de463deb-e281-4633-aa63-e169a92b0538 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:05.794948 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0fc106-0d0d-4ec9-9076-03b1526fbb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:05.795839 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fc106-0d0d-4ec9-9076-03b1526fbb54 admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:05.796125 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fc106-0d0d-4ec9-9076-03b1526fbb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:05.796368 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fc106-0d0d-4ec9-9076-03b1526fbb54 admin admin] PATH_INFO: `/v3/projects/6c8b3f06c77e4dc8b8c4beb60659badf/users/9a9fdba4bebc417ea6f462dc3a45ed83/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:05.842925 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0fc106-0d0d-4ec9-9076-03b1526fbb54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c8b3f06c77e4dc8b8c4beb60659badf, user_id=9a9fdba4bebc417ea6f462dc3a45ed83, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:05.848195 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0fc106-0d0d-4ec9-9076-03b1526fbb54 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:05.881801 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1305/2624] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 14:00:05 2022] PUT /identity/v3/projects/6c8b3f06c77e4dc8b8c4beb60659badf/users/9a9fdba4bebc417ea6f462dc3a45ed83/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:00:05.900960 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e6595-6b4b-4fc7-bebf-953d4dacaeba None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:05.903034 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e6595-6b4b-4fc7-bebf-953d4dacaeba None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:05.903034 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e6595-6b4b-4fc7-bebf-953d4dacaeba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:05.960564 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-2d9e6595-6b4b-4fc7-bebf-953d4dacaeba None None] MFA Rules not processed for user `9a9fdba4bebc417ea6f462dc3a45ed83`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:00:05.962981 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-2d9e6595-6b4b-4fc7-bebf-953d4dacaeba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:06.129655 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1320/2625] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:00:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:00:06.152726 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0fc106-0d0d-4ec9-9076-03b1526fbb54 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:06.156032 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-cb0fc106-0d0d-4ec9-9076-03b1526fbb54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:06.350287 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0fc106-0d0d-4ec9-9076-03b1526fbb54 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:06.358635 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b019fd1-46d9-41d4-b5ed-eba6b371cbbc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6677b4518c094636bc8ed7b588103390', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:06.369423 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b019fd1-46d9-41d4-b5ed-eba6b371cbbc service glance] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:06.369899 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b019fd1-46d9-41d4-b5ed-eba6b371cbbc service glance] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:06.370411 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b019fd1-46d9-41d4-b5ed-eba6b371cbbc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:06.399219 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b019fd1-46d9-41d4-b5ed-eba6b371cbbc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:06.402109 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b019fd1-46d9-41d4-b5ed-eba6b371cbbc service glance] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:06.420850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1306/2626] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:00:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:00:09.936289 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e6595-6b4b-4fc7-bebf-953d4dacaeba None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:09.938312 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-2d9e6595-6b4b-4fc7-bebf-953d4dacaeba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:10.120505 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e6595-6b4b-4fc7-bebf-953d4dacaeba None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:10.135665 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d71249-fd87-4f7d-a255-d0994658fef7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733797f12a1741e1a55332991e867aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:10.136490 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d71249-fd87-4f7d-a255-d0994658fef7 service placement] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:10.136866 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d71249-fd87-4f7d-a255-d0994658fef7 service placement] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:10.137337 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d71249-fd87-4f7d-a255-d0994658fef7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:10.139865 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-d5d71249-fd87-4f7d-a255-d0994658fef7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:10.163203 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d71249-fd87-4f7d-a255-d0994658fef7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:10.167214 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d71249-fd87-4f7d-a255-d0994658fef7 service placement] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:10.188518 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1321/2627] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:00:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:00:16.414029 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=59,keystone:DELETE=3,keystone:INSERT=3 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:20.178431 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=91,keystone:INSERT=3 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:21.718785 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd11aa1-978c-45ee-919d-e3c4d6ef6995 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:21.719561 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd11aa1-978c-45ee-919d-e3c4d6ef6995 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:21.719973 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd11aa1-978c-45ee-919d-e3c4d6ef6995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:21.758512 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-ddd11aa1-978c-45ee-919d-e3c4d6ef6995 None None] MFA Rules not processed for user `6d2dd101d1a14e5ab95f272ab1bbeb94`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:00:21.761243 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-ddd11aa1-978c-45ee-919d-e3c4d6ef6995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:21.889824 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1307/2628] 10.222.0.69 () {58 vars in 1009 bytes} [Thu Sep 8 14:00:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:00:21.903802 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d71249-fd87-4f7d-a255-d0994658fef7 service placement] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:21.906135 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-d5d71249-fd87-4f7d-a255-d0994658fef7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:22.112567 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d71249-fd87-4f7d-a255-d0994658fef7 service placement] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:22.128103 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94134333-3e0e-4f80-b2b7-4a695e111407 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9b97592a6840c3865d7dcf886221e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:22.131458 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94134333-3e0e-4f80-b2b7-4a695e111407 service swift] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:22.132117 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94134333-3e0e-4f80-b2b7-4a695e111407 service swift] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:22.133191 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94134333-3e0e-4f80-b2b7-4a695e111407 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:22.157578 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94134333-3e0e-4f80-b2b7-4a695e111407 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:22.165228 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94134333-3e0e-4f80-b2b7-4a695e111407 service swift] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:22.188745 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1322/2629] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Sep 8 14:00:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 08 14:00:31.791336 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd11aa1-978c-45ee-919d-e3c4d6ef6995 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:31.793604 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-ddd11aa1-978c-45ee-919d-e3c4d6ef6995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:31.886030 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd11aa1-978c-45ee-919d-e3c4d6ef6995 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:31.891257 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579edd74-0b41-42bf-a5ab-514f3d143768 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:31.892214 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579edd74-0b41-42bf-a5ab-514f3d143768 service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:31.892675 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579edd74-0b41-42bf-a5ab-514f3d143768 service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:31.893347 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579edd74-0b41-42bf-a5ab-514f3d143768 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:31.901509 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-579edd74-0b41-42bf-a5ab-514f3d143768 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:31.996117 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579edd74-0b41-42bf-a5ab-514f3d143768 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:31.997619 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579edd74-0b41-42bf-a5ab-514f3d143768 service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:32.011473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1308/2630] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:00:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:00:32.181640 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=32 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:32.955928 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94134333-3e0e-4f80-b2b7-4a695e111407 service swift] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:32.971600 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94134333-3e0e-4f80-b2b7-4a695e111407 service swift] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:32.979104 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7d5be-0b7a-4ade-8d81-5349ad7f4b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:32.980042 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7d5be-0b7a-4ade-8d81-5349ad7f4b88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:32.980388 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7d5be-0b7a-4ade-8d81-5349ad7f4b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:32.981104 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7d5be-0b7a-4ade-8d81-5349ad7f4b88 admin admin] PATH_INFO: `/v3/users/9a9fdba4bebc417ea6f462dc3a45ed83` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:32.983188 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb7d5be-0b7a-4ade-8d81-5349ad7f4b88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a9fdba4bebc417ea6f462dc3a45ed83)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:32.985678 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb7d5be-0b7a-4ade-8d81-5349ad7f4b88 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:33.079124 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-dbb7d5be-0b7a-4ade-8d81-5349ad7f4b88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a9fdba4bebc417ea6f462dc3a45ed83'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:33.079991 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-dbb7d5be-0b7a-4ade-8d81-5349ad7f4b88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a9fdba4bebc417ea6f462dc3a45ed83'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:33.080679 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-dbb7d5be-0b7a-4ade-8d81-5349ad7f4b88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a9fdba4bebc417ea6f462dc3a45ed83'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:33.092152 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-dbb7d5be-0b7a-4ade-8d81-5349ad7f4b88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a9fdba4bebc417ea6f462dc3a45ed83'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:33.112826 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-dbb7d5be-0b7a-4ade-8d81-5349ad7f4b88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a9fdba4bebc417ea6f462dc3a45ed83'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:33.134815 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1323/2631] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 14:00:32 2022] DELETE /identity/v3/users/9a9fdba4bebc417ea6f462dc3a45ed83 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:00:33.142003 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85873574-32ab-4a87-885c-8d187e554923 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:33.142857 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85873574-32ab-4a87-885c-8d187e554923 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:33.143005 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85873574-32ab-4a87-885c-8d187e554923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:33.176494 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-85873574-32ab-4a87-885c-8d187e554923 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:00:33.178675 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-85873574-32ab-4a87-885c-8d187e554923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:33.272270 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:33.302485 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1309/2632] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:00:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:00:33.319633 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7d5be-0b7a-4ade-8d81-5349ad7f4b88 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:33.321932 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-dbb7d5be-0b7a-4ade-8d81-5349ad7f4b88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:33.419514 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7d5be-0b7a-4ade-8d81-5349ad7f4b88 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:33.427218 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141723e4-eb5b-45cf-ab65-9617151e060b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:33.428489 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141723e4-eb5b-45cf-ab65-9617151e060b service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:33.429189 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141723e4-eb5b-45cf-ab65-9617151e060b service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:33.429946 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141723e4-eb5b-45cf-ab65-9617151e060b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:33.452385 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141723e4-eb5b-45cf-ab65-9617151e060b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:33.455384 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141723e4-eb5b-45cf-ab65-9617151e060b service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:33.479174 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1324/2633] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:00:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:00:34.203715 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85873574-32ab-4a87-885c-8d187e554923 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:34.207981 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-85873574-32ab-4a87-885c-8d187e554923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:34.243220 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85873574-32ab-4a87-885c-8d187e554923 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:34.261187 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c41ed69-c5b2-41a9-a27f-596b7fc2991f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:34.262726 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41ed69-c5b2-41a9-a27f-596b7fc2991f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:34.263440 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41ed69-c5b2-41a9-a27f-596b7fc2991f admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:34.263967 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41ed69-c5b2-41a9-a27f-596b7fc2991f admin admin] PATH_INFO: `/v3/projects/6c8b3f06c77e4dc8b8c4beb60659badf` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:34.267305 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c41ed69-c5b2-41a9-a27f-596b7fc2991f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c8b3f06c77e4dc8b8c4beb60659badf)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:34.270619 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c41ed69-c5b2-41a9-a27f-596b7fc2991f admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:34.379909 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-2c41ed69-c5b2-41a9-a27f-596b7fc2991f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c8b3f06c77e4dc8b8c4beb60659badf', 'request_id': 'req-2c41ed69-c5b2-41a9-a27f-596b7fc2991f'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:34.394000 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-2c41ed69-c5b2-41a9-a27f-596b7fc2991f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c8b3f06c77e4dc8b8c4beb60659badf', 'request_id': 'req-2c41ed69-c5b2-41a9-a27f-596b7fc2991f'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:34.407558 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-2c41ed69-c5b2-41a9-a27f-596b7fc2991f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c8b3f06c77e4dc8b8c4beb60659badf', 'request_id': 'req-2c41ed69-c5b2-41a9-a27f-596b7fc2991f'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:34.433803 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-2c41ed69-c5b2-41a9-a27f-596b7fc2991f admin admin] The token cache is being invalidate because project 6c8b3f06c77e4dc8b8c4beb60659badf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:00:34.434706 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-2c41ed69-c5b2-41a9-a27f-596b7fc2991f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:34.438034 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-2c41ed69-c5b2-41a9-a27f-596b7fc2991f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:34.443554 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1310/2634] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 14:00:34 2022] DELETE /identity/v3/projects/6c8b3f06c77e4dc8b8c4beb60659badf => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:00:34.451630 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec6c80-3116-4537-a7cb-199d448e1455 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:34.452458 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec6c80-3116-4537-a7cb-199d448e1455 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:34.452624 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec6c80-3116-4537-a7cb-199d448e1455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:34.505183 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-8aec6c80-3116-4537-a7cb-199d448e1455 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:00:34.508385 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-8aec6c80-3116-4537-a7cb-199d448e1455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:34.639878 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1325/2635] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:00:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:00:34.727159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727aa52-16e6-42db-870d-d3ca58764074 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:34.727651 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727aa52-16e6-42db-870d-d3ca58764074 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:34.728127 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727aa52-16e6-42db-870d-d3ca58764074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:34.771316 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-2727aa52-16e6-42db-870d-d3ca58764074 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:00:34.772575 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-2727aa52-16e6-42db-870d-d3ca58764074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:34.785417 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1311/2636] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:00:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:00:34.788579 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec6c80-3116-4537-a7cb-199d448e1455 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:34.801837 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec6c80-3116-4537-a7cb-199d448e1455 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:34.809798 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8ce31-2bf6-4fd7-8142-46aa6ad47f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:34.810713 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8ce31-2bf6-4fd7-8142-46aa6ad47f25 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:34.810713 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8ce31-2bf6-4fd7-8142-46aa6ad47f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:34.811078 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8ce31-2bf6-4fd7-8142-46aa6ad47f25 admin admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:34.811644 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c8ce31-2bf6-4fd7-8142-46aa6ad47f25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:00:34.811920 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c8ce31-2bf6-4fd7-8142-46aa6ad47f25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:34.813721 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c8ce31-2bf6-4fd7-8142-46aa6ad47f25 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:34.829288 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1326/2637] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 14:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:00:34.834497 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727aa52-16e6-42db-870d-d3ca58764074 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:34.854435 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727aa52-16e6-42db-870d-d3ca58764074 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:34.868434 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3781ed-0844-46f1-ba92-5c18952b79d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:34.869741 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3781ed-0844-46f1-ba92-5c18952b79d1 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:34.870488 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3781ed-0844-46f1-ba92-5c18952b79d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:34.870997 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3781ed-0844-46f1-ba92-5c18952b79d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:34.872307 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3781ed-0844-46f1-ba92-5c18952b79d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:34.881441 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3781ed-0844-46f1-ba92-5c18952b79d1 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:34.957583 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1312/2638] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 14:00:34 2022] POST /identity/v3/projects => generated 371 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:00:34.965273 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8ce31-2bf6-4fd7-8142-46aa6ad47f25 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:34.974925 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:34.991063 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8ce31-2bf6-4fd7-8142-46aa6ad47f25 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:35.137470 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d52a6-052b-49cc-a02a-16ff43df9ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:35.138725 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d52a6-052b-49cc-a02a-16ff43df9ebd admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:35.138961 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d52a6-052b-49cc-a02a-16ff43df9ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:35.139336 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d52a6-052b-49cc-a02a-16ff43df9ebd admin admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:35.140625 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d52a6-052b-49cc-a02a-16ff43df9ebd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:35.144223 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d52a6-052b-49cc-a02a-16ff43df9ebd admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:35.191630 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1327/2639] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 14:00:34 2022] POST /identity/v3/users => generated 286 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:00:35.193211 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3781ed-0844-46f1-ba92-5c18952b79d1 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:35.219346 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3781ed-0844-46f1-ba92-5c18952b79d1 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:35.238607 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c6fb8-9d8b-4434-a4de-7f619949be7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:35.240886 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c6fb8-9d8b-4434-a4de-7f619949be7c admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:35.242437 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c6fb8-9d8b-4434-a4de-7f619949be7c admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:35.243849 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c6fb8-9d8b-4434-a4de-7f619949be7c admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:35.246189 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14c6fb8-9d8b-4434-a4de-7f619949be7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:35.267276 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14c6fb8-9d8b-4434-a4de-7f619949be7c admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:35.299785 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1313/2640] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 14:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:00:35.315279 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d52a6-052b-49cc-a02a-16ff43df9ebd admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:35.347905 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d52a6-052b-49cc-a02a-16ff43df9ebd admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:35.360471 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccfdb1d-50ad-4b1f-a196-f3d221900380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:35.361534 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccfdb1d-50ad-4b1f-a196-f3d221900380 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:35.361960 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccfdb1d-50ad-4b1f-a196-f3d221900380 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:35.362268 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccfdb1d-50ad-4b1f-a196-f3d221900380 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:35.363112 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccfdb1d-50ad-4b1f-a196-f3d221900380 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:35.366290 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccfdb1d-50ad-4b1f-a196-f3d221900380 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:35.398818 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1328/2641] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 14:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:00:35.402636 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c6fb8-9d8b-4434-a4de-7f619949be7c admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:35.430997 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c6fb8-9d8b-4434-a4de-7f619949be7c admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:35.447047 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cdea2f-35b6-422e-b117-cddb11fb8644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:35.448833 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdea2f-35b6-422e-b117-cddb11fb8644 admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:35.449937 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdea2f-35b6-422e-b117-cddb11fb8644 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:35.450390 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdea2f-35b6-422e-b117-cddb11fb8644 admin admin] PATH_INFO: `/v3/projects/4cbc88f5936344229cbb299956148b70/users/40cece5cf73c4d6cb3df5276101b4ff0/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:35.493419 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cdea2f-35b6-422e-b117-cddb11fb8644 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cbc88f5936344229cbb299956148b70, user_id=40cece5cf73c4d6cb3df5276101b4ff0, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:35.499516 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cdea2f-35b6-422e-b117-cddb11fb8644 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:35.537501 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1314/2642] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 14:00:35 2022] PUT /identity/v3/projects/4cbc88f5936344229cbb299956148b70/users/40cece5cf73c4d6cb3df5276101b4ff0/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:00:35.556951 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5d2f6-c56a-4293-9b50-e847af4bb8a6 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:35.557976 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5d2f6-c56a-4293-9b50-e847af4bb8a6 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:35.557976 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5d2f6-c56a-4293-9b50-e847af4bb8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:35.612448 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-7ee5d2f6-c56a-4293-9b50-e847af4bb8a6 None None] MFA Rules not processed for user `40cece5cf73c4d6cb3df5276101b4ff0`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:00:35.614558 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-7ee5d2f6-c56a-4293-9b50-e847af4bb8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:35.804092 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1329/2643] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:00:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:00:35.825853 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cdea2f-35b6-422e-b117-cddb11fb8644 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:35.839534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-d9cdea2f-35b6-422e-b117-cddb11fb8644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:35.976861 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cdea2f-35b6-422e-b117-cddb11fb8644 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:35.982290 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdc9fab-5006-409e-b520-5072ac6b4fbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:35.983218 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc9fab-5006-409e-b520-5072ac6b4fbb service cinder] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:35.984350 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc9fab-5006-409e-b520-5072ac6b4fbb service cinder] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:35.984350 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc9fab-5006-409e-b520-5072ac6b4fbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:36.009452 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdc9fab-5006-409e-b520-5072ac6b4fbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:36.013273 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdc9fab-5006-409e-b520-5072ac6b4fbb service cinder] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:36.048861 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1315/2644] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:00:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:00:38.464737 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5d2f6-c56a-4293-9b50-e847af4bb8a6 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:38.469117 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-7ee5d2f6-c56a-4293-9b50-e847af4bb8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:38.687885 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5d2f6-c56a-4293-9b50-e847af4bb8a6 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:38.699622 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c5058-c3e9-4760-b65c-6caf9badb059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:38.702229 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c5058-c3e9-4760-b65c-6caf9badb059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:38.702862 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c5058-c3e9-4760-b65c-6caf9badb059 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:38.703410 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c5058-c3e9-4760-b65c-6caf9badb059 admin admin] PATH_INFO: `/v3/users/75cd9652625a4935a9af31bd4549ccf1` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:38.707921 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c5058-c3e9-4760-b65c-6caf9badb059 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75cd9652625a4935a9af31bd4549ccf1)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:38.715008 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c5058-c3e9-4760-b65c-6caf9badb059 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:38.760839 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:38.868458 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-836c5058-c3e9-4760-b65c-6caf9badb059 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75cd9652625a4935a9af31bd4549ccf1'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:38.870955 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-836c5058-c3e9-4760-b65c-6caf9badb059 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75cd9652625a4935a9af31bd4549ccf1'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:38.873273 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-836c5058-c3e9-4760-b65c-6caf9badb059 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75cd9652625a4935a9af31bd4549ccf1'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:38.923806 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-836c5058-c3e9-4760-b65c-6caf9badb059 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75cd9652625a4935a9af31bd4549ccf1'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:38.978132 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-836c5058-c3e9-4760-b65c-6caf9badb059 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75cd9652625a4935a9af31bd4549ccf1'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:39.016266 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1330/2645] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 14:00:38 2022] DELETE /identity/v3/users/75cd9652625a4935a9af31bd4549ccf1 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:00:39.355740 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdc9fab-5006-409e-b520-5072ac6b4fbb service cinder] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:39.381098 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdc9fab-5006-409e-b520-5072ac6b4fbb service cinder] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:39.405107 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:39.505775 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc8a081-56c7-45c8-9edb-f5715727f8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:39.508071 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8a081-56c7-45c8-9edb-f5715727f8a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:39.508526 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8a081-56c7-45c8-9edb-f5715727f8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:39.509116 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8a081-56c7-45c8-9edb-f5715727f8a2 admin admin] PATH_INFO: `/v3/projects/21d2887cd0cf4e6cb6d689f93a1dfafb` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:39.518930 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc8a081-56c7-45c8-9edb-f5715727f8a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21d2887cd0cf4e6cb6d689f93a1dfafb)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:39.522093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc8a081-56c7-45c8-9edb-f5715727f8a2 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:39.623604 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-ecc8a081-56c7-45c8-9edb-f5715727f8a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21d2887cd0cf4e6cb6d689f93a1dfafb', 'request_id': 'req-ecc8a081-56c7-45c8-9edb-f5715727f8a2'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:39.634782 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-ecc8a081-56c7-45c8-9edb-f5715727f8a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21d2887cd0cf4e6cb6d689f93a1dfafb', 'request_id': 'req-ecc8a081-56c7-45c8-9edb-f5715727f8a2'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:39.643974 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-ecc8a081-56c7-45c8-9edb-f5715727f8a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21d2887cd0cf4e6cb6d689f93a1dfafb', 'request_id': 'req-ecc8a081-56c7-45c8-9edb-f5715727f8a2'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:39.668140 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-ecc8a081-56c7-45c8-9edb-f5715727f8a2 admin admin] The token cache is being invalidate because project 21d2887cd0cf4e6cb6d689f93a1dfafb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:00:39.668993 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-ecc8a081-56c7-45c8-9edb-f5715727f8a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:39.670150 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-ecc8a081-56c7-45c8-9edb-f5715727f8a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:39.671781 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1316/2646] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 14:00:39 2022] DELETE /identity/v3/projects/21d2887cd0cf4e6cb6d689f93a1dfafb => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:00:39.677880 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3d80d-32ea-47d6-a555-5763efb1b472 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:39.678555 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3d80d-32ea-47d6-a555-5763efb1b472 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:39.678555 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc3d80d-32ea-47d6-a555-5763efb1b472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:39.709537 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-7fc3d80d-32ea-47d6-a555-5763efb1b472 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:00:39.711812 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-7fc3d80d-32ea-47d6-a555-5763efb1b472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:39.810862 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1331/2647] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:00:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:00:39.824430 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef2b53-b165-466e-884b-2d489ac6068b None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:39.825324 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef2b53-b165-466e-884b-2d489ac6068b None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:39.825721 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef2b53-b165-466e-884b-2d489ac6068b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:39.860312 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-7bef2b53-b165-466e-884b-2d489ac6068b None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:00:39.862638 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-7bef2b53-b165-466e-884b-2d489ac6068b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:39.878266 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1317/2648] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:00:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:00:39.883188 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3d80d-32ea-47d6-a555-5763efb1b472 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:39.901860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc3d80d-32ea-47d6-a555-5763efb1b472 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:39.911924 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44939fa-6048-4fda-b7da-3869ba0a1ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:39.913076 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44939fa-6048-4fda-b7da-3869ba0a1ecf admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:39.914532 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44939fa-6048-4fda-b7da-3869ba0a1ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:39.915038 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44939fa-6048-4fda-b7da-3869ba0a1ecf admin admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:39.915842 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44939fa-6048-4fda-b7da-3869ba0a1ecf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:00:39.916160 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44939fa-6048-4fda-b7da-3869ba0a1ecf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:39.917918 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44939fa-6048-4fda-b7da-3869ba0a1ecf admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:39.942547 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1332/2649] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 14:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 14:00:39.950959 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef2b53-b165-466e-884b-2d489ac6068b None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:39.971955 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef2b53-b165-466e-884b-2d489ac6068b None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:39.980656 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f6479e-cfe9-4a4c-9535-fdec82ac4c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:39.981901 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6479e-cfe9-4a4c-9535-fdec82ac4c55 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:39.983049 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6479e-cfe9-4a4c-9535-fdec82ac4c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:39.983049 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f6479e-cfe9-4a4c-9535-fdec82ac4c55 admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:39.984213 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f6479e-cfe9-4a4c-9535-fdec82ac4c55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:39.988292 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f6479e-cfe9-4a4c-9535-fdec82ac4c55 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:40.040647 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1318/2650] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 14:00:39 2022] POST /identity/v3/projects => generated 371 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:00:40.046358 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44939fa-6048-4fda-b7da-3869ba0a1ecf admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:40.076914 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44939fa-6048-4fda-b7da-3869ba0a1ecf admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:40.212984 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873631a-8c68-4220-90fc-4f7d3bf978d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:40.217837 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873631a-8c68-4220-90fc-4f7d3bf978d6 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:40.217837 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873631a-8c68-4220-90fc-4f7d3bf978d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:40.217837 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873631a-8c68-4220-90fc-4f7d3bf978d6 admin admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:40.217837 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5873631a-8c68-4220-90fc-4f7d3bf978d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:40.221633 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5873631a-8c68-4220-90fc-4f7d3bf978d6 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:40.266519 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5fe6b7-6783-445c-a84b-4a8c15fb46bc None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:40.267021 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5fe6b7-6783-445c-a84b-4a8c15fb46bc None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:40.267784 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5fe6b7-6783-445c-a84b-4a8c15fb46bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:40.276054 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1333/2651] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 14:00:40 2022] POST /identity/v3/users => generated 286 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:00:40.283321 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873631a-8c68-4220-90fc-4f7d3bf978d6 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:40.308116 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873631a-8c68-4220-90fc-4f7d3bf978d6 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:40.317154 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-5e5fe6b7-6783-445c-a84b-4a8c15fb46bc None None] MFA Rules not processed for user `6d2dd101d1a14e5ab95f272ab1bbeb94`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:00:40.319032 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-5e5fe6b7-6783-445c-a84b-4a8c15fb46bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:40.328099 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d713e-b6d6-45ab-9686-2ba836bf3c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:40.329106 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d713e-b6d6-45ab-9686-2ba836bf3c52 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:40.329689 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d713e-b6d6-45ab-9686-2ba836bf3c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:40.330194 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d713e-b6d6-45ab-9686-2ba836bf3c52 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:40.331297 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4d713e-b6d6-45ab-9686-2ba836bf3c52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:40.333948 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4d713e-b6d6-45ab-9686-2ba836bf3c52 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:40.336598 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:40.364512 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1334/2652] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 14:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:00:40.378353 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d713e-b6d6-45ab-9686-2ba836bf3c52 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:40.395168 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d713e-b6d6-45ab-9686-2ba836bf3c52 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:40.402655 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd68629-aabe-4696-a9e5-476e10b85b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:40.403326 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd68629-aabe-4696-a9e5-476e10b85b9c admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:40.405135 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd68629-aabe-4696-a9e5-476e10b85b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:40.405833 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd68629-aabe-4696-a9e5-476e10b85b9c admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:40.407275 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd68629-aabe-4696-a9e5-476e10b85b9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:40.410638 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd68629-aabe-4696-a9e5-476e10b85b9c admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:40.431735 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1335/2653] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 14:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:00:40.437209 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd68629-aabe-4696-a9e5-476e10b85b9c admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:40.456059 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd68629-aabe-4696-a9e5-476e10b85b9c admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:40.467959 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a8f457-f94f-4dfe-8535-f9234f2f85ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:40.468452 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1319/2654] 10.222.0.69 () {58 vars in 967 bytes} [Thu Sep 8 14:00:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:00:40.469168 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8f457-f94f-4dfe-8535-f9234f2f85ea admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:40.469718 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8f457-f94f-4dfe-8535-f9234f2f85ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:40.470253 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8f457-f94f-4dfe-8535-f9234f2f85ea admin admin] PATH_INFO: `/v3/projects/46153a4136d1472d95a015d2d679f0a6/users/76a7231179a4496aa0e3aafd84380841/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:40.498398 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a8f457-f94f-4dfe-8535-f9234f2f85ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=46153a4136d1472d95a015d2d679f0a6, user_id=76a7231179a4496aa0e3aafd84380841, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:40.502312 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a8f457-f94f-4dfe-8535-f9234f2f85ea admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:40.508833 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5fe6b7-6783-445c-a84b-4a8c15fb46bc None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:40.511955 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-5e5fe6b7-6783-445c-a84b-4a8c15fb46bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:40.536725 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1336/2655] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 14:00:40 2022] PUT /identity/v3/projects/46153a4136d1472d95a015d2d679f0a6/users/76a7231179a4496aa0e3aafd84380841/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:00:40.539782 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d593a37-391b-4c97-90aa-7d71f9fb8102 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:40.540271 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d593a37-391b-4c97-90aa-7d71f9fb8102 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:40.540738 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d593a37-391b-4c97-90aa-7d71f9fb8102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:40.558100 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:40.599745 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-4d593a37-391b-4c97-90aa-7d71f9fb8102 None None] MFA Rules not processed for user `76a7231179a4496aa0e3aafd84380841`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:00:40.602747 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-4d593a37-391b-4c97-90aa-7d71f9fb8102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:40.668685 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5fe6b7-6783-445c-a84b-4a8c15fb46bc None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:40.780314 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1337/2656] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:00:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:00:40.802799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d593a37-391b-4c97-90aa-7d71f9fb8102 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:40.806524 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-4d593a37-391b-4c97-90aa-7d71f9fb8102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:40.844505 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670b3f7-2f98-4b80-88ad-679b8faf1ff8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9b97592a6840c3865d7dcf886221e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:40.846148 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670b3f7-2f98-4b80-88ad-679b8faf1ff8 service swift] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:40.846562 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670b3f7-2f98-4b80-88ad-679b8faf1ff8 service swift] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:40.847234 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670b3f7-2f98-4b80-88ad-679b8faf1ff8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:41.010104 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b670b3f7-2f98-4b80-88ad-679b8faf1ff8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:41.015738 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b670b3f7-2f98-4b80-88ad-679b8faf1ff8 service swift] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:41.041833 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1320/2657] 10.222.0.69 () {60 vars in 1384 bytes} [Thu Sep 8 14:00:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 08 14:00:41.093856 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d593a37-391b-4c97-90aa-7d71f9fb8102 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:41.110643 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6d137-cb3b-4dbb-98fb-b0f32e414554 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:41.111673 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6d137-cb3b-4dbb-98fb-b0f32e414554 service nova] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:41.113595 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6d137-cb3b-4dbb-98fb-b0f32e414554 service nova] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:41.114670 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6d137-cb3b-4dbb-98fb-b0f32e414554 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:41.130897 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6d137-cb3b-4dbb-98fb-b0f32e414554 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:41.133353 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf6d137-cb3b-4dbb-98fb-b0f32e414554 service nova] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:41.150519 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1338/2658] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:00:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:00:44.376983 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670b3f7-2f98-4b80-88ad-679b8faf1ff8 service swift] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:44.488091 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b670b3f7-2f98-4b80-88ad-679b8faf1ff8 service swift] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:44.494953 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e0aa6-82de-42e0-b9fa-f98d97348b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:44.495275 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e0aa6-82de-42e0-b9fa-f98d97348b51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:44.495503 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e0aa6-82de-42e0-b9fa-f98d97348b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:44.495879 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e0aa6-82de-42e0-b9fa-f98d97348b51 admin admin] PATH_INFO: `/v3/users/76a7231179a4496aa0e3aafd84380841` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:44.497871 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e0aa6-82de-42e0-b9fa-f98d97348b51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76a7231179a4496aa0e3aafd84380841)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:44.500130 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e0aa6-82de-42e0-b9fa-f98d97348b51 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:44.503598 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=100 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:44.613306 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-4a9e0aa6-82de-42e0-b9fa-f98d97348b51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76a7231179a4496aa0e3aafd84380841'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:44.614484 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-4a9e0aa6-82de-42e0-b9fa-f98d97348b51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76a7231179a4496aa0e3aafd84380841'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:44.630083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-4a9e0aa6-82de-42e0-b9fa-f98d97348b51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76a7231179a4496aa0e3aafd84380841'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:44.662166 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-4a9e0aa6-82de-42e0-b9fa-f98d97348b51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76a7231179a4496aa0e3aafd84380841'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:44.663332 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-4a9e0aa6-82de-42e0-b9fa-f98d97348b51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76a7231179a4496aa0e3aafd84380841'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:44.688448 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1321/2659] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 14:00:44 2022] DELETE /identity/v3/users/76a7231179a4496aa0e3aafd84380841 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:00:44.693175 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d1a7f-3b1d-442d-8655-132a70675381 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:44.694019 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d1a7f-3b1d-442d-8655-132a70675381 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:44.694019 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d1a7f-3b1d-442d-8655-132a70675381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:44.715291 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-8f4d1a7f-3b1d-442d-8655-132a70675381 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:00:44.716542 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-8f4d1a7f-3b1d-442d-8655-132a70675381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:44.731558 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:44.824907 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1339/2660] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:00:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:00:44.841004 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e0aa6-82de-42e0-b9fa-f98d97348b51 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:44.843595 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-4a9e0aa6-82de-42e0-b9fa-f98d97348b51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:44.983252 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e0aa6-82de-42e0-b9fa-f98d97348b51 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:44.989476 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4787b6-22cd-4b96-aa35-5f36a2f2b117 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:44.990489 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4787b6-22cd-4b96-aa35-5f36a2f2b117 service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:44.990908 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4787b6-22cd-4b96-aa35-5f36a2f2b117 service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:44.991493 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4787b6-22cd-4b96-aa35-5f36a2f2b117 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:45.008134 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4787b6-22cd-4b96-aa35-5f36a2f2b117 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:45.010803 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4787b6-22cd-4b96-aa35-5f36a2f2b117 service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:45.027751 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1322/2661] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:00:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:00:45.532321 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d1a7f-3b1d-442d-8655-132a70675381 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:45.534758 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-8f4d1a7f-3b1d-442d-8655-132a70675381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:45.558837 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d1a7f-3b1d-442d-8655-132a70675381 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:45.580177 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de7250-fa01-42a1-a1cd-8369399cd4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:45.581518 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de7250-fa01-42a1-a1cd-8369399cd4a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:45.582012 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de7250-fa01-42a1-a1cd-8369399cd4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:45.583004 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de7250-fa01-42a1-a1cd-8369399cd4a1 admin admin] PATH_INFO: `/v3/projects/46153a4136d1472d95a015d2d679f0a6` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:45.588087 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de7250-fa01-42a1-a1cd-8369399cd4a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46153a4136d1472d95a015d2d679f0a6)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:45.594721 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de7250-fa01-42a1-a1cd-8369399cd4a1 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:45.684617 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-18de7250-fa01-42a1-a1cd-8369399cd4a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46153a4136d1472d95a015d2d679f0a6', 'request_id': 'req-18de7250-fa01-42a1-a1cd-8369399cd4a1'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:45.695493 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-18de7250-fa01-42a1-a1cd-8369399cd4a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46153a4136d1472d95a015d2d679f0a6', 'request_id': 'req-18de7250-fa01-42a1-a1cd-8369399cd4a1'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:45.707584 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-18de7250-fa01-42a1-a1cd-8369399cd4a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46153a4136d1472d95a015d2d679f0a6', 'request_id': 'req-18de7250-fa01-42a1-a1cd-8369399cd4a1'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:45.737750 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-18de7250-fa01-42a1-a1cd-8369399cd4a1 admin admin] The token cache is being invalidate because project 46153a4136d1472d95a015d2d679f0a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:00:45.738234 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-18de7250-fa01-42a1-a1cd-8369399cd4a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:45.739253 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-18de7250-fa01-42a1-a1cd-8369399cd4a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:45.742149 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1340/2662] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 14:00:45 2022] DELETE /identity/v3/projects/46153a4136d1472d95a015d2d679f0a6 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:00:45.750994 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db799783-3853-4f12-afcb-f03c0d4449ad None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:45.751830 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db799783-3853-4f12-afcb-f03c0d4449ad None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:45.752085 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db799783-3853-4f12-afcb-f03c0d4449ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:45.780245 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-db799783-3853-4f12-afcb-f03c0d4449ad None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:00:45.781672 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-db799783-3853-4f12-afcb-f03c0d4449ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:45.921160 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1323/2663] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:00:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:00:45.933605 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a26e9-b2a6-4b09-b19b-86cade65c62f None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:45.934157 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a26e9-b2a6-4b09-b19b-86cade65c62f None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:45.934626 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a26e9-b2a6-4b09-b19b-86cade65c62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:45.969492 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-2e1a26e9-b2a6-4b09-b19b-86cade65c62f None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:00:45.971403 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-2e1a26e9-b2a6-4b09-b19b-86cade65c62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:45.986856 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1341/2664] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:00:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:00:45.994312 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db799783-3853-4f12-afcb-f03c0d4449ad None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:46.016760 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db799783-3853-4f12-afcb-f03c0d4449ad None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:46.027764 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2d29c-2ec0-44ab-999c-cbd09a428f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:46.028912 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2d29c-2ec0-44ab-999c-cbd09a428f2f admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:46.029336 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2d29c-2ec0-44ab-999c-cbd09a428f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:46.029886 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2d29c-2ec0-44ab-999c-cbd09a428f2f admin admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:46.031338 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f2d29c-2ec0-44ab-999c-cbd09a428f2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:00:46.031873 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f2d29c-2ec0-44ab-999c-cbd09a428f2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:46.035993 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f2d29c-2ec0-44ab-999c-cbd09a428f2f admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:46.068831 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1324/2665] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 14:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:00:46.071882 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a26e9-b2a6-4b09-b19b-86cade65c62f None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:46.088948 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a26e9-b2a6-4b09-b19b-86cade65c62f None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:46.096789 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc1135-f038-4930-b47d-fc437712a6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:46.097673 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc1135-f038-4930-b47d-fc437712a6ce admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:46.098079 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc1135-f038-4930-b47d-fc437712a6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:46.098455 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc1135-f038-4930-b47d-fc437712a6ce admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:46.099265 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edc1135-f038-4930-b47d-fc437712a6ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:46.102122 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edc1135-f038-4930-b47d-fc437712a6ce admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:46.150408 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1342/2666] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 14:00:46 2022] POST /identity/v3/projects => generated 371 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:00:46.157282 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2d29c-2ec0-44ab-999c-cbd09a428f2f admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:46.177489 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2d29c-2ec0-44ab-999c-cbd09a428f2f admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:46.194674 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:46.294747 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de45df-4180-4c31-9103-c7f1c604b54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:46.295387 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de45df-4180-4c31-9103-c7f1c604b54e admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:46.295670 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de45df-4180-4c31-9103-c7f1c604b54e admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:46.295952 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de45df-4180-4c31-9103-c7f1c604b54e admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:46.296627 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de45df-4180-4c31-9103-c7f1c604b54e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:46.298664 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de45df-4180-4c31-9103-c7f1c604b54e admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:46.330568 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1325/2667] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 14:00:46 2022] POST /identity/v3/users => generated 286 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:00:46.337556 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc1135-f038-4930-b47d-fc437712a6ce admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:46.350180 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc1135-f038-4930-b47d-fc437712a6ce admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:46.355926 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5f874-f1d4-4dcf-a4d4-4896fec138b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:46.356559 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5f874-f1d4-4dcf-a4d4-4896fec138b3 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:46.356844 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5f874-f1d4-4dcf-a4d4-4896fec138b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:46.357148 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5f874-f1d4-4dcf-a4d4-4896fec138b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:46.357841 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c5f874-f1d4-4dcf-a4d4-4896fec138b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:46.360050 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c5f874-f1d4-4dcf-a4d4-4896fec138b3 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:46.372066 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1343/2668] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 14:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:00:46.377585 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de45df-4180-4c31-9103-c7f1c604b54e admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:46.394650 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de45df-4180-4c31-9103-c7f1c604b54e admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:46.400895 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa1ba9-4ddb-45ad-b273-c733fb989884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:46.401701 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa1ba9-4ddb-45ad-b273-c733fb989884 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:46.402039 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa1ba9-4ddb-45ad-b273-c733fb989884 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:46.402355 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa1ba9-4ddb-45ad-b273-c733fb989884 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:46.403272 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa1ba9-4ddb-45ad-b273-c733fb989884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:46.405593 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa1ba9-4ddb-45ad-b273-c733fb989884 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:46.421341 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1326/2669] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 14:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:00:46.425937 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5f874-f1d4-4dcf-a4d4-4896fec138b3 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:46.439190 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5f874-f1d4-4dcf-a4d4-4896fec138b3 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:46.444545 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e841e731-a822-4aaa-a7de-9213808c98b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:46.446680 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841e731-a822-4aaa-a7de-9213808c98b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:46.446875 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841e731-a822-4aaa-a7de-9213808c98b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:46.447235 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841e731-a822-4aaa-a7de-9213808c98b4 admin admin] PATH_INFO: `/v3/projects/7dee6e21345740e2bb655e88163f825c/users/9479ae33d633458db010d1f2256ffa02/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:46.468087 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e841e731-a822-4aaa-a7de-9213808c98b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dee6e21345740e2bb655e88163f825c, user_id=9479ae33d633458db010d1f2256ffa02, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:46.470863 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e841e731-a822-4aaa-a7de-9213808c98b4 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:46.487471 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1344/2670] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 14:00:46 2022] PUT /identity/v3/projects/7dee6e21345740e2bb655e88163f825c/users/9479ae33d633458db010d1f2256ffa02/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:00:46.512107 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4eb4a7-c57c-4bb3-addc-631462b0aba4 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:46.512613 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4eb4a7-c57c-4bb3-addc-631462b0aba4 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:46.513387 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4eb4a7-c57c-4bb3-addc-631462b0aba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:46.557267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-0e4eb4a7-c57c-4bb3-addc-631462b0aba4 None None] MFA Rules not processed for user `9479ae33d633458db010d1f2256ffa02`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:00:46.558581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-0e4eb4a7-c57c-4bb3-addc-631462b0aba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:46.644809 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1327/2671] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:00:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:00:46.651706 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e841e731-a822-4aaa-a7de-9213808c98b4 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:46.709083 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:46.746655 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e841e731-a822-4aaa-a7de-9213808c98b4 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:46.751873 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1aaca-c15b-4764-9374-03963a464179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:46.752500 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1aaca-c15b-4764-9374-03963a464179 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:46.752780 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1aaca-c15b-4764-9374-03963a464179 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:46.753054 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1aaca-c15b-4764-9374-03963a464179 admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:46.753754 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e1aaca-c15b-4764-9374-03963a464179 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:46.755780 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e1aaca-c15b-4764-9374-03963a464179 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:46.794699 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1345/2672] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 14:00:46 2022] POST /identity/v3/projects => generated 371 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:00:46.796940 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4eb4a7-c57c-4bb3-addc-631462b0aba4 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:46.816546 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4eb4a7-c57c-4bb3-addc-631462b0aba4 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:46.912184 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf2e54-d2e3-466d-8656-bba3c4ad1fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:46.912812 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf2e54-d2e3-466d-8656-bba3c4ad1fc0 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:46.913093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf2e54-d2e3-466d-8656-bba3c4ad1fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:46.913543 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf2e54-d2e3-466d-8656-bba3c4ad1fc0 admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:46.914200 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adf2e54-d2e3-466d-8656-bba3c4ad1fc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:46.916160 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adf2e54-d2e3-466d-8656-bba3c4ad1fc0 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:46.945136 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1328/2673] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 14:00:46 2022] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:00:46.950220 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1aaca-c15b-4764-9374-03963a464179 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:46.970019 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1aaca-c15b-4764-9374-03963a464179 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:46.979486 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4539cad1-3ed0-4f6b-80f4-5f18dd3243ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:46.980571 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539cad1-3ed0-4f6b-80f4-5f18dd3243ab admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:46.981146 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539cad1-3ed0-4f6b-80f4-5f18dd3243ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:46.981760 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539cad1-3ed0-4f6b-80f4-5f18dd3243ab admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:46.994991 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4539cad1-3ed0-4f6b-80f4-5f18dd3243ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:46.998190 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4539cad1-3ed0-4f6b-80f4-5f18dd3243ab admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:47.022182 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1346/2674] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 14:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:00:47.025967 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf2e54-d2e3-466d-8656-bba3c4ad1fc0 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:47.045520 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf2e54-d2e3-466d-8656-bba3c4ad1fc0 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:47.055114 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c913c-1539-41da-a7c9-d55e09f53f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:47.056453 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c913c-1539-41da-a7c9-d55e09f53f7f admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:47.056992 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c913c-1539-41da-a7c9-d55e09f53f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:47.057644 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c913c-1539-41da-a7c9-d55e09f53f7f admin admin] PATH_INFO: `/v3/projects/393f4ec0b97945aeaa3597ec06392df1/users/613295bf146b49a1898a1aaddcf6227c/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:47.062937 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:47.085133 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c913c-1539-41da-a7c9-d55e09f53f7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=393f4ec0b97945aeaa3597ec06392df1, user_id=613295bf146b49a1898a1aaddcf6227c, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:47.088844 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c913c-1539-41da-a7c9-d55e09f53f7f admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:47.106317 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1329/2675] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 14:00:47 2022] PUT /identity/v3/projects/393f4ec0b97945aeaa3597ec06392df1/users/613295bf146b49a1898a1aaddcf6227c/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:00:47.111481 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4539cad1-3ed0-4f6b-80f4-5f18dd3243ab admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:47.123564 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4539cad1-3ed0-4f6b-80f4-5f18dd3243ab admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:47.221938 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b63b23e-bb72-4be7-83c6-dcd459a8bc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:47.223043 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63b23e-bb72-4be7-83c6-dcd459a8bc1a admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:47.223429 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63b23e-bb72-4be7-83c6-dcd459a8bc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:47.223851 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63b23e-bb72-4be7-83c6-dcd459a8bc1a admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:47.225102 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b63b23e-bb72-4be7-83c6-dcd459a8bc1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:47.229776 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b63b23e-bb72-4be7-83c6-dcd459a8bc1a admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:47.251572 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1347/2676] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 14:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:00:47.258296 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c913c-1539-41da-a7c9-d55e09f53f7f admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:47.271762 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c913c-1539-41da-a7c9-d55e09f53f7f admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:47.280029 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb7676-9340-49f4-92ea-7c7cc96ed706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:47.280722 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb7676-9340-49f4-92ea-7c7cc96ed706 admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:47.281004 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb7676-9340-49f4-92ea-7c7cc96ed706 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:47.281277 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb7676-9340-49f4-92ea-7c7cc96ed706 admin admin] PATH_INFO: `/v3/projects/393f4ec0b97945aeaa3597ec06392df1/users/613295bf146b49a1898a1aaddcf6227c/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:47.283686 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb7676-9340-49f4-92ea-7c7cc96ed706 admin admin] RBAC: Authorizing `identity:create_grant(project_id=393f4ec0b97945aeaa3597ec06392df1, user_id=613295bf146b49a1898a1aaddcf6227c, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:47.286399 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb7676-9340-49f4-92ea-7c7cc96ed706 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:47.301184 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1330/2677] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 14:00:47 2022] PUT /identity/v3/projects/393f4ec0b97945aeaa3597ec06392df1/users/613295bf146b49a1898a1aaddcf6227c/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:00:47.316299 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7b02d-f12d-450a-865c-5dd374926a8b None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:47.316633 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7b02d-f12d-450a-865c-5dd374926a8b None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:47.316946 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7b02d-f12d-450a-865c-5dd374926a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:47.351607 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-4ae7b02d-f12d-450a-865c-5dd374926a8b None None] MFA Rules not processed for user `613295bf146b49a1898a1aaddcf6227c`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:00:47.352840 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-4ae7b02d-f12d-450a-865c-5dd374926a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:47.474890 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1348/2678] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:00:47 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:00:47.489413 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb7676-9340-49f4-92ea-7c7cc96ed706 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:47.492214 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-13fb7676-9340-49f4-92ea-7c7cc96ed706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:47.576580 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb7676-9340-49f4-92ea-7c7cc96ed706 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:47.583215 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f584d-5eaa-4d8f-82a0-324884dad991 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:47.584307 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f584d-5eaa-4d8f-82a0-324884dad991 service cinder] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:47.584798 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f584d-5eaa-4d8f-82a0-324884dad991 service cinder] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:47.585840 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f584d-5eaa-4d8f-82a0-324884dad991 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:47.600106 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f584d-5eaa-4d8f-82a0-324884dad991 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:47.602877 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f584d-5eaa-4d8f-82a0-324884dad991 service cinder] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:47.615068 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1331/2679] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:00:47 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:00:48.171736 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae7b02d-f12d-450a-865c-5dd374926a8b None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:48.218956 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:48.284944 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae7b02d-f12d-450a-865c-5dd374926a8b None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:48.292397 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2b097-ebac-4a53-8784-dde931e74f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:48.293745 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2b097-ebac-4a53-8784-dde931e74f8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:48.294309 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2b097-ebac-4a53-8784-dde931e74f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:48.294820 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2b097-ebac-4a53-8784-dde931e74f8b admin admin] PATH_INFO: `/v3/users/9479ae33d633458db010d1f2256ffa02` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:48.297293 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f2b097-ebac-4a53-8784-dde931e74f8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9479ae33d633458db010d1f2256ffa02)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:48.301296 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f2b097-ebac-4a53-8784-dde931e74f8b admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:48.389814 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-25f2b097-ebac-4a53-8784-dde931e74f8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9479ae33d633458db010d1f2256ffa02'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:48.390542 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-25f2b097-ebac-4a53-8784-dde931e74f8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9479ae33d633458db010d1f2256ffa02'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:48.391213 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-25f2b097-ebac-4a53-8784-dde931e74f8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9479ae33d633458db010d1f2256ffa02'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:48.404641 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-25f2b097-ebac-4a53-8784-dde931e74f8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9479ae33d633458db010d1f2256ffa02'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:48.428771 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-25f2b097-ebac-4a53-8784-dde931e74f8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9479ae33d633458db010d1f2256ffa02'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:48.466014 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1349/2680] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 14:00:48 2022] DELETE /identity/v3/users/9479ae33d633458db010d1f2256ffa02 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:00:48.472181 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b25c3-db04-408c-9793-1a6f33e7624d None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:48.473095 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b25c3-db04-408c-9793-1a6f33e7624d None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:48.473095 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b25c3-db04-408c-9793-1a6f33e7624d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:48.495992 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-944b25c3-db04-408c-9793-1a6f33e7624d None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:00:48.497703 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-944b25c3-db04-408c-9793-1a6f33e7624d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:48.577353 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1332/2681] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:00:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:00:48.590196 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2b097-ebac-4a53-8784-dde931e74f8b admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:48.591868 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-25f2b097-ebac-4a53-8784-dde931e74f8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:48.660135 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2b097-ebac-4a53-8784-dde931e74f8b admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:48.665176 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3af1d-3411-4dd9-b4b4-53c448726b61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:48.665832 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3af1d-3411-4dd9-b4b4-53c448726b61 service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:48.666115 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3af1d-3411-4dd9-b4b4-53c448726b61 service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:48.666390 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3af1d-3411-4dd9-b4b4-53c448726b61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:48.678776 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb3af1d-3411-4dd9-b4b4-53c448726b61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:48.681701 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb3af1d-3411-4dd9-b4b4-53c448726b61 service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:48.695763 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1350/2682] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:00:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:00:49.087183 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b25c3-db04-408c-9793-1a6f33e7624d None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:49.088315 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-944b25c3-db04-408c-9793-1a6f33e7624d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:49.103857 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b25c3-db04-408c-9793-1a6f33e7624d None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:49.108808 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996509d-2146-4438-a72e-c83b05c3ba11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:49.109506 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996509d-2146-4438-a72e-c83b05c3ba11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:49.109782 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996509d-2146-4438-a72e-c83b05c3ba11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:49.110056 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8996509d-2146-4438-a72e-c83b05c3ba11 admin admin] PATH_INFO: `/v3/projects/7dee6e21345740e2bb655e88163f825c` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:49.111263 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996509d-2146-4438-a72e-c83b05c3ba11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dee6e21345740e2bb655e88163f825c)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:49.113225 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8996509d-2146-4438-a72e-c83b05c3ba11 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:49.175137 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-8996509d-2146-4438-a72e-c83b05c3ba11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dee6e21345740e2bb655e88163f825c', 'request_id': 'req-8996509d-2146-4438-a72e-c83b05c3ba11'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:49.184157 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-8996509d-2146-4438-a72e-c83b05c3ba11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dee6e21345740e2bb655e88163f825c', 'request_id': 'req-8996509d-2146-4438-a72e-c83b05c3ba11'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:49.191211 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-8996509d-2146-4438-a72e-c83b05c3ba11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dee6e21345740e2bb655e88163f825c', 'request_id': 'req-8996509d-2146-4438-a72e-c83b05c3ba11'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:49.202967 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:49.209893 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-8996509d-2146-4438-a72e-c83b05c3ba11 admin admin] The token cache is being invalidate because project 7dee6e21345740e2bb655e88163f825c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:00:49.210392 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-8996509d-2146-4438-a72e-c83b05c3ba11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:49.211973 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-8996509d-2146-4438-a72e-c83b05c3ba11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:49.214921 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1333/2683] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 14:00:49 2022] DELETE /identity/v3/projects/7dee6e21345740e2bb655e88163f825c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:00:49.219827 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3af1d-3411-4dd9-b4b4-53c448726b61 service neutron] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:49.238579 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3af1d-3411-4dd9-b4b4-53c448726b61 service neutron] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:49.315755 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:49.328971 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996509d-2146-4438-a72e-c83b05c3ba11 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:49.329266 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd5bfa-d22b-4a99-8157-85f7f59b0b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:49.330771 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd5bfa-d22b-4a99-8157-85f7f59b0b3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:49.331081 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd5bfa-d22b-4a99-8157-85f7f59b0b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:49.331325 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-8996509d-2146-4438-a72e-c83b05c3ba11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:49.331477 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd5bfa-d22b-4a99-8157-85f7f59b0b3d admin admin] PATH_INFO: `/v3/users/613295bf146b49a1898a1aaddcf6227c` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:49.332997 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd5bfa-d22b-4a99-8157-85f7f59b0b3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=613295bf146b49a1898a1aaddcf6227c)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:49.335615 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd5bfa-d22b-4a99-8157-85f7f59b0b3d admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:49.356655 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8996509d-2146-4438-a72e-c83b05c3ba11 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:49.364846 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb8c27-4365-4a3d-a61a-485f56f1fbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:49.366025 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb8c27-4365-4a3d-a61a-485f56f1fbee admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:49.367069 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb8c27-4365-4a3d-a61a-485f56f1fbee admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:49.367556 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb8c27-4365-4a3d-a61a-485f56f1fbee admin admin] PATH_INFO: `/v3/users/40cece5cf73c4d6cb3df5276101b4ff0` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:49.370209 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb8c27-4365-4a3d-a61a-485f56f1fbee admin admin] RBAC: Authorizing `identity:delete_user(user_id=40cece5cf73c4d6cb3df5276101b4ff0)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:49.374194 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb8c27-4365-4a3d-a61a-485f56f1fbee admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:49.400660 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-1bbd5bfa-d22b-4a99-8157-85f7f59b0b3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '613295bf146b49a1898a1aaddcf6227c'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:49.401389 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-1bbd5bfa-d22b-4a99-8157-85f7f59b0b3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '613295bf146b49a1898a1aaddcf6227c'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:49.402010 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-1bbd5bfa-d22b-4a99-8157-85f7f59b0b3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '613295bf146b49a1898a1aaddcf6227c'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:49.410287 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-1bbd5bfa-d22b-4a99-8157-85f7f59b0b3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '613295bf146b49a1898a1aaddcf6227c'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:49.433814 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-1bbd5bfa-d22b-4a99-8157-85f7f59b0b3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '613295bf146b49a1898a1aaddcf6227c'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:49.451882 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1351/2684] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 14:00:49 2022] DELETE /identity/v3/users/613295bf146b49a1898a1aaddcf6227c => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:00:49.455221 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-6ffb8c27-4365-4a3d-a61a-485f56f1fbee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40cece5cf73c4d6cb3df5276101b4ff0'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:49.455928 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-6ffb8c27-4365-4a3d-a61a-485f56f1fbee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40cece5cf73c4d6cb3df5276101b4ff0'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:49.467544 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-6ffb8c27-4365-4a3d-a61a-485f56f1fbee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40cece5cf73c4d6cb3df5276101b4ff0'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:49.487370 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-6ffb8c27-4365-4a3d-a61a-485f56f1fbee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40cece5cf73c4d6cb3df5276101b4ff0'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:49.488805 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-6ffb8c27-4365-4a3d-a61a-485f56f1fbee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40cece5cf73c4d6cb3df5276101b4ff0'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:49.507350 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1334/2685] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 14:00:49 2022] DELETE /identity/v3/users/40cece5cf73c4d6cb3df5276101b4ff0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:00:49.512189 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99de418-089e-49fa-acf1-fad63945f2ea None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:49.512573 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99de418-089e-49fa-acf1-fad63945f2ea None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:49.512924 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99de418-089e-49fa-acf1-fad63945f2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:49.536960 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-e99de418-089e-49fa-acf1-fad63945f2ea None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:00:49.538774 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-e99de418-089e-49fa-acf1-fad63945f2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:49.624071 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1352/2686] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:00:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:00:49.639420 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb8c27-4365-4a3d-a61a-485f56f1fbee admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:49.640988 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-6ffb8c27-4365-4a3d-a61a-485f56f1fbee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:49.732349 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb8c27-4365-4a3d-a61a-485f56f1fbee admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:49.738518 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e12a84-7766-4ded-bb1c-c71abc5126ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:49.739503 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e12a84-7766-4ded-bb1c-c71abc5126ab service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:49.739932 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e12a84-7766-4ded-bb1c-c71abc5126ab service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:49.740383 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e12a84-7766-4ded-bb1c-c71abc5126ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:49.757436 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e12a84-7766-4ded-bb1c-c71abc5126ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:49.760215 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e12a84-7766-4ded-bb1c-c71abc5126ab service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:49.779259 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1335/2687] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:00:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:00:49.904575 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99de418-089e-49fa-acf1-fad63945f2ea None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:49.907243 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-e99de418-089e-49fa-acf1-fad63945f2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:49.954869 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99de418-089e-49fa-acf1-fad63945f2ea None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:49.963714 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc42ee09-6bbd-413e-94bc-b5a0e3e2bbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:49.964689 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42ee09-6bbd-413e-94bc-b5a0e3e2bbde admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:49.965155 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42ee09-6bbd-413e-94bc-b5a0e3e2bbde admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:49.965674 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc42ee09-6bbd-413e-94bc-b5a0e3e2bbde admin admin] PATH_INFO: `/v3/projects/393f4ec0b97945aeaa3597ec06392df1` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:49.967933 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42ee09-6bbd-413e-94bc-b5a0e3e2bbde admin admin] RBAC: Authorizing `identity:delete_project(project_id=393f4ec0b97945aeaa3597ec06392df1)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:49.971969 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc42ee09-6bbd-413e-94bc-b5a0e3e2bbde admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:50.050755 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-fc42ee09-6bbd-413e-94bc-b5a0e3e2bbde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '393f4ec0b97945aeaa3597ec06392df1', 'request_id': 'req-fc42ee09-6bbd-413e-94bc-b5a0e3e2bbde'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:50.059051 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-fc42ee09-6bbd-413e-94bc-b5a0e3e2bbde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '393f4ec0b97945aeaa3597ec06392df1', 'request_id': 'req-fc42ee09-6bbd-413e-94bc-b5a0e3e2bbde'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:50.068102 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-fc42ee09-6bbd-413e-94bc-b5a0e3e2bbde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '393f4ec0b97945aeaa3597ec06392df1', 'request_id': 'req-fc42ee09-6bbd-413e-94bc-b5a0e3e2bbde'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:50.075429 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:50.097686 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-fc42ee09-6bbd-413e-94bc-b5a0e3e2bbde admin admin] The token cache is being invalidate because project 393f4ec0b97945aeaa3597ec06392df1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:00:50.098009 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-fc42ee09-6bbd-413e-94bc-b5a0e3e2bbde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:50.098961 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-fc42ee09-6bbd-413e-94bc-b5a0e3e2bbde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:50.105639 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1353/2688] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 14:00:49 2022] DELETE /identity/v3/projects/393f4ec0b97945aeaa3597ec06392df1 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:00:50.109694 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e111ce3-51ca-4a26-8790-c791cfb11ddc None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:50.110094 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e111ce3-51ca-4a26-8790-c791cfb11ddc None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:50.110492 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e111ce3-51ca-4a26-8790-c791cfb11ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:50.139621 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-1e111ce3-51ca-4a26-8790-c791cfb11ddc None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:00:50.141506 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-1e111ce3-51ca-4a26-8790-c791cfb11ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:50.219108 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1336/2689] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:00:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:00:50.228263 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e5319-40a8-42af-be37-a566d6f38414 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:50.229081 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e5319-40a8-42af-be37-a566d6f38414 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:50.229081 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e5319-40a8-42af-be37-a566d6f38414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:50.259956 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e111ce3-51ca-4a26-8790-c791cfb11ddc None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:50.262959 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-1e111ce3-51ca-4a26-8790-c791cfb11ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:50.270013 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-792e5319-40a8-42af-be37-a566d6f38414 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:00:50.272333 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-792e5319-40a8-42af-be37-a566d6f38414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:50.289197 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1354/2690] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:00:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:00:50.292060 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e111ce3-51ca-4a26-8790-c791cfb11ddc None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:50.296623 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e5319-40a8-42af-be37-a566d6f38414 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:50.307290 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543a952-ee27-4e4c-aff2-080d0c5a764e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:50.308397 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543a952-ee27-4e4c-aff2-080d0c5a764e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:50.308885 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543a952-ee27-4e4c-aff2-080d0c5a764e admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:50.309410 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9543a952-ee27-4e4c-aff2-080d0c5a764e admin admin] PATH_INFO: `/v3/projects/4cbc88f5936344229cbb299956148b70` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:50.311443 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543a952-ee27-4e4c-aff2-080d0c5a764e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cbc88f5936344229cbb299956148b70)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:50.315150 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9543a952-ee27-4e4c-aff2-080d0c5a764e admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:50.315921 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e5319-40a8-42af-be37-a566d6f38414 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:50.326354 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db194f6-e1bf-462f-8355-7e1e8ba8c06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:50.327564 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db194f6-e1bf-462f-8355-7e1e8ba8c06a admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:50.328240 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db194f6-e1bf-462f-8355-7e1e8ba8c06a admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:50.328877 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db194f6-e1bf-462f-8355-7e1e8ba8c06a admin admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:50.330210 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db194f6-e1bf-462f-8355-7e1e8ba8c06a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:00:50.330757 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db194f6-e1bf-462f-8355-7e1e8ba8c06a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:50.334117 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db194f6-e1bf-462f-8355-7e1e8ba8c06a admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:50.335772 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:50.360763 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1355/2691] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 14:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:00:50.364968 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db194f6-e1bf-462f-8355-7e1e8ba8c06a admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:50.380965 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db194f6-e1bf-462f-8355-7e1e8ba8c06a admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:50.389040 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b02b1f-c74e-477a-812a-e424c5dbb6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:50.389758 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b02b1f-c74e-477a-812a-e424c5dbb6c4 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:50.390350 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b02b1f-c74e-477a-812a-e424c5dbb6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:50.390533 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b02b1f-c74e-477a-812a-e424c5dbb6c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:50.391102 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b02b1f-c74e-477a-812a-e424c5dbb6c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:50.393331 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b02b1f-c74e-477a-812a-e424c5dbb6c4 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:50.411353 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-9543a952-ee27-4e4c-aff2-080d0c5a764e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cbc88f5936344229cbb299956148b70', 'request_id': 'req-9543a952-ee27-4e4c-aff2-080d0c5a764e'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:50.422174 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-9543a952-ee27-4e4c-aff2-080d0c5a764e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cbc88f5936344229cbb299956148b70', 'request_id': 'req-9543a952-ee27-4e4c-aff2-080d0c5a764e'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:50.432478 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-9543a952-ee27-4e4c-aff2-080d0c5a764e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cbc88f5936344229cbb299956148b70', 'request_id': 'req-9543a952-ee27-4e4c-aff2-080d0c5a764e'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:50.439161 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1356/2692] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 14:00:50 2022] POST /identity/v3/projects => generated 369 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:00:50.447077 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b02b1f-c74e-477a-812a-e424c5dbb6c4 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:50.455902 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-9543a952-ee27-4e4c-aff2-080d0c5a764e admin admin] The token cache is being invalidate because project 4cbc88f5936344229cbb299956148b70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:00:50.456534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-9543a952-ee27-4e4c-aff2-080d0c5a764e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:50.457800 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-9543a952-ee27-4e4c-aff2-080d0c5a764e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:50.461563 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1337/2693] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 14:00:50 2022] DELETE /identity/v3/projects/4cbc88f5936344229cbb299956148b70 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:00:50.568397 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b02b1f-c74e-477a-812a-e424c5dbb6c4 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:50.574919 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8d11b-bc20-4699-8273-42cc6b900272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:50.575959 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8d11b-bc20-4699-8273-42cc6b900272 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:50.576364 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8d11b-bc20-4699-8273-42cc6b900272 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:50.576767 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8d11b-bc20-4699-8273-42cc6b900272 admin admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:50.577835 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb8d11b-bc20-4699-8273-42cc6b900272 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:50.580311 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb8d11b-bc20-4699-8273-42cc6b900272 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:50.611462 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1357/2694] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 14:00:50 2022] POST /identity/v3/users => generated 285 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:00:50.617581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543a952-ee27-4e4c-aff2-080d0c5a764e admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:50.619991 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-9543a952-ee27-4e4c-aff2-080d0c5a764e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:50.747779 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9543a952-ee27-4e4c-aff2-080d0c5a764e admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:50.755067 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d7ac6a-d910-47eb-a6b3-0905b9ad6cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:50.755927 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7ac6a-d910-47eb-a6b3-0905b9ad6cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:50.756360 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7ac6a-d910-47eb-a6b3-0905b9ad6cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:50.756743 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7ac6a-d910-47eb-a6b3-0905b9ad6cd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:50.758568 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d7ac6a-d910-47eb-a6b3-0905b9ad6cd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:50.761564 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d7ac6a-d910-47eb-a6b3-0905b9ad6cd5 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:50.777444 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1338/2695] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 14:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:00:50.782773 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8d11b-bc20-4699-8273-42cc6b900272 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:50.796018 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8d11b-bc20-4699-8273-42cc6b900272 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:50.802525 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f2c96-16a2-4742-b34f-d3cd451bf91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:50.803204 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f2c96-16a2-4742-b34f-d3cd451bf91c admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:50.803498 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f2c96-16a2-4742-b34f-d3cd451bf91c admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:50.803873 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f2c96-16a2-4742-b34f-d3cd451bf91c admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:50.804561 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f2c96-16a2-4742-b34f-d3cd451bf91c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:50.806287 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f2c96-16a2-4742-b34f-d3cd451bf91c admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:50.819022 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1358/2696] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 14:00:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:00:50.824667 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d7ac6a-d910-47eb-a6b3-0905b9ad6cd5 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:50.839433 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d7ac6a-d910-47eb-a6b3-0905b9ad6cd5 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:50.846708 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004edf24-3297-4dbc-8503-0909739b9f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:50.847455 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004edf24-3297-4dbc-8503-0909739b9f41 admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:50.847763 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004edf24-3297-4dbc-8503-0909739b9f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:50.848015 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004edf24-3297-4dbc-8503-0909739b9f41 admin admin] PATH_INFO: `/v3/projects/10cd9030b4924d489ac565565f09113d/users/a63bbb8d0b474194afac896449d12317/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:50.871899 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004edf24-3297-4dbc-8503-0909739b9f41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10cd9030b4924d489ac565565f09113d, user_id=a63bbb8d0b474194afac896449d12317, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:50.875301 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004edf24-3297-4dbc-8503-0909739b9f41 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:50.897707 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1339/2697] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 14:00:50 2022] PUT /identity/v3/projects/10cd9030b4924d489ac565565f09113d/users/a63bbb8d0b474194afac896449d12317/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:00:50.918156 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67264858-2c01-4156-bde5-bb9cd49148ae None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:50.918653 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67264858-2c01-4156-bde5-bb9cd49148ae None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:50.919141 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67264858-2c01-4156-bde5-bb9cd49148ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:50.962752 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-67264858-2c01-4156-bde5-bb9cd49148ae None None] MFA Rules not processed for user `a63bbb8d0b474194afac896449d12317`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:00:50.964060 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-67264858-2c01-4156-bde5-bb9cd49148ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:51.079299 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1359/2698] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:00:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:00:51.084589 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004edf24-3297-4dbc-8503-0909739b9f41 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:51.162942 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004edf24-3297-4dbc-8503-0909739b9f41 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:51.169316 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a5a26-adbd-44fe-89a5-e0af0e399e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:51.169991 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a5a26-adbd-44fe-89a5-e0af0e399e8d admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:51.170273 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a5a26-adbd-44fe-89a5-e0af0e399e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:51.170615 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a5a26-adbd-44fe-89a5-e0af0e399e8d admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:51.171293 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a5a26-adbd-44fe-89a5-e0af0e399e8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:51.173346 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a5a26-adbd-44fe-89a5-e0af0e399e8d admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:51.191241 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:51.216102 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1340/2699] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 14:00:51 2022] POST /identity/v3/projects => generated 367 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:00:51.221297 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67264858-2c01-4156-bde5-bb9cd49148ae None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:51.234657 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67264858-2c01-4156-bde5-bb9cd49148ae None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:51.261781 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:51.318363 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9655ea-bdff-4e53-af66-1681869ec313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:51.319341 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9655ea-bdff-4e53-af66-1681869ec313 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:51.320481 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9655ea-bdff-4e53-af66-1681869ec313 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:51.320953 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9655ea-bdff-4e53-af66-1681869ec313 admin admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:51.322072 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9655ea-bdff-4e53-af66-1681869ec313 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:51.325568 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9655ea-bdff-4e53-af66-1681869ec313 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:51.363049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1360/2700] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 14:00:51 2022] POST /identity/v3/users => generated 290 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:00:51.366053 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a5a26-adbd-44fe-89a5-e0af0e399e8d admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:51.378368 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a5a26-adbd-44fe-89a5-e0af0e399e8d admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:51.383415 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae8e38-6aa6-443a-9097-513df245abf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:51.384079 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae8e38-6aa6-443a-9097-513df245abf3 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:51.384357 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae8e38-6aa6-443a-9097-513df245abf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:51.384633 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae8e38-6aa6-443a-9097-513df245abf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:51.385345 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae8e38-6aa6-443a-9097-513df245abf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:51.387367 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae8e38-6aa6-443a-9097-513df245abf3 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:51.400983 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1341/2701] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 14:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:00:51.406674 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9655ea-bdff-4e53-af66-1681869ec313 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:51.418658 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9655ea-bdff-4e53-af66-1681869ec313 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:51.424148 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf5cac-7f97-400f-8bc4-8e56d3712d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:51.424830 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf5cac-7f97-400f-8bc4-8e56d3712d1f admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:51.425109 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf5cac-7f97-400f-8bc4-8e56d3712d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:51.425405 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf5cac-7f97-400f-8bc4-8e56d3712d1f admin admin] PATH_INFO: `/v3/projects/2b4cf755bd1e4e23811d2f8eab08938e/users/06f439e31ee541e694831116a31973fb/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:51.447234 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf5cac-7f97-400f-8bc4-8e56d3712d1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b4cf755bd1e4e23811d2f8eab08938e, user_id=06f439e31ee541e694831116a31973fb, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:51.450251 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf5cac-7f97-400f-8bc4-8e56d3712d1f admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:51.467149 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1361/2702] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 14:00:51 2022] PUT /identity/v3/projects/2b4cf755bd1e4e23811d2f8eab08938e/users/06f439e31ee541e694831116a31973fb/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:00:51.471503 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae8e38-6aa6-443a-9097-513df245abf3 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:51.482997 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae8e38-6aa6-443a-9097-513df245abf3 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:51.555002 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce7285-6fbe-4560-9634-14d46c160d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:51.557067 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce7285-6fbe-4560-9634-14d46c160d4d admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:51.557067 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce7285-6fbe-4560-9634-14d46c160d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:51.557537 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce7285-6fbe-4560-9634-14d46c160d4d admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:51.558397 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce7285-6fbe-4560-9634-14d46c160d4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:51.561015 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce7285-6fbe-4560-9634-14d46c160d4d admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:51.574770 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1342/2703] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 14:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:00:51.579567 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf5cac-7f97-400f-8bc4-8e56d3712d1f admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:51.596539 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf5cac-7f97-400f-8bc4-8e56d3712d1f admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:51.602772 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958611e6-79d7-4fa5-a37b-136ba1d44ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:51.603454 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958611e6-79d7-4fa5-a37b-136ba1d44ade admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:51.603737 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958611e6-79d7-4fa5-a37b-136ba1d44ade admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:51.604014 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958611e6-79d7-4fa5-a37b-136ba1d44ade admin admin] PATH_INFO: `/v3/projects/2b4cf755bd1e4e23811d2f8eab08938e/users/06f439e31ee541e694831116a31973fb/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:51.606245 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958611e6-79d7-4fa5-a37b-136ba1d44ade admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b4cf755bd1e4e23811d2f8eab08938e, user_id=06f439e31ee541e694831116a31973fb, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:51.609099 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958611e6-79d7-4fa5-a37b-136ba1d44ade admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:51.621954 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1362/2704] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 14:00:51 2022] PUT /identity/v3/projects/2b4cf755bd1e4e23811d2f8eab08938e/users/06f439e31ee541e694831116a31973fb/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:00:51.635268 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331bfe8-7c68-4921-bfb3-67311a880944 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:51.635876 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331bfe8-7c68-4921-bfb3-67311a880944 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:51.635876 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331bfe8-7c68-4921-bfb3-67311a880944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:51.670796 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-c331bfe8-7c68-4921-bfb3-67311a880944 None None] MFA Rules not processed for user `06f439e31ee541e694831116a31973fb`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:00:51.672077 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-c331bfe8-7c68-4921-bfb3-67311a880944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:51.764743 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1343/2705] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:00:51 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:00:51.776975 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958611e6-79d7-4fa5-a37b-136ba1d44ade admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:51.778997 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-958611e6-79d7-4fa5-a37b-136ba1d44ade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:51.856044 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958611e6-79d7-4fa5-a37b-136ba1d44ade admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:51.860335 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc6ae8-c118-4285-a146-9424ec3987f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:51.861047 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc6ae8-c118-4285-a146-9424ec3987f8 service cinder] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:51.861432 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc6ae8-c118-4285-a146-9424ec3987f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:51.861758 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc6ae8-c118-4285-a146-9424ec3987f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:51.873414 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc6ae8-c118-4285-a146-9424ec3987f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:51.875266 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc6ae8-c118-4285-a146-9424ec3987f8 service cinder] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:51.887351 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1363/2706] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:00:51 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:00:53.706185 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c331bfe8-7c68-4921-bfb3-67311a880944 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:53.793860 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c331bfe8-7c68-4921-bfb3-67311a880944 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:53.798623 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f378b2c-1b0e-403f-9b19-70bd25f77e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:53.799266 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f378b2c-1b0e-403f-9b19-70bd25f77e88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:53.799564 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f378b2c-1b0e-403f-9b19-70bd25f77e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:53.799834 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f378b2c-1b0e-403f-9b19-70bd25f77e88 admin admin] PATH_INFO: `/v3/users/a63bbb8d0b474194afac896449d12317` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:53.800997 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f378b2c-1b0e-403f-9b19-70bd25f77e88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a63bbb8d0b474194afac896449d12317)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:53.803232 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f378b2c-1b0e-403f-9b19-70bd25f77e88 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:53.809452 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:53.866181 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-4f378b2c-1b0e-403f-9b19-70bd25f77e88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a63bbb8d0b474194afac896449d12317'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:53.867407 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-4f378b2c-1b0e-403f-9b19-70bd25f77e88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a63bbb8d0b474194afac896449d12317'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:53.877842 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-4f378b2c-1b0e-403f-9b19-70bd25f77e88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a63bbb8d0b474194afac896449d12317'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:53.893852 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-4f378b2c-1b0e-403f-9b19-70bd25f77e88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a63bbb8d0b474194afac896449d12317'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:53.894684 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-4f378b2c-1b0e-403f-9b19-70bd25f77e88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a63bbb8d0b474194afac896449d12317'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:53.912014 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1344/2707] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 14:00:53 2022] DELETE /identity/v3/users/a63bbb8d0b474194afac896449d12317 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:00:53.917053 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8ff8f-447d-4452-84dd-764be3af8647 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:53.917735 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8ff8f-447d-4452-84dd-764be3af8647 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:53.917735 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8ff8f-447d-4452-84dd-764be3af8647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:53.938309 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-7ea8ff8f-447d-4452-84dd-764be3af8647 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:00:53.939617 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-7ea8ff8f-447d-4452-84dd-764be3af8647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:54.011959 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1364/2708] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:00:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:00:54.023725 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f378b2c-1b0e-403f-9b19-70bd25f77e88 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:54.025466 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-4f378b2c-1b0e-403f-9b19-70bd25f77e88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:54.128751 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f378b2c-1b0e-403f-9b19-70bd25f77e88 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:54.135923 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d8d5c-7de7-4171-92d8-e78a1460d5c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:54.136981 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d8d5c-7de7-4171-92d8-e78a1460d5c7 service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:54.137508 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d8d5c-7de7-4171-92d8-e78a1460d5c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:54.138010 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d8d5c-7de7-4171-92d8-e78a1460d5c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:54.158673 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d8d5c-7de7-4171-92d8-e78a1460d5c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:54.161518 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d8d5c-7de7-4171-92d8-e78a1460d5c7 service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:54.183999 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1345/2709] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:00:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:00:54.525040 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea8ff8f-447d-4452-84dd-764be3af8647 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:54.527475 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-7ea8ff8f-447d-4452-84dd-764be3af8647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:54.553246 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea8ff8f-447d-4452-84dd-764be3af8647 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:54.564185 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe193ab-1cf9-4d81-8092-ecf61070ab46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:54.565241 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe193ab-1cf9-4d81-8092-ecf61070ab46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:54.565551 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe193ab-1cf9-4d81-8092-ecf61070ab46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:54.565829 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe193ab-1cf9-4d81-8092-ecf61070ab46 admin admin] PATH_INFO: `/v3/projects/10cd9030b4924d489ac565565f09113d` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:54.567344 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe193ab-1cf9-4d81-8092-ecf61070ab46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10cd9030b4924d489ac565565f09113d)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:54.569422 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe193ab-1cf9-4d81-8092-ecf61070ab46 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:54.583569 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:54.634697 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-4fe193ab-1cf9-4d81-8092-ecf61070ab46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10cd9030b4924d489ac565565f09113d', 'request_id': 'req-4fe193ab-1cf9-4d81-8092-ecf61070ab46'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:54.642476 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-4fe193ab-1cf9-4d81-8092-ecf61070ab46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10cd9030b4924d489ac565565f09113d', 'request_id': 'req-4fe193ab-1cf9-4d81-8092-ecf61070ab46'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:54.651103 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-4fe193ab-1cf9-4d81-8092-ecf61070ab46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10cd9030b4924d489ac565565f09113d', 'request_id': 'req-4fe193ab-1cf9-4d81-8092-ecf61070ab46'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:54.668195 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-4fe193ab-1cf9-4d81-8092-ecf61070ab46 admin admin] The token cache is being invalidate because project 10cd9030b4924d489ac565565f09113d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:00:54.668539 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-4fe193ab-1cf9-4d81-8092-ecf61070ab46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:54.669996 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-4fe193ab-1cf9-4d81-8092-ecf61070ab46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:54.670884 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1365/2710] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 14:00:54 2022] DELETE /identity/v3/projects/10cd9030b4924d489ac565565f09113d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:00:54.675494 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d8d5c-7de7-4171-92d8-e78a1460d5c7 service neutron] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:54.688441 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d8d5c-7de7-4171-92d8-e78a1460d5c7 service neutron] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:54.770736 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f256131-97e2-421d-825d-251a7f265728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:54.771419 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f256131-97e2-421d-825d-251a7f265728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:54.771571 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f256131-97e2-421d-825d-251a7f265728 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:54.771816 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f256131-97e2-421d-825d-251a7f265728 admin admin] PATH_INFO: `/v3/users/06f439e31ee541e694831116a31973fb` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:54.773105 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f256131-97e2-421d-825d-251a7f265728 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06f439e31ee541e694831116a31973fb)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:54.775345 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f256131-97e2-421d-825d-251a7f265728 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:54.813939 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:54.842278 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-3f256131-97e2-421d-825d-251a7f265728 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06f439e31ee541e694831116a31973fb'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:54.843058 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-3f256131-97e2-421d-825d-251a7f265728 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06f439e31ee541e694831116a31973fb'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:54.852864 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-3f256131-97e2-421d-825d-251a7f265728 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06f439e31ee541e694831116a31973fb'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:54.868971 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-3f256131-97e2-421d-825d-251a7f265728 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06f439e31ee541e694831116a31973fb'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:54.870034 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-3f256131-97e2-421d-825d-251a7f265728 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06f439e31ee541e694831116a31973fb'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:54.892617 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1346/2711] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 14:00:54 2022] DELETE /identity/v3/users/06f439e31ee541e694831116a31973fb => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:00:55.247231 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe193ab-1cf9-4d81-8092-ecf61070ab46 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:55.249228 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-4fe193ab-1cf9-4d81-8092-ecf61070ab46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:55.266251 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe193ab-1cf9-4d81-8092-ecf61070ab46 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:55.344018 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03cea2b-8410-47b6-893a-aa87271142b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:55.344651 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03cea2b-8410-47b6-893a-aa87271142b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:55.344931 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03cea2b-8410-47b6-893a-aa87271142b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:55.345206 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03cea2b-8410-47b6-893a-aa87271142b7 admin admin] PATH_INFO: `/v3/projects/2b4cf755bd1e4e23811d2f8eab08938e` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:55.346482 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03cea2b-8410-47b6-893a-aa87271142b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b4cf755bd1e4e23811d2f8eab08938e)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:55.348433 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03cea2b-8410-47b6-893a-aa87271142b7 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:55.407143 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-d03cea2b-8410-47b6-893a-aa87271142b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b4cf755bd1e4e23811d2f8eab08938e', 'request_id': 'req-d03cea2b-8410-47b6-893a-aa87271142b7'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:55.418430 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-d03cea2b-8410-47b6-893a-aa87271142b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b4cf755bd1e4e23811d2f8eab08938e', 'request_id': 'req-d03cea2b-8410-47b6-893a-aa87271142b7'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:55.430913 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-d03cea2b-8410-47b6-893a-aa87271142b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b4cf755bd1e4e23811d2f8eab08938e', 'request_id': 'req-d03cea2b-8410-47b6-893a-aa87271142b7'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:55.450933 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-d03cea2b-8410-47b6-893a-aa87271142b7 admin admin] The token cache is being invalidate because project 2b4cf755bd1e4e23811d2f8eab08938e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:00:55.451381 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-d03cea2b-8410-47b6-893a-aa87271142b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:55.452205 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-d03cea2b-8410-47b6-893a-aa87271142b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:00:55.453994 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1366/2712] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 14:00:55 2022] DELETE /identity/v3/projects/2b4cf755bd1e4e23811d2f8eab08938e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:00:55.459385 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a25441-5e4c-42b7-928a-34bf6806b404 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:55.459801 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a25441-5e4c-42b7-928a-34bf6806b404 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:55.460899 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a25441-5e4c-42b7-928a-34bf6806b404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:55.485469 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-70a25441-5e4c-42b7-928a-34bf6806b404 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:00:55.486730 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-70a25441-5e4c-42b7-928a-34bf6806b404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:55.705573 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1347/2713] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:00:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:00:55.713944 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c8d7f-dbdd-4bdf-ae4a-f57894800406 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:55.714218 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c8d7f-dbdd-4bdf-ae4a-f57894800406 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:55.714478 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c8d7f-dbdd-4bdf-ae4a-f57894800406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:55.737684 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-e06c8d7f-dbdd-4bdf-ae4a-f57894800406 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:00:55.738956 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-e06c8d7f-dbdd-4bdf-ae4a-f57894800406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:55.748074 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1367/2714] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:00:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:00:55.752979 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a25441-5e4c-42b7-928a-34bf6806b404 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:55.765262 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a25441-5e4c-42b7-928a-34bf6806b404 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:55.770659 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b8519-f2c6-451a-90cf-77bdd7a10db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:55.771282 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b8519-f2c6-451a-90cf-77bdd7a10db6 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:55.771888 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b8519-f2c6-451a-90cf-77bdd7a10db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:55.771888 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b8519-f2c6-451a-90cf-77bdd7a10db6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:55.772642 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b8519-f2c6-451a-90cf-77bdd7a10db6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:00:55.773947 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b8519-f2c6-451a-90cf-77bdd7a10db6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:55.775982 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b8519-f2c6-451a-90cf-77bdd7a10db6 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:55.792554 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1348/2715] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 14:00:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 14:00:55.799961 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c8d7f-dbdd-4bdf-ae4a-f57894800406 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:55.820476 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c8d7f-dbdd-4bdf-ae4a-f57894800406 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:55.828588 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1abeace-2318-453a-a2a9-ad6360d6c75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:55.829491 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abeace-2318-453a-a2a9-ad6360d6c75b admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:55.829897 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abeace-2318-453a-a2a9-ad6360d6c75b admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:55.830289 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abeace-2318-453a-a2a9-ad6360d6c75b admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:55.831292 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1abeace-2318-453a-a2a9-ad6360d6c75b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:55.835885 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1abeace-2318-453a-a2a9-ad6360d6c75b admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:55.889528 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1368/2716] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 14:00:55 2022] POST /identity/v3/projects => generated 393 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:00:55.896069 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b8519-f2c6-451a-90cf-77bdd7a10db6 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:55.909306 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b8519-f2c6-451a-90cf-77bdd7a10db6 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:55.981468 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19863c-d0f9-4703-ac62-f166557da17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:55.981984 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19863c-d0f9-4703-ac62-f166557da17e admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:55.982264 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19863c-d0f9-4703-ac62-f166557da17e admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:55.982535 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19863c-d0f9-4703-ac62-f166557da17e admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:55.983198 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19863c-d0f9-4703-ac62-f166557da17e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:55.985236 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19863c-d0f9-4703-ac62-f166557da17e admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:56.011779 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1349/2717] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 14:00:55 2022] POST /identity/v3/users => generated 297 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:00:56.018175 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1abeace-2318-453a-a2a9-ad6360d6c75b admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:56.025413 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:56.034183 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1abeace-2318-453a-a2a9-ad6360d6c75b admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:56.042168 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc6094-89b6-4f25-b5cd-97ee451a97c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:56.042788 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc6094-89b6-4f25-b5cd-97ee451a97c6 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:56.043067 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc6094-89b6-4f25-b5cd-97ee451a97c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:56.043339 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc6094-89b6-4f25-b5cd-97ee451a97c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:56.044029 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bc6094-89b6-4f25-b5cd-97ee451a97c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:56.046298 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bc6094-89b6-4f25-b5cd-97ee451a97c6 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:56.059075 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1369/2718] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 14:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:00:56.064126 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19863c-d0f9-4703-ac62-f166557da17e admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:56.075825 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19863c-d0f9-4703-ac62-f166557da17e admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:56.081003 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c40592-9e13-4b8f-a2e1-4ec4bc61ba6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:56.081678 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c40592-9e13-4b8f-a2e1-4ec4bc61ba6e admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:56.082122 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c40592-9e13-4b8f-a2e1-4ec4bc61ba6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:56.082396 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c40592-9e13-4b8f-a2e1-4ec4bc61ba6e admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:56.083062 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c40592-9e13-4b8f-a2e1-4ec4bc61ba6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:56.084678 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c40592-9e13-4b8f-a2e1-4ec4bc61ba6e admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:56.097297 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1350/2719] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 14:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:00:56.103136 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc6094-89b6-4f25-b5cd-97ee451a97c6 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:56.114233 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc6094-89b6-4f25-b5cd-97ee451a97c6 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:56.120468 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da2bdd-e467-4278-a554-dd43be635097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:56.121150 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da2bdd-e467-4278-a554-dd43be635097 admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:56.121475 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da2bdd-e467-4278-a554-dd43be635097 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:56.121757 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da2bdd-e467-4278-a554-dd43be635097 admin admin] PATH_INFO: `/v3/projects/1f489fddf80e4974b113d54357941fea/users/6426e684954b47668d75314b80195335/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:56.141958 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da2bdd-e467-4278-a554-dd43be635097 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f489fddf80e4974b113d54357941fea, user_id=6426e684954b47668d75314b80195335, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:56.147102 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da2bdd-e467-4278-a554-dd43be635097 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:56.169680 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1370/2720] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 14:00:56 2022] PUT /identity/v3/projects/1f489fddf80e4974b113d54357941fea/users/6426e684954b47668d75314b80195335/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:00:56.189397 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0adbd5a-f765-4a44-a599-fcb1f02637bd None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:56.189907 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0adbd5a-f765-4a44-a599-fcb1f02637bd None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:56.190371 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0adbd5a-f765-4a44-a599-fcb1f02637bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:56.219728 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:56.234185 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-b0adbd5a-f765-4a44-a599-fcb1f02637bd None None] MFA Rules not processed for user `6426e684954b47668d75314b80195335`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:00:56.236296 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-b0adbd5a-f765-4a44-a599-fcb1f02637bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:56.333093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1351/2721] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:00:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:00:56.338901 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da2bdd-e467-4278-a554-dd43be635097 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:56.420023 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da2bdd-e467-4278-a554-dd43be635097 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:56.425129 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db211f11-64cf-494e-95f7-84d6f4f1d25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:56.425799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db211f11-64cf-494e-95f7-84d6f4f1d25f admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:56.426080 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db211f11-64cf-494e-95f7-84d6f4f1d25f admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:56.426352 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db211f11-64cf-494e-95f7-84d6f4f1d25f admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:56.427014 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db211f11-64cf-494e-95f7-84d6f4f1d25f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:56.430417 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db211f11-64cf-494e-95f7-84d6f4f1d25f admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:56.465257 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1371/2722] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 14:00:56 2022] POST /identity/v3/projects => generated 393 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:00:56.470945 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0adbd5a-f765-4a44-a599-fcb1f02637bd None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:56.483631 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0adbd5a-f765-4a44-a599-fcb1f02637bd None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:56.556687 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e26e4f-dde9-42b5-8bc2-0fd4fb6df694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:56.557464 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e26e4f-dde9-42b5-8bc2-0fd4fb6df694 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:56.557673 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e26e4f-dde9-42b5-8bc2-0fd4fb6df694 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:56.557834 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e26e4f-dde9-42b5-8bc2-0fd4fb6df694 admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:56.558488 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e26e4f-dde9-42b5-8bc2-0fd4fb6df694 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:56.560495 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e26e4f-dde9-42b5-8bc2-0fd4fb6df694 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:56.591143 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1352/2723] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 14:00:56 2022] POST /identity/v3/users => generated 303 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:00:56.596091 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db211f11-64cf-494e-95f7-84d6f4f1d25f admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:56.610019 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db211f11-64cf-494e-95f7-84d6f4f1d25f admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:56.615790 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896a6a7-e041-4714-8226-751a3ae6654b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:56.616493 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896a6a7-e041-4714-8226-751a3ae6654b admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:56.617237 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896a6a7-e041-4714-8226-751a3ae6654b admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:56.617237 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896a6a7-e041-4714-8226-751a3ae6654b admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:56.617914 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e896a6a7-e041-4714-8226-751a3ae6654b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:56.619872 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e896a6a7-e041-4714-8226-751a3ae6654b admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:56.633336 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1372/2724] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 14:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:00:56.638259 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e26e4f-dde9-42b5-8bc2-0fd4fb6df694 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:56.653962 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e26e4f-dde9-42b5-8bc2-0fd4fb6df694 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:56.661943 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c9feae-8957-463a-be28-ed5753b4f7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:56.663063 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9feae-8957-463a-be28-ed5753b4f7f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:56.663561 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9feae-8957-463a-be28-ed5753b4f7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:56.664048 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9feae-8957-463a-be28-ed5753b4f7f2 admin admin] PATH_INFO: `/v3/projects/c015123a15da45f0a85688196e011c8d/users/1eb71f4396cc40d3bd09a705cfcfe9d1/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:56.692368 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c9feae-8957-463a-be28-ed5753b4f7f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c015123a15da45f0a85688196e011c8d, user_id=1eb71f4396cc40d3bd09a705cfcfe9d1, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:56.698125 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c9feae-8957-463a-be28-ed5753b4f7f2 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:56.717304 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1353/2725] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 14:00:56 2022] PUT /identity/v3/projects/c015123a15da45f0a85688196e011c8d/users/1eb71f4396cc40d3bd09a705cfcfe9d1/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:00:56.722173 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896a6a7-e041-4714-8226-751a3ae6654b admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:56.734403 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896a6a7-e041-4714-8226-751a3ae6654b admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:56.830432 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e26b31-2532-4ff9-9950-b71b6a37f1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:56.831462 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e26b31-2532-4ff9-9950-b71b6a37f1a9 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:56.831905 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e26b31-2532-4ff9-9950-b71b6a37f1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:56.832341 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e26b31-2532-4ff9-9950-b71b6a37f1a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:56.833468 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e26b31-2532-4ff9-9950-b71b6a37f1a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:56.836971 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e26b31-2532-4ff9-9950-b71b6a37f1a9 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:56.856630 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1373/2726] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 14:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:00:56.861476 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c9feae-8957-463a-be28-ed5753b4f7f2 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:56.873483 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c9feae-8957-463a-be28-ed5753b4f7f2 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:56.878527 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678fc526-83f6-48c2-a8a8-ac6511bd788f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:56.879222 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fc526-83f6-48c2-a8a8-ac6511bd788f admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:56.879498 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fc526-83f6-48c2-a8a8-ac6511bd788f admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:56.879773 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fc526-83f6-48c2-a8a8-ac6511bd788f admin admin] PATH_INFO: `/v3/projects/c015123a15da45f0a85688196e011c8d/users/1eb71f4396cc40d3bd09a705cfcfe9d1/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:56.882373 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678fc526-83f6-48c2-a8a8-ac6511bd788f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c015123a15da45f0a85688196e011c8d, user_id=1eb71f4396cc40d3bd09a705cfcfe9d1, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:56.885048 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678fc526-83f6-48c2-a8a8-ac6511bd788f admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:56.898268 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1354/2727] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 14:00:56 2022] PUT /identity/v3/projects/c015123a15da45f0a85688196e011c8d/users/1eb71f4396cc40d3bd09a705cfcfe9d1/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:00:56.910742 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c4d56-b0de-42eb-812d-064c887bad69 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:56.911094 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c4d56-b0de-42eb-812d-064c887bad69 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:56.911418 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c4d56-b0de-42eb-812d-064c887bad69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:56.946858 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-444c4d56-b0de-42eb-812d-064c887bad69 None None] MFA Rules not processed for user `1eb71f4396cc40d3bd09a705cfcfe9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:00:56.948230 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-444c4d56-b0de-42eb-812d-064c887bad69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:56.983005 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:57.040329 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1374/2728] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:00:56 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:00:57.052372 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678fc526-83f6-48c2-a8a8-ac6511bd788f admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:57.055621 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-678fc526-83f6-48c2-a8a8-ac6511bd788f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:57.157650 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678fc526-83f6-48c2-a8a8-ac6511bd788f admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:57.161661 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8513bb90-68c3-4779-b420-25ddbc91622a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:57.162296 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513bb90-68c3-4779-b420-25ddbc91622a service cinder] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:57.162576 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513bb90-68c3-4779-b420-25ddbc91622a service cinder] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:57.162850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513bb90-68c3-4779-b420-25ddbc91622a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:57.174452 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:57.178059 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8513bb90-68c3-4779-b420-25ddbc91622a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:57.181514 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8513bb90-68c3-4779-b420-25ddbc91622a service cinder] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:57.193785 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1355/2729] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:00:57 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:00:57.257844 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c4d56-b0de-42eb-812d-064c887bad69 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:00:57.260142 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-444c4d56-b0de-42eb-812d-064c887bad69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:00:57.281925 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c4d56-b0de-42eb-812d-064c887bad69 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:00:57.288253 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e38fc30-0e01-4060-a9e8-6a08182218cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:00:57.289479 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38fc30-0e01-4060-a9e8-6a08182218cc service cinder] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:00:57.289973 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38fc30-0e01-4060-a9e8-6a08182218cc service cinder] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:00:57.290454 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e38fc30-0e01-4060-a9e8-6a08182218cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:00:57.370023 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38fc30-0e01-4060-a9e8-6a08182218cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:00:57.371557 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e38fc30-0e01-4060-a9e8-6a08182218cc service cinder] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:00:57.383080 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1375/2730] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:00:57 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:01:01.241247 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8513bb90-68c3-4779-b420-25ddbc91622a service cinder] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:01.347234 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8513bb90-68c3-4779-b420-25ddbc91622a service cinder] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:01.355722 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958fa95-9e82-4958-b155-81a9f218d01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:01.356747 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958fa95-9e82-4958-b155-81a9f218d01f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:01.357274 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958fa95-9e82-4958-b155-81a9f218d01f admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:01.357836 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958fa95-9e82-4958-b155-81a9f218d01f admin admin] PATH_INFO: `/v3/users/6426e684954b47668d75314b80195335` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:01.360246 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e958fa95-9e82-4958-b155-81a9f218d01f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6426e684954b47668d75314b80195335)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:01.364057 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e958fa95-9e82-4958-b155-81a9f218d01f admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:01.435138 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-e958fa95-9e82-4958-b155-81a9f218d01f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6426e684954b47668d75314b80195335'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:01.435965 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-e958fa95-9e82-4958-b155-81a9f218d01f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6426e684954b47668d75314b80195335'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:01.445805 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-e958fa95-9e82-4958-b155-81a9f218d01f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6426e684954b47668d75314b80195335'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:01.469299 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-e958fa95-9e82-4958-b155-81a9f218d01f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6426e684954b47668d75314b80195335'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:01.470305 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-e958fa95-9e82-4958-b155-81a9f218d01f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6426e684954b47668d75314b80195335'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:01.488866 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1356/2731] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 14:01:01 2022] DELETE /identity/v3/users/6426e684954b47668d75314b80195335 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:01:01.495001 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc1266-a6ca-4d43-ac7c-6b677a7b4e98 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:01.495681 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc1266-a6ca-4d43-ac7c-6b677a7b4e98 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:01.495681 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc1266-a6ca-4d43-ac7c-6b677a7b4e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:01.530488 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-fcfc1266-a6ca-4d43-ac7c-6b677a7b4e98 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:01:01.531879 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-fcfc1266-a6ca-4d43-ac7c-6b677a7b4e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:01.641018 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1376/2732] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:01:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:01:01.655682 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958fa95-9e82-4958-b155-81a9f218d01f admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:01.657671 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-e958fa95-9e82-4958-b155-81a9f218d01f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:01.740614 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958fa95-9e82-4958-b155-81a9f218d01f admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:01.745001 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6895e4-9aee-42d0-ac14-6a4ce07331b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:01.745746 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6895e4-9aee-42d0-ac14-6a4ce07331b8 service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:01.746081 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6895e4-9aee-42d0-ac14-6a4ce07331b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:01.746431 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6895e4-9aee-42d0-ac14-6a4ce07331b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:01.758339 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6895e4-9aee-42d0-ac14-6a4ce07331b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:01.759849 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6895e4-9aee-42d0-ac14-6a4ce07331b8 service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:01.771169 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1357/2733] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:01:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:01:02.175346 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc1266-a6ca-4d43-ac7c-6b677a7b4e98 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:02.177951 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-fcfc1266-a6ca-4d43-ac7c-6b677a7b4e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:02.200963 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfc1266-a6ca-4d43-ac7c-6b677a7b4e98 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:02.212200 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958bee06-8abd-4ebd-a15d-df860a4ec641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:02.212782 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bee06-8abd-4ebd-a15d-df860a4ec641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:02.213422 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bee06-8abd-4ebd-a15d-df860a4ec641 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:02.214671 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bee06-8abd-4ebd-a15d-df860a4ec641 admin admin] PATH_INFO: `/v3/projects/1f489fddf80e4974b113d54357941fea` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:02.216702 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958bee06-8abd-4ebd-a15d-df860a4ec641 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f489fddf80e4974b113d54357941fea)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:02.219584 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958bee06-8abd-4ebd-a15d-df860a4ec641 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:02.321800 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-958bee06-8abd-4ebd-a15d-df860a4ec641 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f489fddf80e4974b113d54357941fea', 'request_id': 'req-958bee06-8abd-4ebd-a15d-df860a4ec641'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:02.329109 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:02.331632 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-958bee06-8abd-4ebd-a15d-df860a4ec641 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f489fddf80e4974b113d54357941fea', 'request_id': 'req-958bee06-8abd-4ebd-a15d-df860a4ec641'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:02.344050 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-958bee06-8abd-4ebd-a15d-df860a4ec641 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f489fddf80e4974b113d54357941fea', 'request_id': 'req-958bee06-8abd-4ebd-a15d-df860a4ec641'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:02.366834 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-958bee06-8abd-4ebd-a15d-df860a4ec641 admin admin] The token cache is being invalidate because project 1f489fddf80e4974b113d54357941fea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:01:02.366834 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-958bee06-8abd-4ebd-a15d-df860a4ec641 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:02.367853 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-958bee06-8abd-4ebd-a15d-df860a4ec641 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:02.369662 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1377/2734] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 14:01:02 2022] DELETE /identity/v3/projects/1f489fddf80e4974b113d54357941fea => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:01:02.374975 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6895e4-9aee-42d0-ac14-6a4ce07331b8 service neutron] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:02.396917 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6895e4-9aee-42d0-ac14-6a4ce07331b8 service neutron] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:02.422814 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:02.509923 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6a7ce-8c2d-4f38-9cd5-387a074fca7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:02.510644 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6a7ce-8c2d-4f38-9cd5-387a074fca7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:02.510962 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6a7ce-8c2d-4f38-9cd5-387a074fca7e admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:02.511273 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6a7ce-8c2d-4f38-9cd5-387a074fca7e admin admin] PATH_INFO: `/v3/users/1eb71f4396cc40d3bd09a705cfcfe9d1` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:02.512566 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6a7ce-8c2d-4f38-9cd5-387a074fca7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1eb71f4396cc40d3bd09a705cfcfe9d1)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:02.514817 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6a7ce-8c2d-4f38-9cd5-387a074fca7e admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:02.605461 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-73e6a7ce-8c2d-4f38-9cd5-387a074fca7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1eb71f4396cc40d3bd09a705cfcfe9d1'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:02.606191 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-73e6a7ce-8c2d-4f38-9cd5-387a074fca7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1eb71f4396cc40d3bd09a705cfcfe9d1'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:02.618148 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-73e6a7ce-8c2d-4f38-9cd5-387a074fca7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1eb71f4396cc40d3bd09a705cfcfe9d1'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:02.633506 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-73e6a7ce-8c2d-4f38-9cd5-387a074fca7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1eb71f4396cc40d3bd09a705cfcfe9d1'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:02.634296 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-73e6a7ce-8c2d-4f38-9cd5-387a074fca7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1eb71f4396cc40d3bd09a705cfcfe9d1'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:02.651020 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1358/2735] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 14:01:02 2022] DELETE /identity/v3/users/1eb71f4396cc40d3bd09a705cfcfe9d1 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:01:03.015822 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958bee06-8abd-4ebd-a15d-df860a4ec641 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:03.018015 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-958bee06-8abd-4ebd-a15d-df860a4ec641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:03.042232 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958bee06-8abd-4ebd-a15d-df860a4ec641 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:03.120632 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ce9fd-f134-4753-9880-9ce6596a6a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:03.121278 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ce9fd-f134-4753-9880-9ce6596a6a0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:03.121670 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ce9fd-f134-4753-9880-9ce6596a6a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:03.121936 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ce9fd-f134-4753-9880-9ce6596a6a0a admin admin] PATH_INFO: `/v3/projects/c015123a15da45f0a85688196e011c8d` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:03.123222 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66ce9fd-f134-4753-9880-9ce6596a6a0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c015123a15da45f0a85688196e011c8d)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:03.125572 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66ce9fd-f134-4753-9880-9ce6596a6a0a admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:03.183495 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-e66ce9fd-f134-4753-9880-9ce6596a6a0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c015123a15da45f0a85688196e011c8d', 'request_id': 'req-e66ce9fd-f134-4753-9880-9ce6596a6a0a'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:03.193385 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-e66ce9fd-f134-4753-9880-9ce6596a6a0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c015123a15da45f0a85688196e011c8d', 'request_id': 'req-e66ce9fd-f134-4753-9880-9ce6596a6a0a'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:03.207031 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-e66ce9fd-f134-4753-9880-9ce6596a6a0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c015123a15da45f0a85688196e011c8d', 'request_id': 'req-e66ce9fd-f134-4753-9880-9ce6596a6a0a'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:03.231777 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-e66ce9fd-f134-4753-9880-9ce6596a6a0a admin admin] The token cache is being invalidate because project c015123a15da45f0a85688196e011c8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:01:03.233187 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-e66ce9fd-f134-4753-9880-9ce6596a6a0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:03.233750 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-e66ce9fd-f134-4753-9880-9ce6596a6a0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:03.236369 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1378/2736] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 14:01:03 2022] DELETE /identity/v3/projects/c015123a15da45f0a85688196e011c8d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:01:03.246324 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88441c-ba15-474e-af56-9962821ae4bb None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:03.246835 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88441c-ba15-474e-af56-9962821ae4bb None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:03.247338 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88441c-ba15-474e-af56-9962821ae4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:03.275111 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-9a88441c-ba15-474e-af56-9962821ae4bb None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:01:03.276536 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-9a88441c-ba15-474e-af56-9962821ae4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:03.363439 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1359/2737] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:01:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:01:03.378073 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d97440-ef64-465f-a988-3834ae073a0b None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:03.378503 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d97440-ef64-465f-a988-3834ae073a0b None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:03.378884 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d97440-ef64-465f-a988-3834ae073a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:03.405092 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-66d97440-ef64-465f-a988-3834ae073a0b None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:01:03.406741 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-66d97440-ef64-465f-a988-3834ae073a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:03.416459 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1379/2738] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:01:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:01:03.421859 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88441c-ba15-474e-af56-9962821ae4bb None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:03.436254 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88441c-ba15-474e-af56-9962821ae4bb None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:03.442055 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c2d833-5592-42fa-a66d-c6d974d7d619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:03.443055 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2d833-5592-42fa-a66d-c6d974d7d619 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:03.443553 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2d833-5592-42fa-a66d-c6d974d7d619 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:03.443963 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2d833-5592-42fa-a66d-c6d974d7d619 admin admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:03.445642 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c2d833-5592-42fa-a66d-c6d974d7d619 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:01:03.446054 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c2d833-5592-42fa-a66d-c6d974d7d619 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:03.447954 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c2d833-5592-42fa-a66d-c6d974d7d619 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:03.464330 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1360/2739] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 14:01:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 14:01:03.472780 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d97440-ef64-465f-a988-3834ae073a0b None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:03.490924 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d97440-ef64-465f-a988-3834ae073a0b None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:03.500518 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7453c3-f8ba-41a9-8a44-da83c563303c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:03.501623 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7453c3-f8ba-41a9-8a44-da83c563303c admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:03.502145 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7453c3-f8ba-41a9-8a44-da83c563303c admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:03.502658 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7453c3-f8ba-41a9-8a44-da83c563303c admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:03.503942 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7453c3-f8ba-41a9-8a44-da83c563303c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:03.509708 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7453c3-f8ba-41a9-8a44-da83c563303c admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:03.552417 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1380/2740] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 14:01:03 2022] POST /identity/v3/projects => generated 387 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:01:03.559706 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c2d833-5592-42fa-a66d-c6d974d7d619 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:03.579344 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c2d833-5592-42fa-a66d-c6d974d7d619 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:03.610489 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:03.660748 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43fbd22-ae5c-4963-bc2c-c8f39872c8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:03.661346 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43fbd22-ae5c-4963-bc2c-c8f39872c8b2 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:03.661650 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43fbd22-ae5c-4963-bc2c-c8f39872c8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:03.661917 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43fbd22-ae5c-4963-bc2c-c8f39872c8b2 admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:03.662565 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43fbd22-ae5c-4963-bc2c-c8f39872c8b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:03.664667 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43fbd22-ae5c-4963-bc2c-c8f39872c8b2 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:03.699159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1361/2741] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 14:01:03 2022] POST /identity/v3/users => generated 294 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:01:03.704754 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7453c3-f8ba-41a9-8a44-da83c563303c admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:03.723324 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7453c3-f8ba-41a9-8a44-da83c563303c admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:03.729675 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783cccac-f674-479a-bea4-d6e926182c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:03.730463 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783cccac-f674-479a-bea4-d6e926182c26 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:03.730839 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783cccac-f674-479a-bea4-d6e926182c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:03.731227 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783cccac-f674-479a-bea4-d6e926182c26 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:03.732022 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783cccac-f674-479a-bea4-d6e926182c26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:03.734021 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783cccac-f674-479a-bea4-d6e926182c26 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:03.754249 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1381/2742] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 14:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:01:03.761341 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43fbd22-ae5c-4963-bc2c-c8f39872c8b2 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:03.779729 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43fbd22-ae5c-4963-bc2c-c8f39872c8b2 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:03.787654 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57adf8b1-6510-49c5-8ac4-af29d50b4b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:03.788649 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adf8b1-6510-49c5-8ac4-af29d50b4b76 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:03.789132 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adf8b1-6510-49c5-8ac4-af29d50b4b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:03.789623 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57adf8b1-6510-49c5-8ac4-af29d50b4b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:03.790797 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57adf8b1-6510-49c5-8ac4-af29d50b4b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:03.793748 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57adf8b1-6510-49c5-8ac4-af29d50b4b76 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:03.814949 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1362/2743] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 14:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:01:03.822846 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783cccac-f674-479a-bea4-d6e926182c26 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:03.852095 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783cccac-f674-479a-bea4-d6e926182c26 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:03.863670 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec52c45-6ec2-4ca1-a27a-c48c843ebcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:03.864658 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec52c45-6ec2-4ca1-a27a-c48c843ebcf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:03.865043 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec52c45-6ec2-4ca1-a27a-c48c843ebcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:03.867511 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec52c45-6ec2-4ca1-a27a-c48c843ebcf8 admin admin] PATH_INFO: `/v3/projects/048c226d6c2046258e3b4460608038bd/users/d9d89c59563d4796918ff3f758ec0cd6/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:03.888421 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec52c45-6ec2-4ca1-a27a-c48c843ebcf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=048c226d6c2046258e3b4460608038bd, user_id=d9d89c59563d4796918ff3f758ec0cd6, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:03.892891 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec52c45-6ec2-4ca1-a27a-c48c843ebcf8 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:03.911800 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1382/2744] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 14:01:03 2022] PUT /identity/v3/projects/048c226d6c2046258e3b4460608038bd/users/d9d89c59563d4796918ff3f758ec0cd6/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:01:03.935321 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dbfa08-acbf-4a32-92f4-ef0acd9e7196 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:03.935683 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dbfa08-acbf-4a32-92f4-ef0acd9e7196 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:03.935956 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dbfa08-acbf-4a32-92f4-ef0acd9e7196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:03.972240 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-29dbfa08-acbf-4a32-92f4-ef0acd9e7196 None None] MFA Rules not processed for user `d9d89c59563d4796918ff3f758ec0cd6`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:01:03.973555 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-29dbfa08-acbf-4a32-92f4-ef0acd9e7196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:04.089217 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1363/2745] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:01:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:01:04.095427 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec52c45-6ec2-4ca1-a27a-c48c843ebcf8 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:04.113947 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:04.204481 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec52c45-6ec2-4ca1-a27a-c48c843ebcf8 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:04.214612 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ce608-37c6-4ce7-8dca-c3524f37e28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:04.215684 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ce608-37c6-4ce7-8dca-c3524f37e28b admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:04.216174 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ce608-37c6-4ce7-8dca-c3524f37e28b admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:04.216654 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ce608-37c6-4ce7-8dca-c3524f37e28b admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:04.217873 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ce608-37c6-4ce7-8dca-c3524f37e28b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:04.222137 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ce608-37c6-4ce7-8dca-c3524f37e28b admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:04.275751 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1383/2746] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 14:01:04 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:01:04.280216 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dbfa08-acbf-4a32-92f4-ef0acd9e7196 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:04.291918 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dbfa08-acbf-4a32-92f4-ef0acd9e7196 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:04.383512 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdea7d8-b083-43fa-ad7b-26d720a0c861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:04.384635 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdea7d8-b083-43fa-ad7b-26d720a0c861 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:04.385176 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdea7d8-b083-43fa-ad7b-26d720a0c861 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:04.385741 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdea7d8-b083-43fa-ad7b-26d720a0c861 admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:04.387002 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdea7d8-b083-43fa-ad7b-26d720a0c861 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:04.390667 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdea7d8-b083-43fa-ad7b-26d720a0c861 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:04.439917 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1364/2747] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 14:01:04 2022] POST /identity/v3/users => generated 299 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:01:04.442131 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ce608-37c6-4ce7-8dca-c3524f37e28b admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:04.462452 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ce608-37c6-4ce7-8dca-c3524f37e28b admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:04.468400 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02689b8-1565-468c-a811-a66f04b33c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:04.469493 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02689b8-1565-468c-a811-a66f04b33c3e admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:04.469979 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02689b8-1565-468c-a811-a66f04b33c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:04.470628 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02689b8-1565-468c-a811-a66f04b33c3e admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:04.471360 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02689b8-1565-468c-a811-a66f04b33c3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:04.473249 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02689b8-1565-468c-a811-a66f04b33c3e admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:04.487881 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1384/2748] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 14:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:01:04.493387 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdea7d8-b083-43fa-ad7b-26d720a0c861 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:04.506421 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdea7d8-b083-43fa-ad7b-26d720a0c861 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:04.512186 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7cb1a1-00e3-4b26-aa33-d5a0e9749af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:04.512871 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7cb1a1-00e3-4b26-aa33-d5a0e9749af2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:04.513153 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7cb1a1-00e3-4b26-aa33-d5a0e9749af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:04.513644 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7cb1a1-00e3-4b26-aa33-d5a0e9749af2 admin admin] PATH_INFO: `/v3/projects/32c06e456266435895363ede58943769/users/4c71f0a7203c4aa8a367a709bbeb6aa6/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:04.535874 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7cb1a1-00e3-4b26-aa33-d5a0e9749af2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32c06e456266435895363ede58943769, user_id=4c71f0a7203c4aa8a367a709bbeb6aa6, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:04.538654 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7cb1a1-00e3-4b26-aa33-d5a0e9749af2 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:04.551062 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:04.564874 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1365/2749] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 14:01:04 2022] PUT /identity/v3/projects/32c06e456266435895363ede58943769/users/4c71f0a7203c4aa8a367a709bbeb6aa6/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:01:04.574439 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02689b8-1565-468c-a811-a66f04b33c3e admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:04.596372 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02689b8-1565-468c-a811-a66f04b33c3e admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:04.736045 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dddf777-f82c-48c1-9571-694e89016d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:04.737302 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddf777-f82c-48c1-9571-694e89016d2c admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:04.737874 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddf777-f82c-48c1-9571-694e89016d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:04.738381 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddf777-f82c-48c1-9571-694e89016d2c admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:04.739751 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dddf777-f82c-48c1-9571-694e89016d2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:04.744150 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dddf777-f82c-48c1-9571-694e89016d2c admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:04.768203 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1385/2750] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 14:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:01:04.777090 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7cb1a1-00e3-4b26-aa33-d5a0e9749af2 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:04.800263 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7cb1a1-00e3-4b26-aa33-d5a0e9749af2 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:04.809286 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73fc28-e36e-46e8-94bf-387dcb39f5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:04.810284 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73fc28-e36e-46e8-94bf-387dcb39f5ea admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:04.810615 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73fc28-e36e-46e8-94bf-387dcb39f5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:04.810946 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73fc28-e36e-46e8-94bf-387dcb39f5ea admin admin] PATH_INFO: `/v3/projects/32c06e456266435895363ede58943769/users/4c71f0a7203c4aa8a367a709bbeb6aa6/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:04.813834 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc73fc28-e36e-46e8-94bf-387dcb39f5ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=32c06e456266435895363ede58943769, user_id=4c71f0a7203c4aa8a367a709bbeb6aa6, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:04.817247 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc73fc28-e36e-46e8-94bf-387dcb39f5ea admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:04.849212 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1366/2751] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 14:01:04 2022] PUT /identity/v3/projects/32c06e456266435895363ede58943769/users/4c71f0a7203c4aa8a367a709bbeb6aa6/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:01:04.863323 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a4ee4-c6fb-4fb1-9748-3007e34e244f None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:04.863707 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a4ee4-c6fb-4fb1-9748-3007e34e244f None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:04.864008 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a4ee4-c6fb-4fb1-9748-3007e34e244f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:04.916806 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-285a4ee4-c6fb-4fb1-9748-3007e34e244f None None] MFA Rules not processed for user `4c71f0a7203c4aa8a367a709bbeb6aa6`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:01:04.918848 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-285a4ee4-c6fb-4fb1-9748-3007e34e244f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:05.064206 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1386/2752] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:01:04 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:01:05.077347 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73fc28-e36e-46e8-94bf-387dcb39f5ea admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:05.080230 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-dc73fc28-e36e-46e8-94bf-387dcb39f5ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:05.177324 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73fc28-e36e-46e8-94bf-387dcb39f5ea admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:05.184035 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724e872-5599-4026-907c-14064a2290d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:05.184897 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724e872-5599-4026-907c-14064a2290d8 service cinder] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:05.185336 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724e872-5599-4026-907c-14064a2290d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:05.185867 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724e872-5599-4026-907c-14064a2290d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:05.199766 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6724e872-5599-4026-907c-14064a2290d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:05.201639 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6724e872-5599-4026-907c-14064a2290d8 service cinder] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:05.214622 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1367/2753] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:01:05 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:01:06.127090 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a4ee4-c6fb-4fb1-9748-3007e34e244f None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:06.139818 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:06.249040 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a4ee4-c6fb-4fb1-9748-3007e34e244f None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:06.258172 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e23b87-22b2-41b4-a17a-0f7ee2e13b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:06.259413 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e23b87-22b2-41b4-a17a-0f7ee2e13b56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:06.259837 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e23b87-22b2-41b4-a17a-0f7ee2e13b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:06.260228 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e23b87-22b2-41b4-a17a-0f7ee2e13b56 admin admin] PATH_INFO: `/v3/users/d9d89c59563d4796918ff3f758ec0cd6` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:06.262278 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e23b87-22b2-41b4-a17a-0f7ee2e13b56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9d89c59563d4796918ff3f758ec0cd6)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:06.265550 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e23b87-22b2-41b4-a17a-0f7ee2e13b56 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:06.348928 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-c5e23b87-22b2-41b4-a17a-0f7ee2e13b56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9d89c59563d4796918ff3f758ec0cd6'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:06.349666 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-c5e23b87-22b2-41b4-a17a-0f7ee2e13b56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9d89c59563d4796918ff3f758ec0cd6'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:06.350276 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-c5e23b87-22b2-41b4-a17a-0f7ee2e13b56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9d89c59563d4796918ff3f758ec0cd6'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:06.360486 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-c5e23b87-22b2-41b4-a17a-0f7ee2e13b56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9d89c59563d4796918ff3f758ec0cd6'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:06.379282 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-c5e23b87-22b2-41b4-a17a-0f7ee2e13b56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9d89c59563d4796918ff3f758ec0cd6'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:06.399410 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1387/2754] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 14:01:06 2022] DELETE /identity/v3/users/d9d89c59563d4796918ff3f758ec0cd6 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:01:06.404813 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ca0d4-b7ea-4703-b01f-c784138edcb7 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:06.405737 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ca0d4-b7ea-4703-b01f-c784138edcb7 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:06.405737 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ca0d4-b7ea-4703-b01f-c784138edcb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:06.430595 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-534ca0d4-b7ea-4703-b01f-c784138edcb7 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:01:06.432447 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-534ca0d4-b7ea-4703-b01f-c784138edcb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:06.527419 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1368/2755] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:01:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:01:06.540078 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e23b87-22b2-41b4-a17a-0f7ee2e13b56 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:06.541945 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-c5e23b87-22b2-41b4-a17a-0f7ee2e13b56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:06.635080 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e23b87-22b2-41b4-a17a-0f7ee2e13b56 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:06.640094 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c824da-2202-4b07-abce-134e04bc2bf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:06.641166 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c824da-2202-4b07-abce-134e04bc2bf2 service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:06.641850 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c824da-2202-4b07-abce-134e04bc2bf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:06.642302 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c824da-2202-4b07-abce-134e04bc2bf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:06.658367 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c824da-2202-4b07-abce-134e04bc2bf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:06.660450 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c824da-2202-4b07-abce-134e04bc2bf2 service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:06.674111 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1388/2756] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:01:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:01:07.166184 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ca0d4-b7ea-4703-b01f-c784138edcb7 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:07.169235 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-534ca0d4-b7ea-4703-b01f-c784138edcb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:07.195880 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ca0d4-b7ea-4703-b01f-c784138edcb7 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:07.202525 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13c0a1-3f99-419c-b5e2-83dd5557c4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:07.203187 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13c0a1-3f99-419c-b5e2-83dd5557c4c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:07.203462 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13c0a1-3f99-419c-b5e2-83dd5557c4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:07.203747 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13c0a1-3f99-419c-b5e2-83dd5557c4c6 admin admin] PATH_INFO: `/v3/projects/048c226d6c2046258e3b4460608038bd` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:07.205086 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13c0a1-3f99-419c-b5e2-83dd5557c4c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=048c226d6c2046258e3b4460608038bd)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:07.207138 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13c0a1-3f99-419c-b5e2-83dd5557c4c6 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:07.296581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-ad13c0a1-3f99-419c-b5e2-83dd5557c4c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '048c226d6c2046258e3b4460608038bd', 'request_id': 'req-ad13c0a1-3f99-419c-b5e2-83dd5557c4c6'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:07.308230 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-ad13c0a1-3f99-419c-b5e2-83dd5557c4c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '048c226d6c2046258e3b4460608038bd', 'request_id': 'req-ad13c0a1-3f99-419c-b5e2-83dd5557c4c6'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:07.320191 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-ad13c0a1-3f99-419c-b5e2-83dd5557c4c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '048c226d6c2046258e3b4460608038bd', 'request_id': 'req-ad13c0a1-3f99-419c-b5e2-83dd5557c4c6'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:07.339887 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-ad13c0a1-3f99-419c-b5e2-83dd5557c4c6 admin admin] The token cache is being invalidate because project 048c226d6c2046258e3b4460608038bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:01:07.340231 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-ad13c0a1-3f99-419c-b5e2-83dd5557c4c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:07.340916 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-ad13c0a1-3f99-419c-b5e2-83dd5557c4c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:07.342518 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1369/2757] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 14:01:07 2022] DELETE /identity/v3/projects/048c226d6c2046258e3b4460608038bd => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:01:07.348558 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c824da-2202-4b07-abce-134e04bc2bf2 service neutron] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:07.362216 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c824da-2202-4b07-abce-134e04bc2bf2 service neutron] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:07.412417 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:07.482823 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34045ac-afbb-4b62-976f-4d935b499e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:07.483931 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34045ac-afbb-4b62-976f-4d935b499e3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:07.484447 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34045ac-afbb-4b62-976f-4d935b499e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:07.484957 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34045ac-afbb-4b62-976f-4d935b499e3b admin admin] PATH_INFO: `/v3/users/4c71f0a7203c4aa8a367a709bbeb6aa6` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:07.487286 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34045ac-afbb-4b62-976f-4d935b499e3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c71f0a7203c4aa8a367a709bbeb6aa6)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:07.491704 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34045ac-afbb-4b62-976f-4d935b499e3b admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:07.579990 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-c34045ac-afbb-4b62-976f-4d935b499e3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c71f0a7203c4aa8a367a709bbeb6aa6'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:07.581124 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-c34045ac-afbb-4b62-976f-4d935b499e3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c71f0a7203c4aa8a367a709bbeb6aa6'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:07.582214 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-c34045ac-afbb-4b62-976f-4d935b499e3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c71f0a7203c4aa8a367a709bbeb6aa6'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:07.596909 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-c34045ac-afbb-4b62-976f-4d935b499e3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c71f0a7203c4aa8a367a709bbeb6aa6'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:07.618646 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-c34045ac-afbb-4b62-976f-4d935b499e3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c71f0a7203c4aa8a367a709bbeb6aa6'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:07.637244 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1389/2758] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 14:01:07 2022] DELETE /identity/v3/users/4c71f0a7203c4aa8a367a709bbeb6aa6 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:01:08.103202 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13c0a1-3f99-419c-b5e2-83dd5557c4c6 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:08.105250 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-ad13c0a1-3f99-419c-b5e2-83dd5557c4c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:08.124930 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13c0a1-3f99-419c-b5e2-83dd5557c4c6 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:08.139813 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:08.214733 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6012c-6177-43d2-84a5-ad44efc69c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:08.215518 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6012c-6177-43d2-84a5-ad44efc69c7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:08.215907 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6012c-6177-43d2-84a5-ad44efc69c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:08.216272 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6012c-6177-43d2-84a5-ad44efc69c7e admin admin] PATH_INFO: `/v3/projects/32c06e456266435895363ede58943769` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:08.217813 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb6012c-6177-43d2-84a5-ad44efc69c7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=32c06e456266435895363ede58943769)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:08.220092 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb6012c-6177-43d2-84a5-ad44efc69c7e admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:08.286504 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-ffb6012c-6177-43d2-84a5-ad44efc69c7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32c06e456266435895363ede58943769', 'request_id': 'req-ffb6012c-6177-43d2-84a5-ad44efc69c7e'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:08.294846 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-ffb6012c-6177-43d2-84a5-ad44efc69c7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32c06e456266435895363ede58943769', 'request_id': 'req-ffb6012c-6177-43d2-84a5-ad44efc69c7e'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:08.302578 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-ffb6012c-6177-43d2-84a5-ad44efc69c7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32c06e456266435895363ede58943769', 'request_id': 'req-ffb6012c-6177-43d2-84a5-ad44efc69c7e'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:08.319583 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-ffb6012c-6177-43d2-84a5-ad44efc69c7e admin admin] The token cache is being invalidate because project 32c06e456266435895363ede58943769 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:01:08.319966 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-ffb6012c-6177-43d2-84a5-ad44efc69c7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:08.320791 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-ffb6012c-6177-43d2-84a5-ad44efc69c7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:08.322539 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1370/2759] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 14:01:08 2022] DELETE /identity/v3/projects/32c06e456266435895363ede58943769 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:01:08.329024 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25147859-a0f4-40ae-9060-838c3f55dde4 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:08.329447 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25147859-a0f4-40ae-9060-838c3f55dde4 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:08.329750 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25147859-a0f4-40ae-9060-838c3f55dde4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:08.365492 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-25147859-a0f4-40ae-9060-838c3f55dde4 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:01:08.368157 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-25147859-a0f4-40ae-9060-838c3f55dde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:08.450714 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1390/2760] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:01:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:01:08.459661 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776377d3-8626-4ff3-bd09-a3c120119d04 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:08.460510 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776377d3-8626-4ff3-bd09-a3c120119d04 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:08.460845 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776377d3-8626-4ff3-bd09-a3c120119d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:08.487460 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-776377d3-8626-4ff3-bd09-a3c120119d04 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:01:08.489168 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-776377d3-8626-4ff3-bd09-a3c120119d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:08.499693 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1371/2761] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:01:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:01:08.504720 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25147859-a0f4-40ae-9060-838c3f55dde4 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:08.516626 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25147859-a0f4-40ae-9060-838c3f55dde4 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:08.522809 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7560f9-46ac-41ab-a153-a3ba3936f624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:08.523490 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7560f9-46ac-41ab-a153-a3ba3936f624 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:08.523876 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7560f9-46ac-41ab-a153-a3ba3936f624 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:08.524210 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7560f9-46ac-41ab-a153-a3ba3936f624 admin admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:08.525278 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7560f9-46ac-41ab-a153-a3ba3936f624 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:01:08.525802 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7560f9-46ac-41ab-a153-a3ba3936f624 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:08.528527 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7560f9-46ac-41ab-a153-a3ba3936f624 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:08.543597 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1391/2762] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 14:01:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:01:08.548715 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776377d3-8626-4ff3-bd09-a3c120119d04 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:08.560051 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776377d3-8626-4ff3-bd09-a3c120119d04 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:08.565761 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc0b08-29cf-433b-a947-2ad779b90f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:08.566447 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc0b08-29cf-433b-a947-2ad779b90f20 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:08.566762 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc0b08-29cf-433b-a947-2ad779b90f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:08.567069 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc0b08-29cf-433b-a947-2ad779b90f20 admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:08.567766 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc0b08-29cf-433b-a947-2ad779b90f20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:08.571344 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc0b08-29cf-433b-a947-2ad779b90f20 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:08.611579 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1372/2763] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 14:01:08 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:01:08.617878 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7560f9-46ac-41ab-a153-a3ba3936f624 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:08.636227 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7560f9-46ac-41ab-a153-a3ba3936f624 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:08.678724 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:08.716954 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6ea45-0289-410f-aade-7d731e893413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:08.717613 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6ea45-0289-410f-aade-7d731e893413 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:08.717892 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6ea45-0289-410f-aade-7d731e893413 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:08.718163 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6ea45-0289-410f-aade-7d731e893413 admin admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:08.718812 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb6ea45-0289-410f-aade-7d731e893413 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:08.721293 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb6ea45-0289-410f-aade-7d731e893413 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:08.761452 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1392/2764] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 14:01:08 2022] POST /identity/v3/users => generated 293 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:01:08.763159 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc0b08-29cf-433b-a947-2ad779b90f20 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:08.775257 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc0b08-29cf-433b-a947-2ad779b90f20 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:08.783286 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f210477-ae94-40a9-88dd-527587322b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:08.783925 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f210477-ae94-40a9-88dd-527587322b68 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:08.784199 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f210477-ae94-40a9-88dd-527587322b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:08.784465 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f210477-ae94-40a9-88dd-527587322b68 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:08.785206 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f210477-ae94-40a9-88dd-527587322b68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:08.787140 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f210477-ae94-40a9-88dd-527587322b68 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:08.801752 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1373/2765] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 14:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:01:08.805982 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6ea45-0289-410f-aade-7d731e893413 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:08.826979 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6ea45-0289-410f-aade-7d731e893413 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:08.835754 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef29a3-5d49-4f6a-b979-9daa7f860614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:08.836733 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef29a3-5d49-4f6a-b979-9daa7f860614 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:08.837155 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef29a3-5d49-4f6a-b979-9daa7f860614 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:08.837690 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef29a3-5d49-4f6a-b979-9daa7f860614 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:08.838870 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef29a3-5d49-4f6a-b979-9daa7f860614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:08.842227 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef29a3-5d49-4f6a-b979-9daa7f860614 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:08.864653 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1393/2766] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 14:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:01:08.871342 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f210477-ae94-40a9-88dd-527587322b68 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:08.890038 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f210477-ae94-40a9-88dd-527587322b68 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:08.899293 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f77ac4-1839-4057-be78-871c69604c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:08.900420 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f77ac4-1839-4057-be78-871c69604c6d admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:08.900923 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f77ac4-1839-4057-be78-871c69604c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:08.901425 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f77ac4-1839-4057-be78-871c69604c6d admin admin] PATH_INFO: `/v3/projects/eca140ff24dc424b9e32922c19904248/users/b4addd78c56641efbca840b0de9274de/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:08.935976 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f77ac4-1839-4057-be78-871c69604c6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=eca140ff24dc424b9e32922c19904248, user_id=b4addd78c56641efbca840b0de9274de, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:08.941830 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f77ac4-1839-4057-be78-871c69604c6d admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:08.968299 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1374/2767] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 14:01:08 2022] PUT /identity/v3/projects/eca140ff24dc424b9e32922c19904248/users/b4addd78c56641efbca840b0de9274de/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:01:09.080513 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ba189-edbe-4b7b-be4e-7d1070b13e1c None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:09.081065 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ba189-edbe-4b7b-be4e-7d1070b13e1c None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:09.081624 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ba189-edbe-4b7b-be4e-7d1070b13e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:09.123493 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-f72ba189-edbe-4b7b-be4e-7d1070b13e1c None None] MFA Rules not processed for user `b4addd78c56641efbca840b0de9274de`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:01:09.124637 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-f72ba189-edbe-4b7b-be4e-7d1070b13e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:09.220917 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1394/2768] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:01:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:01:09.234337 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f77ac4-1839-4057-be78-871c69604c6d admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:09.236765 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-98f77ac4-1839-4057-be78-871c69604c6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:09.299199 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:09.335796 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f77ac4-1839-4057-be78-871c69604c6d admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:09.340056 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519421a8-ed6a-4c63-b007-863c81262429 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:09.341298 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519421a8-ed6a-4c63-b007-863c81262429 service cinder] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:09.341861 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519421a8-ed6a-4c63-b007-863c81262429 service cinder] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:09.342255 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519421a8-ed6a-4c63-b007-863c81262429 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:09.355536 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519421a8-ed6a-4c63-b007-863c81262429 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:09.357006 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519421a8-ed6a-4c63-b007-863c81262429 service cinder] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:09.368590 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1375/2769] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:01:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:01:15.282274 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ba189-edbe-4b7b-be4e-7d1070b13e1c None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:15.384465 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ba189-edbe-4b7b-be4e-7d1070b13e1c None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:15.392614 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640bb7e-31ea-42fa-9493-d5294996206b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:15.393760 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640bb7e-31ea-42fa-9493-d5294996206b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:15.394242 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640bb7e-31ea-42fa-9493-d5294996206b admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:15.394730 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640bb7e-31ea-42fa-9493-d5294996206b admin admin] PATH_INFO: `/v3/users/b4addd78c56641efbca840b0de9274de` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:15.396940 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d640bb7e-31ea-42fa-9493-d5294996206b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4addd78c56641efbca840b0de9274de)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:15.401974 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d640bb7e-31ea-42fa-9493-d5294996206b admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:15.475352 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:15.485695 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-d640bb7e-31ea-42fa-9493-d5294996206b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4addd78c56641efbca840b0de9274de'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:15.486999 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-d640bb7e-31ea-42fa-9493-d5294996206b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4addd78c56641efbca840b0de9274de'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:15.488028 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-d640bb7e-31ea-42fa-9493-d5294996206b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4addd78c56641efbca840b0de9274de'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:15.501583 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-d640bb7e-31ea-42fa-9493-d5294996206b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4addd78c56641efbca840b0de9274de'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:15.543216 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-d640bb7e-31ea-42fa-9493-d5294996206b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4addd78c56641efbca840b0de9274de'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:15.570662 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1395/2770] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 14:01:15 2022] DELETE /identity/v3/users/b4addd78c56641efbca840b0de9274de => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:01:15.576449 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d03665-7585-421b-913f-d382c5d4e0dd None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:15.577294 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d03665-7585-421b-913f-d382c5d4e0dd None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:15.577504 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d03665-7585-421b-913f-d382c5d4e0dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:15.604152 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-19d03665-7585-421b-913f-d382c5d4e0dd None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:01:15.605705 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-19d03665-7585-421b-913f-d382c5d4e0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:15.688670 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1376/2771] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:01:15.701897 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640bb7e-31ea-42fa-9493-d5294996206b admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:15.703877 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-d640bb7e-31ea-42fa-9493-d5294996206b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:15.799037 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640bb7e-31ea-42fa-9493-d5294996206b admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:15.807838 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f297d-3d1f-4efc-b5a8-fc1490d50864 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:15.808660 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f297d-3d1f-4efc-b5a8-fc1490d50864 service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:15.809068 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f297d-3d1f-4efc-b5a8-fc1490d50864 service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:15.809501 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f297d-3d1f-4efc-b5a8-fc1490d50864 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:15.823250 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250f297d-3d1f-4efc-b5a8-fc1490d50864 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:15.826186 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250f297d-3d1f-4efc-b5a8-fc1490d50864 service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:15.841898 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1396/2772] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:01:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:01:16.341188 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d03665-7585-421b-913f-d382c5d4e0dd None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:16.343913 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-19d03665-7585-421b-913f-d382c5d4e0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:16.375842 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d03665-7585-421b-913f-d382c5d4e0dd None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:16.387370 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca8423-8182-4592-b19d-c8d988372bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:16.388630 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca8423-8182-4592-b19d-c8d988372bb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:16.389260 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca8423-8182-4592-b19d-c8d988372bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:16.389426 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca8423-8182-4592-b19d-c8d988372bb2 admin admin] PATH_INFO: `/v3/projects/eca140ff24dc424b9e32922c19904248` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:16.391644 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca8423-8182-4592-b19d-c8d988372bb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eca140ff24dc424b9e32922c19904248)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:16.395538 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca8423-8182-4592-b19d-c8d988372bb2 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:16.492476 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-16ca8423-8182-4592-b19d-c8d988372bb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eca140ff24dc424b9e32922c19904248', 'request_id': 'req-16ca8423-8182-4592-b19d-c8d988372bb2'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:16.502519 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-16ca8423-8182-4592-b19d-c8d988372bb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eca140ff24dc424b9e32922c19904248', 'request_id': 'req-16ca8423-8182-4592-b19d-c8d988372bb2'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:16.511345 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-16ca8423-8182-4592-b19d-c8d988372bb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eca140ff24dc424b9e32922c19904248', 'request_id': 'req-16ca8423-8182-4592-b19d-c8d988372bb2'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:16.531583 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-16ca8423-8182-4592-b19d-c8d988372bb2 admin admin] The token cache is being invalidate because project eca140ff24dc424b9e32922c19904248 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:01:16.531915 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-16ca8423-8182-4592-b19d-c8d988372bb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:16.533977 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-16ca8423-8182-4592-b19d-c8d988372bb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:16.536314 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1377/2773] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 14:01:16 2022] DELETE /identity/v3/projects/eca140ff24dc424b9e32922c19904248 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:01:16.545270 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880248db-7cb3-4ac6-a7f7-49b341ca1ddc None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:16.545949 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880248db-7cb3-4ac6-a7f7-49b341ca1ddc None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:16.545949 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880248db-7cb3-4ac6-a7f7-49b341ca1ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:16.572185 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-880248db-7cb3-4ac6-a7f7-49b341ca1ddc None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:01:16.573704 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-880248db-7cb3-4ac6-a7f7-49b341ca1ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:16.687070 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1397/2774] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:01:16.698131 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206daebe-89f6-4805-bf86-c246688e7615 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:16.699009 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206daebe-89f6-4805-bf86-c246688e7615 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:16.699238 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206daebe-89f6-4805-bf86-c246688e7615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:16.724554 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-206daebe-89f6-4805-bf86-c246688e7615 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:01:16.726018 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-206daebe-89f6-4805-bf86-c246688e7615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:16.738326 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1378/2775] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:01:16.744023 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880248db-7cb3-4ac6-a7f7-49b341ca1ddc None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:16.758885 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880248db-7cb3-4ac6-a7f7-49b341ca1ddc None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:16.767578 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda9de9-9f33-4dcf-bb03-8c40a3833b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:16.768321 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda9de9-9f33-4dcf-bb03-8c40a3833b57 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:16.768601 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda9de9-9f33-4dcf-bb03-8c40a3833b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:16.768935 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda9de9-9f33-4dcf-bb03-8c40a3833b57 admin admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:16.769766 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dda9de9-9f33-4dcf-bb03-8c40a3833b57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:01:16.770101 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dda9de9-9f33-4dcf-bb03-8c40a3833b57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:16.771835 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dda9de9-9f33-4dcf-bb03-8c40a3833b57 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:16.787433 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1398/2776] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 14:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:01:16.792838 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206daebe-89f6-4805-bf86-c246688e7615 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:16.806361 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206daebe-89f6-4805-bf86-c246688e7615 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:16.814359 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e14bca-4972-4370-a79d-ce01eeef6b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:16.815393 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e14bca-4972-4370-a79d-ce01eeef6b50 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:16.815870 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e14bca-4972-4370-a79d-ce01eeef6b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:16.816349 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e14bca-4972-4370-a79d-ce01eeef6b50 admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:16.817554 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e14bca-4972-4370-a79d-ce01eeef6b50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:16.822139 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e14bca-4972-4370-a79d-ce01eeef6b50 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:16.861442 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1379/2777] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 14:01:16 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:01:16.864428 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda9de9-9f33-4dcf-bb03-8c40a3833b57 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:16.877085 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda9de9-9f33-4dcf-bb03-8c40a3833b57 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:16.937286 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:16.950414 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a529c3-de9c-4e3c-8ebb-8c3772606a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:16.951222 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a529c3-de9c-4e3c-8ebb-8c3772606a1a admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:16.951524 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a529c3-de9c-4e3c-8ebb-8c3772606a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:16.951817 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a529c3-de9c-4e3c-8ebb-8c3772606a1a admin admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:16.952853 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a529c3-de9c-4e3c-8ebb-8c3772606a1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:16.954872 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a529c3-de9c-4e3c-8ebb-8c3772606a1a admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:16.981271 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1399/2778] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 14:01:16 2022] POST /identity/v3/users => generated 287 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:01:16.987082 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e14bca-4972-4370-a79d-ce01eeef6b50 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:16.999703 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e14bca-4972-4370-a79d-ce01eeef6b50 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:17.005083 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed45db-5d7a-4add-a04d-403527c4a73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:17.005871 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed45db-5d7a-4add-a04d-403527c4a73d admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:17.006208 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed45db-5d7a-4add-a04d-403527c4a73d admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:17.007118 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed45db-5d7a-4add-a04d-403527c4a73d admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:17.008047 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed45db-5d7a-4add-a04d-403527c4a73d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:17.009845 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed45db-5d7a-4add-a04d-403527c4a73d admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:17.022707 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1380/2779] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 14:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:01:17.028248 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a529c3-de9c-4e3c-8ebb-8c3772606a1a admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:17.041293 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a529c3-de9c-4e3c-8ebb-8c3772606a1a admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:17.046587 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dca230-6425-4e7f-9ee6-be44be1e9441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:17.047272 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dca230-6425-4e7f-9ee6-be44be1e9441 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:17.047671 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dca230-6425-4e7f-9ee6-be44be1e9441 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:17.047990 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dca230-6425-4e7f-9ee6-be44be1e9441 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:17.048806 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dca230-6425-4e7f-9ee6-be44be1e9441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:17.050627 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dca230-6425-4e7f-9ee6-be44be1e9441 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:17.065122 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1400/2780] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 14:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:01:17.070928 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed45db-5d7a-4add-a04d-403527c4a73d admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:17.089962 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed45db-5d7a-4add-a04d-403527c4a73d admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:17.098414 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c928814-ed1e-4346-9fd2-fbf8132975ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:17.099520 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c928814-ed1e-4346-9fd2-fbf8132975ab admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:17.099931 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c928814-ed1e-4346-9fd2-fbf8132975ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:17.100595 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c928814-ed1e-4346-9fd2-fbf8132975ab admin admin] PATH_INFO: `/v3/projects/c31367f8a7d142efb35e93601ba0be2a/users/b0182f6c243e435d8bb81f33995f9a2a/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:17.130161 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c928814-ed1e-4346-9fd2-fbf8132975ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=c31367f8a7d142efb35e93601ba0be2a, user_id=b0182f6c243e435d8bb81f33995f9a2a, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:17.136335 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c928814-ed1e-4346-9fd2-fbf8132975ab admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:17.151140 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:17.161959 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1381/2781] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 14:01:17 2022] PUT /identity/v3/projects/c31367f8a7d142efb35e93601ba0be2a/users/b0182f6c243e435d8bb81f33995f9a2a/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:01:17.171712 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94d008-5912-483d-b8b6-5b1975aa1f7f None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:17.172202 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94d008-5912-483d-b8b6-5b1975aa1f7f None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:17.172692 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94d008-5912-483d-b8b6-5b1975aa1f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:17.203340 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-8f94d008-5912-483d-b8b6-5b1975aa1f7f None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:01:17.205132 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-8f94d008-5912-483d-b8b6-5b1975aa1f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:17.312061 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1401/2782] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:01:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:01:17.324564 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c928814-ed1e-4346-9fd2-fbf8132975ab admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:17.328272 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-2c928814-ed1e-4346-9fd2-fbf8132975ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:17.405761 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c928814-ed1e-4346-9fd2-fbf8132975ab admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:17.409968 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa974f-b43c-4fd9-ab98-f1901e3ddbff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:17.410611 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa974f-b43c-4fd9-ab98-f1901e3ddbff service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:17.410894 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa974f-b43c-4fd9-ab98-f1901e3ddbff service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:17.411170 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa974f-b43c-4fd9-ab98-f1901e3ddbff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:17.424288 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa974f-b43c-4fd9-ab98-f1901e3ddbff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:17.425922 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa974f-b43c-4fd9-ab98-f1901e3ddbff service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:17.437797 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1382/2783] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:01:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:01:24.677018 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490b5ba-c3c0-4dc2-be30-56b428231458 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:24.677846 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490b5ba-c3c0-4dc2-be30-56b428231458 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:24.677846 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490b5ba-c3c0-4dc2-be30-56b428231458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:24.719786 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-4490b5ba-c3c0-4dc2-be30-56b428231458 None None] MFA Rules not processed for user `b0182f6c243e435d8bb81f33995f9a2a`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:01:24.721073 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-4490b5ba-c3c0-4dc2-be30-56b428231458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:24.838902 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1402/2784] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:01:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:01:24.844180 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa974f-b43c-4fd9-ab98-f1901e3ddbff service neutron] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:24.862449 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa974f-b43c-4fd9-ab98-f1901e3ddbff service neutron] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:24.871659 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d117f1f-201d-49b5-957e-46994eefa7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:24.872611 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d117f1f-201d-49b5-957e-46994eefa7ba admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:24.873112 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d117f1f-201d-49b5-957e-46994eefa7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:24.873678 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d117f1f-201d-49b5-957e-46994eefa7ba admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:24.874839 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d117f1f-201d-49b5-957e-46994eefa7ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:24.878542 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d117f1f-201d-49b5-957e-46994eefa7ba admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:24.935369 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1383/2785] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 14:01:24 2022] POST /identity/v3/projects => generated 373 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:01:24.937470 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490b5ba-c3c0-4dc2-be30-56b428231458 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:24.956550 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490b5ba-c3c0-4dc2-be30-56b428231458 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:25.095812 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f89702-7e18-41ad-bde6-64f28c7e768b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:25.096993 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f89702-7e18-41ad-bde6-64f28c7e768b admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:25.097540 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f89702-7e18-41ad-bde6-64f28c7e768b admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:25.098130 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f89702-7e18-41ad-bde6-64f28c7e768b admin admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:25.099091 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f89702-7e18-41ad-bde6-64f28c7e768b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:25.102925 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f89702-7e18-41ad-bde6-64f28c7e768b admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:25.139585 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:25.163529 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1403/2786] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 14:01:24 2022] POST /identity/v3/users => generated 293 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:01:25.185753 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d117f1f-201d-49b5-957e-46994eefa7ba admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:25.214634 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d117f1f-201d-49b5-957e-46994eefa7ba admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:25.218806 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f89702-7e18-41ad-bde6-64f28c7e768b admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:25.223190 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-31f89702-7e18-41ad-bde6-64f28c7e768b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:25.224366 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b628ee3-2c16-4eb3-a89a-7df288a9a0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:25.227032 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b628ee3-2c16-4eb3-a89a-7df288a9a0de admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:25.227580 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b628ee3-2c16-4eb3-a89a-7df288a9a0de admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:25.228141 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b628ee3-2c16-4eb3-a89a-7df288a9a0de admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:25.229153 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b628ee3-2c16-4eb3-a89a-7df288a9a0de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:25.231290 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b628ee3-2c16-4eb3-a89a-7df288a9a0de admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:25.265599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1384/2787] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 14:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:01:25.267974 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b628ee3-2c16-4eb3-a89a-7df288a9a0de admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:25.288123 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b628ee3-2c16-4eb3-a89a-7df288a9a0de admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:25.300431 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130135da-b445-4c97-b05c-6b01976d9d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:25.301341 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130135da-b445-4c97-b05c-6b01976d9d24 admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:25.301761 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130135da-b445-4c97-b05c-6b01976d9d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:25.302177 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130135da-b445-4c97-b05c-6b01976d9d24 admin admin] PATH_INFO: `/v3/projects/04e8c22d1c7f46a18922cf91dca057b3/users/c9825c72ba684b5791eddb31ff894dad/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:25.328002 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130135da-b445-4c97-b05c-6b01976d9d24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04e8c22d1c7f46a18922cf91dca057b3, user_id=c9825c72ba684b5791eddb31ff894dad, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:25.330900 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130135da-b445-4c97-b05c-6b01976d9d24 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:25.352528 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1385/2788] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 14:01:25 2022] PUT /identity/v3/projects/04e8c22d1c7f46a18922cf91dca057b3/users/c9825c72ba684b5791eddb31ff894dad/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:01:25.358317 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f89702-7e18-41ad-bde6-64f28c7e768b admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:25.359292 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130135da-b445-4c97-b05c-6b01976d9d24 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:25.448104 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53858def-e9c5-49d1-86f6-26aaee13caec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:25.448974 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53858def-e9c5-49d1-86f6-26aaee13caec service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:25.449412 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53858def-e9c5-49d1-86f6-26aaee13caec service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:25.449802 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53858def-e9c5-49d1-86f6-26aaee13caec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:25.452611 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-53858def-e9c5-49d1-86f6-26aaee13caec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:25.464773 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130135da-b445-4c97-b05c-6b01976d9d24 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:25.471532 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53858def-e9c5-49d1-86f6-26aaee13caec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:25.472220 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e08a1-934a-40ef-98cb-2911a4052734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:25.473023 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e08a1-934a-40ef-98cb-2911a4052734 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:25.473533 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e08a1-934a-40ef-98cb-2911a4052734 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:25.473954 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e08a1-934a-40ef-98cb-2911a4052734 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:25.474159 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53858def-e9c5-49d1-86f6-26aaee13caec service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:25.474852 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e08a1-934a-40ef-98cb-2911a4052734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:25.477267 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e08a1-934a-40ef-98cb-2911a4052734 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:25.490175 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1404/2789] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:01:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:01:25.500893 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1386/2790] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 14:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:01:25.502238 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53858def-e9c5-49d1-86f6-26aaee13caec service neutron] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:25.522237 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53858def-e9c5-49d1-86f6-26aaee13caec service neutron] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:25.537844 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15969dbb-7bdb-4cb8-a4a6-d2634b38ed40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:25.539153 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15969dbb-7bdb-4cb8-a4a6-d2634b38ed40 admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:25.539663 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15969dbb-7bdb-4cb8-a4a6-d2634b38ed40 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:25.540135 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15969dbb-7bdb-4cb8-a4a6-d2634b38ed40 admin admin] PATH_INFO: `/v3/projects/04e8c22d1c7f46a18922cf91dca057b3/users/c9825c72ba684b5791eddb31ff894dad/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:25.546458 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15969dbb-7bdb-4cb8-a4a6-d2634b38ed40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04e8c22d1c7f46a18922cf91dca057b3, user_id=c9825c72ba684b5791eddb31ff894dad, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:25.550805 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15969dbb-7bdb-4cb8-a4a6-d2634b38ed40 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:25.574365 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1405/2791] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 14:01:25 2022] PUT /identity/v3/projects/04e8c22d1c7f46a18922cf91dca057b3/users/c9825c72ba684b5791eddb31ff894dad/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:01:32.936196 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e08a1-934a-40ef-98cb-2911a4052734 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:32.939603 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-de4e08a1-934a-40ef-98cb-2911a4052734 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:33.011920 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e08a1-934a-40ef-98cb-2911a4052734 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:33.130397 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:33.173564 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d89cb-52c3-4582-89ec-ff2672f0a249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:33.175770 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d89cb-52c3-4582-89ec-ff2672f0a249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:33.176042 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d89cb-52c3-4582-89ec-ff2672f0a249 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:33.176314 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d89cb-52c3-4582-89ec-ff2672f0a249 admin admin] PATH_INFO: `/v3/users/c38575a2f7bc408f8b5eb58ad513c078` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:33.182692 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d89cb-52c3-4582-89ec-ff2672f0a249 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c38575a2f7bc408f8b5eb58ad513c078)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:33.185669 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d89cb-52c3-4582-89ec-ff2672f0a249 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:33.266829 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-167d89cb-52c3-4582-89ec-ff2672f0a249 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c38575a2f7bc408f8b5eb58ad513c078'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:33.269154 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-167d89cb-52c3-4582-89ec-ff2672f0a249 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c38575a2f7bc408f8b5eb58ad513c078'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:33.285985 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-167d89cb-52c3-4582-89ec-ff2672f0a249 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c38575a2f7bc408f8b5eb58ad513c078'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:33.310317 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-167d89cb-52c3-4582-89ec-ff2672f0a249 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c38575a2f7bc408f8b5eb58ad513c078'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:33.311106 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-167d89cb-52c3-4582-89ec-ff2672f0a249 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c38575a2f7bc408f8b5eb58ad513c078'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:33.332802 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1387/2792] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 14:01:32 2022] DELETE /identity/v3/users/c38575a2f7bc408f8b5eb58ad513c078 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:01:33.700129 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15969dbb-7bdb-4cb8-a4a6-d2634b38ed40 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:33.704617 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-15969dbb-7bdb-4cb8-a4a6-d2634b38ed40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:33.770510 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15969dbb-7bdb-4cb8-a4a6-d2634b38ed40 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:33.908177 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4840c233-880d-43d7-b650-b1ab0125e308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:33.909205 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840c233-880d-43d7-b650-b1ab0125e308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:33.909551 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840c233-880d-43d7-b650-b1ab0125e308 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:33.909811 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4840c233-880d-43d7-b650-b1ab0125e308 admin admin] PATH_INFO: `/v3/projects/93f83ce5a70c436592711252a06c3814` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:33.914977 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4840c233-880d-43d7-b650-b1ab0125e308 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93f83ce5a70c436592711252a06c3814)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:33.918020 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4840c233-880d-43d7-b650-b1ab0125e308 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:33.987751 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6dd36f-ef56-4b5e-8c9a-de22c81f0644 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:33.988556 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6dd36f-ef56-4b5e-8c9a-de22c81f0644 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:33.988747 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6dd36f-ef56-4b5e-8c9a-de22c81f0644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:34.048051 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:INSERT=3,keystone:SELECT=94,keystone:DELETE=3 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:34.054059 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-cb6dd36f-ef56-4b5e-8c9a-de22c81f0644 None None] MFA Rules not processed for user `c9825c72ba684b5791eddb31ff894dad`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:01:34.058158 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-cb6dd36f-ef56-4b5e-8c9a-de22c81f0644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:34.067934 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-4840c233-880d-43d7-b650-b1ab0125e308 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93f83ce5a70c436592711252a06c3814', 'request_id': 'req-4840c233-880d-43d7-b650-b1ab0125e308'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:34.078703 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-4840c233-880d-43d7-b650-b1ab0125e308 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93f83ce5a70c436592711252a06c3814', 'request_id': 'req-4840c233-880d-43d7-b650-b1ab0125e308'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:34.087817 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-4840c233-880d-43d7-b650-b1ab0125e308 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93f83ce5a70c436592711252a06c3814', 'request_id': 'req-4840c233-880d-43d7-b650-b1ab0125e308'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:34.110161 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-4840c233-880d-43d7-b650-b1ab0125e308 admin admin] The token cache is being invalidate because project 93f83ce5a70c436592711252a06c3814 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:01:34.111086 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-4840c233-880d-43d7-b650-b1ab0125e308 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:34.111828 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-4840c233-880d-43d7-b650-b1ab0125e308 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:01:34.117404 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1406/2793] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 14:01:33 2022] DELETE /identity/v3/projects/93f83ce5a70c436592711252a06c3814 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:01:34.126540 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6eccd9-5011-4c96-9d5a-5dd2b72d1eac None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:34.127461 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6eccd9-5011-4c96-9d5a-5dd2b72d1eac None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:34.127811 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6eccd9-5011-4c96-9d5a-5dd2b72d1eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:34.153880 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-eb6eccd9-5011-4c96-9d5a-5dd2b72d1eac None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:01:34.155270 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-eb6eccd9-5011-4c96-9d5a-5dd2b72d1eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:34.185599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1388/2794] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:01:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:01:34.200583 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6dd36f-ef56-4b5e-8c9a-de22c81f0644 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:34.202828 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-cb6dd36f-ef56-4b5e-8c9a-de22c81f0644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:34.264269 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1407/2795] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:01:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:01:34.274236 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:34.274559 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c24ffa-162f-4db8-8d65-611810200432 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:34.275690 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c24ffa-162f-4db8-8d65-611810200432 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:34.276265 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c24ffa-162f-4db8-8d65-611810200432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:34.310711 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-f2c24ffa-162f-4db8-8d65-611810200432 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:01:34.312332 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-f2c24ffa-162f-4db8-8d65-611810200432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:34.327784 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1408/2796] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:01:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:01:34.330114 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6dd36f-ef56-4b5e-8c9a-de22c81f0644 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:34.330873 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c24ffa-162f-4db8-8d65-611810200432 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:34.340062 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d473c7-17e4-4918-9d24-13c2f821fbc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:34.341008 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d473c7-17e4-4918-9d24-13c2f821fbc5 service nova] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:34.341516 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d473c7-17e4-4918-9d24-13c2f821fbc5 service nova] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:34.341824 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d473c7-17e4-4918-9d24-13c2f821fbc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:34.344266 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c24ffa-162f-4db8-8d65-611810200432 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:34.344525 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-f4d473c7-17e4-4918-9d24-13c2f821fbc5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:34.352492 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a9a48-ea9d-4087-afc8-416eca87a5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:34.353772 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a9a48-ea9d-4087-afc8-416eca87a5c9 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:34.354235 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a9a48-ea9d-4087-afc8-416eca87a5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:34.355562 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a9a48-ea9d-4087-afc8-416eca87a5c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:34.356142 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a9a48-ea9d-4087-afc8-416eca87a5c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:01:34.356900 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a9a48-ea9d-4087-afc8-416eca87a5c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:34.359869 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883a9a48-ea9d-4087-afc8-416eca87a5c9 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:34.382769 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1409/2797] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 14:01:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:01:34.387139 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a9a48-ea9d-4087-afc8-416eca87a5c9 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:34.401420 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a9a48-ea9d-4087-afc8-416eca87a5c9 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:34.406519 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89636cba-64b8-46d9-a840-8d94d9cddee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:34.407125 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89636cba-64b8-46d9-a840-8d94d9cddee3 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:34.407408 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89636cba-64b8-46d9-a840-8d94d9cddee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:34.407683 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89636cba-64b8-46d9-a840-8d94d9cddee3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:34.408351 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89636cba-64b8-46d9-a840-8d94d9cddee3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:34.410354 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89636cba-64b8-46d9-a840-8d94d9cddee3 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:34.450080 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d473c7-17e4-4918-9d24-13c2f821fbc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:34.452178 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d473c7-17e4-4918-9d24-13c2f821fbc5 service nova] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:34.453857 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1410/2798] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 14:01:34 2022] POST /identity/v3/projects => generated 375 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:01:34.454837 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89636cba-64b8-46d9-a840-8d94d9cddee3 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:34.464817 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1389/2799] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:01:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:01:34.583554 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89636cba-64b8-46d9-a840-8d94d9cddee3 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:34.600247 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb0ba2-9fdf-4f42-8ff4-ca5c24673c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:34.601157 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb0ba2-9fdf-4f42-8ff4-ca5c24673c01 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:34.601635 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb0ba2-9fdf-4f42-8ff4-ca5c24673c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:34.602416 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fb0ba2-9fdf-4f42-8ff4-ca5c24673c01 admin admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:34.603086 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fb0ba2-9fdf-4f42-8ff4-ca5c24673c01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:34.605123 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fb0ba2-9fdf-4f42-8ff4-ca5c24673c01 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:34.675361 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1411/2800] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 14:01:34 2022] POST /identity/v3/users => generated 288 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:01:34.677010 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d473c7-17e4-4918-9d24-13c2f821fbc5 service nova] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:34.702555 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d473c7-17e4-4918-9d24-13c2f821fbc5 service nova] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:34.715564 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf6248a-50e1-4a50-90ff-af7b0a84b974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:34.716933 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6248a-50e1-4a50-90ff-af7b0a84b974 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:34.717516 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6248a-50e1-4a50-90ff-af7b0a84b974 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:34.718448 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf6248a-50e1-4a50-90ff-af7b0a84b974 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:34.719992 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf6248a-50e1-4a50-90ff-af7b0a84b974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:34.722964 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf6248a-50e1-4a50-90ff-af7b0a84b974 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:34.749454 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1390/2801] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 14:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:01:34.751924 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb0ba2-9fdf-4f42-8ff4-ca5c24673c01 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:34.770383 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fb0ba2-9fdf-4f42-8ff4-ca5c24673c01 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:34.779048 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd64389-2f3b-4a8c-807b-13c9987b2c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:34.779945 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd64389-2f3b-4a8c-807b-13c9987b2c73 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:34.780393 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd64389-2f3b-4a8c-807b-13c9987b2c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:34.780839 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd64389-2f3b-4a8c-807b-13c9987b2c73 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:34.781629 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd64389-2f3b-4a8c-807b-13c9987b2c73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:34.783489 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd64389-2f3b-4a8c-807b-13c9987b2c73 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:34.806049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1412/2802] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 14:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:01:34.806543 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf6248a-50e1-4a50-90ff-af7b0a84b974 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:34.820646 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf6248a-50e1-4a50-90ff-af7b0a84b974 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:34.826793 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6767d2-9a1a-4909-8cd7-dc46870a0d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:34.827580 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6767d2-9a1a-4909-8cd7-dc46870a0d67 admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:34.827916 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6767d2-9a1a-4909-8cd7-dc46870a0d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:34.828214 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6767d2-9a1a-4909-8cd7-dc46870a0d67 admin admin] PATH_INFO: `/v3/projects/7ecffc112daa478e9ba541f14f303456/users/54679e11eed24535b4f1c389dfa5f3d3/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:34.856651 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6767d2-9a1a-4909-8cd7-dc46870a0d67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ecffc112daa478e9ba541f14f303456, user_id=54679e11eed24535b4f1c389dfa5f3d3, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:34.862228 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6767d2-9a1a-4909-8cd7-dc46870a0d67 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:34.899231 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f82238-dd85-4ee9-8801-5c34a32bf450 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:34.900300 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f82238-dd85-4ee9-8801-5c34a32bf450 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:34.900998 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f82238-dd85-4ee9-8801-5c34a32bf450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:34.906898 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1391/2803] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 14:01:34 2022] PUT /identity/v3/projects/7ecffc112daa478e9ba541f14f303456/users/54679e11eed24535b4f1c389dfa5f3d3/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:01:34.931795 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:34.949014 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-b2f82238-dd85-4ee9-8801-5c34a32bf450 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:01:34.952667 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-b2f82238-dd85-4ee9-8801-5c34a32bf450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:35.094738 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1413/2804] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:01:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:01:35.108187 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6767d2-9a1a-4909-8cd7-dc46870a0d67 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:35.117993 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-1c6767d2-9a1a-4909-8cd7-dc46870a0d67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:35.253124 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6767d2-9a1a-4909-8cd7-dc46870a0d67 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:35.264852 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355c34a-007b-435e-b7fe-f909369e8950 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:35.266996 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355c34a-007b-435e-b7fe-f909369e8950 service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:35.267462 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355c34a-007b-435e-b7fe-f909369e8950 service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:35.267899 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355c34a-007b-435e-b7fe-f909369e8950 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:35.301351 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355c34a-007b-435e-b7fe-f909369e8950 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:35.303465 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355c34a-007b-435e-b7fe-f909369e8950 service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:35.322202 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1392/2805] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:01:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:01:36.461169 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8158f-3a8c-4d9f-a918-d7cb443b3690 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:36.462799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8158f-3a8c-4d9f-a918-d7cb443b3690 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:36.463286 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8158f-3a8c-4d9f-a918-d7cb443b3690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:36.506840 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-56f8158f-3a8c-4d9f-a918-d7cb443b3690 None None] MFA Rules not processed for user `b0182f6c243e435d8bb81f33995f9a2a`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:01:36.508848 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-56f8158f-3a8c-4d9f-a918-d7cb443b3690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:36.733065 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1414/2806] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:01:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:01:43.554006 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251337b5-426b-4f51-aef0-7bc66053fbd6 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:43.554868 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251337b5-426b-4f51-aef0-7bc66053fbd6 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:43.554868 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251337b5-426b-4f51-aef0-7bc66053fbd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:43.591197 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-251337b5-426b-4f51-aef0-7bc66053fbd6 None None] MFA Rules not processed for user `54679e11eed24535b4f1c389dfa5f3d3`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:01:43.592627 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-251337b5-426b-4f51-aef0-7bc66053fbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:43.650052 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:43.699558 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1393/2807] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:01:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:01:43.728626 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8158f-3a8c-4d9f-a918-d7cb443b3690 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:01:43.730878 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-56f8158f-3a8c-4d9f-a918-d7cb443b3690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:43.861428 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8158f-3a8c-4d9f-a918-d7cb443b3690 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:01:43.868503 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd2134-1dfe-46de-8e39-a2f112dd0706 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:01:43.869149 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd2134-1dfe-46de-8e39-a2f112dd0706 service nova] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:43.869590 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd2134-1dfe-46de-8e39-a2f112dd0706 service nova] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:43.869758 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd2134-1dfe-46de-8e39-a2f112dd0706 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:43.883411 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fd2134-1dfe-46de-8e39-a2f112dd0706 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:01:43.885046 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fd2134-1dfe-46de-8e39-a2f112dd0706 service nova] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:01:43.897922 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1415/2808] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:01:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:01:46.157142 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f62e75-c54d-413f-8e7a-dc6c1251da1a None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:01:46.158010 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f62e75-c54d-413f-8e7a-dc6c1251da1a None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:01:46.158162 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f62e75-c54d-413f-8e7a-dc6c1251da1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:01:46.185789 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-f0f62e75-c54d-413f-8e7a-dc6c1251da1a None None] MFA Rules not processed for user `54679e11eed24535b4f1c389dfa5f3d3`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:01:46.188165 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-f0f62e75-c54d-413f-8e7a-dc6c1251da1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:01:46.199984 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1394/2809] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:01:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:01:53.890880 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=84 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:56.176755 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=12 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:07.283205 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd2134-1dfe-46de-8e39-a2f112dd0706 service nova] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:02:07.284952 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-b8fd2134-1dfe-46de-8e39-a2f112dd0706 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:07.300194 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd2134-1dfe-46de-8e39-a2f112dd0706 service nova] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:02:07.304133 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913bcca8-e53d-4935-86e3-1dd9e8e46e79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:02:07.304749 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913bcca8-e53d-4935-86e3-1dd9e8e46e79 service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:07.305089 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913bcca8-e53d-4935-86e3-1dd9e8e46e79 service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:07.305598 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913bcca8-e53d-4935-86e3-1dd9e8e46e79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:07.401413 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913bcca8-e53d-4935-86e3-1dd9e8e46e79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:02:07.403114 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913bcca8-e53d-4935-86e3-1dd9e8e46e79 service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:02:07.415241 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1416/2810] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:02:07 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:02:17.409599 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=30 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:44.182355 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f62e75-c54d-413f-8e7a-dc6c1251da1a None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:02:44.184193 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-f0f62e75-c54d-413f-8e7a-dc6c1251da1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:44.273765 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f62e75-c54d-413f-8e7a-dc6c1251da1a None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:02:44.278708 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf23c8e-b65b-4094-a41f-57fd937f85ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:02:44.279613 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf23c8e-b65b-4094-a41f-57fd937f85ec service cinder] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:44.279871 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf23c8e-b65b-4094-a41f-57fd937f85ec service cinder] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:44.280147 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf23c8e-b65b-4094-a41f-57fd937f85ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:44.282350 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-aaf23c8e-b65b-4094-a41f-57fd937f85ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:44.299938 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf23c8e-b65b-4094-a41f-57fd937f85ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:02:44.301668 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf23c8e-b65b-4094-a41f-57fd937f85ec service cinder] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:02:44.316093 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1395/2811] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:02:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:02:48.563906 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913bcca8-e53d-4935-86e3-1dd9e8e46e79 service neutron] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:02:48.581270 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913bcca8-e53d-4935-86e3-1dd9e8e46e79 service neutron] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:02:48.586714 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20ddf2-379d-4b2a-b1f4-a916b7e5b287 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:02:48.587349 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20ddf2-379d-4b2a-b1f4-a916b7e5b287 service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:02:48.587627 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20ddf2-379d-4b2a-b1f4-a916b7e5b287 service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:02:48.587899 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20ddf2-379d-4b2a-b1f4-a916b7e5b287 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:02:48.590416 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-7d20ddf2-379d-4b2a-b1f4-a916b7e5b287 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:02:48.612879 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d20ddf2-379d-4b2a-b1f4-a916b7e5b287 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:02:48.615310 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d20ddf2-379d-4b2a-b1f4-a916b7e5b287 service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:02:48.630294 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1417/2812] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:02:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:02:54.309592 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=26 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:02:58.623762 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=6 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:51.140586 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf23c8e-b65b-4094-a41f-57fd937f85ec service cinder] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:03:51.158324 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf23c8e-b65b-4094-a41f-57fd937f85ec service cinder] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:03:51.163864 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b55466-d2ca-4424-a0a7-85e0d8287712 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:03:51.164672 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b55466-d2ca-4424-a0a7-85e0d8287712 service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:03:51.165163 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b55466-d2ca-4424-a0a7-85e0d8287712 service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:03:51.165703 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b55466-d2ca-4424-a0a7-85e0d8287712 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:03:51.168761 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-a6b55466-d2ca-4424-a0a7-85e0d8287712 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:03:51.188396 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b55466-d2ca-4424-a0a7-85e0d8287712 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:03:51.191454 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b55466-d2ca-4424-a0a7-85e0d8287712 service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:03:51.204358 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1396/2813] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:03:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:04:01.199764 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=6 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:21.253050 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db2378-9976-47ef-b32f-66e41a9f45de None None] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:21.254169 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db2378-9976-47ef-b32f-66e41a9f45de None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:21.254169 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db2378-9976-47ef-b32f-66e41a9f45de None None] PATH_INFO: `/` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:21.255486 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1418/2814] 10.222.0.69 () {54 vars in 921 bytes} [Thu Sep 8 14:04:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 08 14:04:21.264581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee86671-b374-48ee-aaa7-37da0adef5aa None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:21.265640 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee86671-b374-48ee-aaa7-37da0adef5aa None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:21.265640 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee86671-b374-48ee-aaa7-37da0adef5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:21.322401 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-3ee86671-b374-48ee-aaa7-37da0adef5aa None None] MFA Rules not processed for user `db898158553743d3a28f3d6237e91a8b`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:21.323972 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-3ee86671-b374-48ee-aaa7-37da0adef5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:21.332742 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1397/2815] 10.222.0.69 () {58 vars in 1018 bytes} [Thu Sep 8 14:04:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:04:21.351909 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db2378-9976-47ef-b32f-66e41a9f45de None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:21.366555 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db2378-9976-47ef-b32f-66e41a9f45de None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:21.372423 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446b0fd-fc22-4510-9705-6667ff310ea9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:21.373053 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446b0fd-fc22-4510-9705-6667ff310ea9 service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:21.373335 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446b0fd-fc22-4510-9705-6667ff310ea9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:21.373647 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446b0fd-fc22-4510-9705-6667ff310ea9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:21.384256 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8446b0fd-fc22-4510-9705-6667ff310ea9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:21.386054 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8446b0fd-fc22-4510-9705-6667ff310ea9 service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:21.400065 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1419/2816] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:04:22.529018 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d669cef-abe6-47df-bb96-3f660ee58a93 None None] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:22.529620 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d669cef-abe6-47df-bb96-3f660ee58a93 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:22.529620 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d669cef-abe6-47df-bb96-3f660ee58a93 None None] PATH_INFO: `/` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:22.531082 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1398/2817] 10.222.0.69 () {54 vars in 921 bytes} [Thu Sep 8 14:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 08 14:04:22.539607 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98255d2f-d612-4848-b1fc-ad1bde34c31b None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:22.540225 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98255d2f-d612-4848-b1fc-ad1bde34c31b None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:22.540225 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98255d2f-d612-4848-b1fc-ad1bde34c31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:22.604066 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-98255d2f-d612-4848-b1fc-ad1bde34c31b None None] MFA Rules not processed for user `c95448c1b8b1466cae37fda5c713d53f`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:22.605951 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-98255d2f-d612-4848-b1fc-ad1bde34c31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:22.620292 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1420/2818] 10.222.0.69 () {58 vars in 1018 bytes} [Thu Sep 8 14:04:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:04:22.636570 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d669cef-abe6-47df-bb96-3f660ee58a93 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:22.665748 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d669cef-abe6-47df-bb96-3f660ee58a93 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:22.672398 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c7041-3785-4a98-8194-38895c06cadd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:22.673623 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c7041-3785-4a98-8194-38895c06cadd service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:22.674139 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c7041-3785-4a98-8194-38895c06cadd service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:22.674882 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c7041-3785-4a98-8194-38895c06cadd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:22.691401 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13c7041-3785-4a98-8194-38895c06cadd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:22.693521 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13c7041-3785-4a98-8194-38895c06cadd service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:22.707184 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1399/2819] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:04:22.826272 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98255d2f-d612-4848-b1fc-ad1bde34c31b None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:22.827819 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-98255d2f-d612-4848-b1fc-ad1bde34c31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:22.908110 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c7041-3785-4a98-8194-38895c06cadd service neutron] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:22.935531 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c7041-3785-4a98-8194-38895c06cadd service neutron] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:22.947124 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75866ada-32d3-49af-a641-df737f6a0d5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:22.948818 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75866ada-32d3-49af-a641-df737f6a0d5f service nova] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:22.949817 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75866ada-32d3-49af-a641-df737f6a0d5f service nova] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:22.950601 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75866ada-32d3-49af-a641-df737f6a0d5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:22.954038 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-75866ada-32d3-49af-a641-df737f6a0d5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:22.959962 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98255d2f-d612-4848-b1fc-ad1bde34c31b None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:22.969840 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadcaa7-2feb-4f79-ade8-a7d39b34fcf8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733797f12a1741e1a55332991e867aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:22.970553 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadcaa7-2feb-4f79-ade8-a7d39b34fcf8 service placement] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:22.970884 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadcaa7-2feb-4f79-ade8-a7d39b34fcf8 service placement] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:22.972131 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fadcaa7-2feb-4f79-ade8-a7d39b34fcf8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:22.974015 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-8fadcaa7-2feb-4f79-ade8-a7d39b34fcf8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:22.988077 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75866ada-32d3-49af-a641-df737f6a0d5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:22.993649 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75866ada-32d3-49af-a641-df737f6a0d5f service nova] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:22.994156 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fadcaa7-2feb-4f79-ade8-a7d39b34fcf8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:22.998903 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fadcaa7-2feb-4f79-ade8-a7d39b34fcf8 service placement] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:23.023706 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1421/2820] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:04:23.026554 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1400/2821] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:04:33.014992 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=21 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:33.016760 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=47 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:33.667927 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadcaa7-2feb-4f79-ade8-a7d39b34fcf8 service placement] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:33.684555 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fadcaa7-2feb-4f79-ade8-a7d39b34fcf8 service placement] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:33.693040 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300412d-3069-466b-a863-7ea7a2c4a9cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:33.694317 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300412d-3069-466b-a863-7ea7a2c4a9cf service nova] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:33.695079 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300412d-3069-466b-a863-7ea7a2c4a9cf service nova] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:33.696103 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300412d-3069-466b-a863-7ea7a2c4a9cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:33.699584 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-d300412d-3069-466b-a863-7ea7a2c4a9cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:33.721563 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d300412d-3069-466b-a863-7ea7a2c4a9cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:33.725879 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d300412d-3069-466b-a863-7ea7a2c4a9cf service nova] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:33.760522 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1422/2822] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:04:40.832661 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d209edf-b36e-4b3b-b882-9e2ff625ae2d None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:40.833319 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d209edf-b36e-4b3b-b882-9e2ff625ae2d None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:40.833319 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d209edf-b36e-4b3b-b882-9e2ff625ae2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:40.857823 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-1d209edf-b36e-4b3b-b882-9e2ff625ae2d None None] MFA Rules not processed for user `54679e11eed24535b4f1c389dfa5f3d3`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:04:40.859222 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-1d209edf-b36e-4b3b-b882-9e2ff625ae2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:40.867246 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1401/2823] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:04:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:04:41.304301 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300412d-3069-466b-a863-7ea7a2c4a9cf service nova] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:41.315531 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300412d-3069-466b-a863-7ea7a2c4a9cf service nova] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:41.323620 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada191c-9db8-4f6a-b6f9-6624e4711517 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:41.324473 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada191c-9db8-4f6a-b6f9-6624e4711517 service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:41.324919 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada191c-9db8-4f6a-b6f9-6624e4711517 service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:41.325308 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada191c-9db8-4f6a-b6f9-6624e4711517 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:41.327350 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-8ada191c-9db8-4f6a-b6f9-6624e4711517 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:41.339841 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ada191c-9db8-4f6a-b6f9-6624e4711517 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:41.342133 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ada191c-9db8-4f6a-b6f9-6624e4711517 service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:41.362078 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1423/2824] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:04:50.850561 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=3 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:51.349024 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=12 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:54.888400 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d209edf-b36e-4b3b-b882-9e2ff625ae2d None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:04:54.914841 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d209edf-b36e-4b3b-b882-9e2ff625ae2d None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:04:54.925888 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720cac91-9e23-4265-a88f-f467177066ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c95448c1b8b1466cae37fda5c713d53f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:04:54.927361 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720cac91-9e23-4265-a88f-f467177066ce service nova] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:04:54.928066 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720cac91-9e23-4265-a88f-f467177066ce service nova] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:04:54.928842 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720cac91-9e23-4265-a88f-f467177066ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:04:54.933256 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-720cac91-9e23-4265-a88f-f467177066ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:04:54.955202 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720cac91-9e23-4265-a88f-f467177066ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:04:54.957342 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720cac91-9e23-4265-a88f-f467177066ce service nova] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:04:54.971908 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1402/2825] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:04:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:05:04.965197 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=6 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:14.403858 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada191c-9db8-4f6a-b6f9-6624e4711517 service neutron] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:14.418822 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada191c-9db8-4f6a-b6f9-6624e4711517 service neutron] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:14.424761 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61154dd7-f27c-4416-af54-e2b0549f410a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733797f12a1741e1a55332991e867aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:14.425402 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61154dd7-f27c-4416-af54-e2b0549f410a service placement] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:14.425689 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61154dd7-f27c-4416-af54-e2b0549f410a service placement] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:14.425961 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61154dd7-f27c-4416-af54-e2b0549f410a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:14.427781 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-61154dd7-f27c-4416-af54-e2b0549f410a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:14.440931 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61154dd7-f27c-4416-af54-e2b0549f410a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:14.442598 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61154dd7-f27c-4416-af54-e2b0549f410a service placement] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:14.454866 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1424/2826] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:05:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:05:24.449282 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=6 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:58.285983 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720cac91-9e23-4265-a88f-f467177066ce service nova] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:58.288215 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-720cac91-9e23-4265-a88f-f467177066ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:58.307521 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720cac91-9e23-4265-a88f-f467177066ce service nova] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:58.314141 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a358f-9a10-4ef5-b9bf-564c2223f5e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733797f12a1741e1a55332991e867aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:58.315164 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a358f-9a10-4ef5-b9bf-564c2223f5e2 service placement] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:58.315436 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a358f-9a10-4ef5-b9bf-564c2223f5e2 service placement] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:58.316061 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a358f-9a10-4ef5-b9bf-564c2223f5e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:58.318633 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-5e8a358f-9a10-4ef5-b9bf-564c2223f5e2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:58.336067 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8a358f-9a10-4ef5-b9bf-564c2223f5e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:58.338437 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8a358f-9a10-4ef5-b9bf-564c2223f5e2 service placement] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:58.356296 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61154dd7-f27c-4416-af54-e2b0549f410a service placement] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:58.377040 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61154dd7-f27c-4416-af54-e2b0549f410a service placement] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:58.377957 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1403/2827] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:05:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:05:58.383176 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ed112-3be0-4127-a901-6adb30cab6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:58.384066 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ed112-3be0-4127-a901-6adb30cab6e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:58.384402 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ed112-3be0-4127-a901-6adb30cab6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:58.384685 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ed112-3be0-4127-a901-6adb30cab6e1 admin admin] PATH_INFO: `/v3/users/54679e11eed24535b4f1c389dfa5f3d3` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:58.386054 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354ed112-3be0-4127-a901-6adb30cab6e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54679e11eed24535b4f1c389dfa5f3d3)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:58.388068 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354ed112-3be0-4127-a901-6adb30cab6e1 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:58.489062 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-354ed112-3be0-4127-a901-6adb30cab6e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54679e11eed24535b4f1c389dfa5f3d3'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:58.490242 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-354ed112-3be0-4127-a901-6adb30cab6e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54679e11eed24535b4f1c389dfa5f3d3'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:58.491447 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-354ed112-3be0-4127-a901-6adb30cab6e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54679e11eed24535b4f1c389dfa5f3d3'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:58.512561 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-354ed112-3be0-4127-a901-6adb30cab6e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54679e11eed24535b4f1c389dfa5f3d3'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:58.540130 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-354ed112-3be0-4127-a901-6adb30cab6e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54679e11eed24535b4f1c389dfa5f3d3'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:58.566347 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1425/2828] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 14:05:58 2022] DELETE /identity/v3/users/54679e11eed24535b4f1c389dfa5f3d3 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:05:58.896598 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a358f-9a10-4ef5-b9bf-564c2223f5e2 service placement] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:58.920667 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a358f-9a10-4ef5-b9bf-564c2223f5e2 service placement] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:59.043011 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a83f636-b433-4b6a-8998-9c33d004cb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:59.043770 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83f636-b433-4b6a-8998-9c33d004cb8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:59.044313 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83f636-b433-4b6a-8998-9c33d004cb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:59.044865 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a83f636-b433-4b6a-8998-9c33d004cb8b admin admin] PATH_INFO: `/v3/projects/7ecffc112daa478e9ba541f14f303456` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:59.046480 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a83f636-b433-4b6a-8998-9c33d004cb8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ecffc112daa478e9ba541f14f303456)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:59.049484 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a83f636-b433-4b6a-8998-9c33d004cb8b admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:59.150246 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-6a83f636-b433-4b6a-8998-9c33d004cb8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ecffc112daa478e9ba541f14f303456', 'request_id': 'req-6a83f636-b433-4b6a-8998-9c33d004cb8b'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:59.163926 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-6a83f636-b433-4b6a-8998-9c33d004cb8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ecffc112daa478e9ba541f14f303456', 'request_id': 'req-6a83f636-b433-4b6a-8998-9c33d004cb8b'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:59.174529 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-6a83f636-b433-4b6a-8998-9c33d004cb8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ecffc112daa478e9ba541f14f303456', 'request_id': 'req-6a83f636-b433-4b6a-8998-9c33d004cb8b'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:59.196445 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-6a83f636-b433-4b6a-8998-9c33d004cb8b admin admin] The token cache is being invalidate because project 7ecffc112daa478e9ba541f14f303456 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:05:59.197094 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-6a83f636-b433-4b6a-8998-9c33d004cb8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:59.197909 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-6a83f636-b433-4b6a-8998-9c33d004cb8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:05:59.200269 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1404/2829] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 14:05:58 2022] DELETE /identity/v3/projects/7ecffc112daa478e9ba541f14f303456 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:05:59.209305 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcaf8bf-0421-42b4-ae93-50c6d8efd138 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:59.209975 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcaf8bf-0421-42b4-ae93-50c6d8efd138 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:59.210382 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcaf8bf-0421-42b4-ae93-50c6d8efd138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:59.242376 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-fbcaf8bf-0421-42b4-ae93-50c6d8efd138 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:59.244017 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-fbcaf8bf-0421-42b4-ae93-50c6d8efd138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:59.345971 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1426/2830] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:05:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:05:59.354821 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315265b4-98df-4d86-a3d6-21fbea135cb6 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:59.355845 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315265b4-98df-4d86-a3d6-21fbea135cb6 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:59.356126 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315265b4-98df-4d86-a3d6-21fbea135cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:59.380894 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-315265b4-98df-4d86-a3d6-21fbea135cb6 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:59.382206 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-315265b4-98df-4d86-a3d6-21fbea135cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:05:59.391150 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1405/2831] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:05:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:05:59.397477 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcaf8bf-0421-42b4-ae93-50c6d8efd138 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:59.410782 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcaf8bf-0421-42b4-ae93-50c6d8efd138 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:59.416514 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce50f15-b5c1-4618-b1a2-87de6012c12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:59.417489 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce50f15-b5c1-4618-b1a2-87de6012c12a admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:59.417932 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce50f15-b5c1-4618-b1a2-87de6012c12a admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:59.418342 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce50f15-b5c1-4618-b1a2-87de6012c12a admin admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:59.419302 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce50f15-b5c1-4618-b1a2-87de6012c12a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:05:59.419448 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce50f15-b5c1-4618-b1a2-87de6012c12a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:59.422337 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce50f15-b5c1-4618-b1a2-87de6012c12a admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:59.437226 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1427/2832] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 14:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:05:59.442320 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315265b4-98df-4d86-a3d6-21fbea135cb6 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:59.453208 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315265b4-98df-4d86-a3d6-21fbea135cb6 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:59.459602 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5922873-32c8-49d9-a790-0e84d83f9161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:59.459931 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5922873-32c8-49d9-a790-0e84d83f9161 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:59.459931 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5922873-32c8-49d9-a790-0e84d83f9161 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:59.460212 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5922873-32c8-49d9-a790-0e84d83f9161 admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:59.461073 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5922873-32c8-49d9-a790-0e84d83f9161 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:59.463485 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5922873-32c8-49d9-a790-0e84d83f9161 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:59.509450 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1406/2833] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 14:05:59 2022] POST /identity/v3/projects => generated 367 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:05:59.511285 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce50f15-b5c1-4618-b1a2-87de6012c12a admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:59.530310 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce50f15-b5c1-4618-b1a2-87de6012c12a admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:59.634258 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2a2f4-6454-424c-8bb0-4fe02bdeef56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:59.635331 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2a2f4-6454-424c-8bb0-4fe02bdeef56 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:59.635814 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2a2f4-6454-424c-8bb0-4fe02bdeef56 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:59.636292 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2a2f4-6454-424c-8bb0-4fe02bdeef56 admin admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:59.637187 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c2a2f4-6454-424c-8bb0-4fe02bdeef56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:59.639500 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c2a2f4-6454-424c-8bb0-4fe02bdeef56 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:59.652437 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:59.679854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1428/2834] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 14:05:59 2022] POST /identity/v3/users => generated 284 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:05:59.685582 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5922873-32c8-49d9-a790-0e84d83f9161 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:59.701469 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5922873-32c8-49d9-a790-0e84d83f9161 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:59.709121 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aea8bdb-de36-4473-a886-b4a1b43ca312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:59.710014 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea8bdb-de36-4473-a886-b4a1b43ca312 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:59.710461 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea8bdb-de36-4473-a886-b4a1b43ca312 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:59.710926 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea8bdb-de36-4473-a886-b4a1b43ca312 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:59.711950 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aea8bdb-de36-4473-a886-b4a1b43ca312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:59.714920 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aea8bdb-de36-4473-a886-b4a1b43ca312 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:59.730112 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1407/2835] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 14:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:05:59.736799 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2a2f4-6454-424c-8bb0-4fe02bdeef56 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:59.748859 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2a2f4-6454-424c-8bb0-4fe02bdeef56 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:59.755541 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c00a47-6cf7-46fd-807a-77a64f5f5442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:59.756169 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c00a47-6cf7-46fd-807a-77a64f5f5442 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:59.756453 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c00a47-6cf7-46fd-807a-77a64f5f5442 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:59.756725 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c00a47-6cf7-46fd-807a-77a64f5f5442 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:59.757721 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c00a47-6cf7-46fd-807a-77a64f5f5442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:59.759903 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c00a47-6cf7-46fd-807a-77a64f5f5442 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:59.773625 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1429/2836] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 14:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:05:59.778621 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aea8bdb-de36-4473-a886-b4a1b43ca312 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:05:59.793434 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aea8bdb-de36-4473-a886-b4a1b43ca312 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:05:59.801047 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef0b79-4732-454a-bfb7-c8138f1a9549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:05:59.802098 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef0b79-4732-454a-bfb7-c8138f1a9549 admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:59.802549 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef0b79-4732-454a-bfb7-c8138f1a9549 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:59.803071 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef0b79-4732-454a-bfb7-c8138f1a9549 admin admin] PATH_INFO: `/v3/projects/dd5148cfeb9f49fead4536d48d846873/users/e9f555f5de1946bd8b46007c4e378ae2/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:59.824846 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef0b79-4732-454a-bfb7-c8138f1a9549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd5148cfeb9f49fead4536d48d846873, user_id=e9f555f5de1946bd8b46007c4e378ae2, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:05:59.829257 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef0b79-4732-454a-bfb7-c8138f1a9549 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:05:59.850446 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1408/2837] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 14:05:59 2022] PUT /identity/v3/projects/dd5148cfeb9f49fead4536d48d846873/users/e9f555f5de1946bd8b46007c4e378ae2/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:05:59.863110 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ace7fe-85a2-4abb-8613-b45992886b1d None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:05:59.863403 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ace7fe-85a2-4abb-8613-b45992886b1d None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:05:59.863645 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ace7fe-85a2-4abb-8613-b45992886b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:05:59.916705 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-09ace7fe-85a2-4abb-8613-b45992886b1d None None] MFA Rules not processed for user `e9f555f5de1946bd8b46007c4e378ae2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:05:59.918814 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-09ace7fe-85a2-4abb-8613-b45992886b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:00.059763 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1430/2838] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:05:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:06:00.074860 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef0b79-4732-454a-bfb7-c8138f1a9549 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:00.078496 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-78ef0b79-4732-454a-bfb7-c8138f1a9549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:00.116259 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:00.210639 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef0b79-4732-454a-bfb7-c8138f1a9549 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:00.217353 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d227a229-9ce1-41e8-b0c6-4f099f3f7242 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:00.218583 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227a229-9ce1-41e8-b0c6-4f099f3f7242 service cinder] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:00.219369 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227a229-9ce1-41e8-b0c6-4f099f3f7242 service cinder] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:00.220059 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227a229-9ce1-41e8-b0c6-4f099f3f7242 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:00.238984 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d227a229-9ce1-41e8-b0c6-4f099f3f7242 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:00.242233 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d227a229-9ce1-41e8-b0c6-4f099f3f7242 service cinder] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:00.265151 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1409/2839] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:06:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:06:06.336875 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ace7fe-85a2-4abb-8613-b45992886b1d None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:06.339053 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-09ace7fe-85a2-4abb-8613-b45992886b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:06.486436 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d227a229-9ce1-41e8-b0c6-4f099f3f7242 service cinder] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:06.488832 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-d227a229-9ce1-41e8-b0c6-4f099f3f7242 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:06.516948 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ace7fe-85a2-4abb-8613-b45992886b1d None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:06.528649 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f10eaef-9c6c-4f77-9378-1b1e81efeeea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733797f12a1741e1a55332991e867aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:06.529868 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10eaef-9c6c-4f77-9378-1b1e81efeeea service placement] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:06.531004 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10eaef-9c6c-4f77-9378-1b1e81efeeea service placement] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:06.531579 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10eaef-9c6c-4f77-9378-1b1e81efeeea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:06.534864 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-4f10eaef-9c6c-4f77-9378-1b1e81efeeea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:06.558511 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f10eaef-9c6c-4f77-9378-1b1e81efeeea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:06.562645 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f10eaef-9c6c-4f77-9378-1b1e81efeeea service placement] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:06.584752 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1431/2840] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:06:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:06:06.629643 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d227a229-9ce1-41e8-b0c6-4f099f3f7242 service cinder] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:06.644392 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be645ee1-f067-4770-b691-5d8b0258582d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:06.645199 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be645ee1-f067-4770-b691-5d8b0258582d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:06.645630 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be645ee1-f067-4770-b691-5d8b0258582d admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:06.646006 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be645ee1-f067-4770-b691-5d8b0258582d admin admin] PATH_INFO: `/v3/users/b0182f6c243e435d8bb81f33995f9a2a` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:06.647348 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be645ee1-f067-4770-b691-5d8b0258582d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0182f6c243e435d8bb81f33995f9a2a)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:06.649803 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be645ee1-f067-4770-b691-5d8b0258582d admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:06.730733 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-be645ee1-f067-4770-b691-5d8b0258582d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0182f6c243e435d8bb81f33995f9a2a'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:06.731835 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-be645ee1-f067-4770-b691-5d8b0258582d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0182f6c243e435d8bb81f33995f9a2a'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:06.748284 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-be645ee1-f067-4770-b691-5d8b0258582d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0182f6c243e435d8bb81f33995f9a2a'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:06.775344 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-be645ee1-f067-4770-b691-5d8b0258582d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0182f6c243e435d8bb81f33995f9a2a'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:06.776393 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-be645ee1-f067-4770-b691-5d8b0258582d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0182f6c243e435d8bb81f33995f9a2a'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:06.805154 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1410/2841] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 14:06:06 2022] DELETE /identity/v3/users/b0182f6c243e435d8bb81f33995f9a2a => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:06:07.064314 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f10eaef-9c6c-4f77-9378-1b1e81efeeea service placement] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:07.083367 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f10eaef-9c6c-4f77-9378-1b1e81efeeea service placement] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:07.169332 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:07.181130 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fdd61a-98cc-4ee0-9240-0ea5933ce00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:07.182256 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fdd61a-98cc-4ee0-9240-0ea5933ce00d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:07.182710 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fdd61a-98cc-4ee0-9240-0ea5933ce00d admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:07.183175 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fdd61a-98cc-4ee0-9240-0ea5933ce00d admin admin] PATH_INFO: `/v3/projects/c31367f8a7d142efb35e93601ba0be2a` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:07.185188 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fdd61a-98cc-4ee0-9240-0ea5933ce00d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c31367f8a7d142efb35e93601ba0be2a)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:07.189020 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fdd61a-98cc-4ee0-9240-0ea5933ce00d admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:07.270551 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-b5fdd61a-98cc-4ee0-9240-0ea5933ce00d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c31367f8a7d142efb35e93601ba0be2a', 'request_id': 'req-b5fdd61a-98cc-4ee0-9240-0ea5933ce00d'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:07.278467 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-b5fdd61a-98cc-4ee0-9240-0ea5933ce00d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c31367f8a7d142efb35e93601ba0be2a', 'request_id': 'req-b5fdd61a-98cc-4ee0-9240-0ea5933ce00d'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:07.286977 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-b5fdd61a-98cc-4ee0-9240-0ea5933ce00d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c31367f8a7d142efb35e93601ba0be2a', 'request_id': 'req-b5fdd61a-98cc-4ee0-9240-0ea5933ce00d'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:07.304659 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-b5fdd61a-98cc-4ee0-9240-0ea5933ce00d admin admin] The token cache is being invalidate because project c31367f8a7d142efb35e93601ba0be2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:06:07.305012 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-b5fdd61a-98cc-4ee0-9240-0ea5933ce00d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:07.305771 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-b5fdd61a-98cc-4ee0-9240-0ea5933ce00d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:07.307491 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1432/2842] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 14:06:07 2022] DELETE /identity/v3/projects/c31367f8a7d142efb35e93601ba0be2a => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:06:07.312142 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be645ee1-f067-4770-b691-5d8b0258582d admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:07.314075 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-be645ee1-f067-4770-b691-5d8b0258582d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:07.330585 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be645ee1-f067-4770-b691-5d8b0258582d admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:07.378949 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:07.412228 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9023c8e-70f6-4de5-811a-1a80d9a0cead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:07.412783 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9023c8e-70f6-4de5-811a-1a80d9a0cead admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:07.413071 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9023c8e-70f6-4de5-811a-1a80d9a0cead admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:07.413424 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9023c8e-70f6-4de5-811a-1a80d9a0cead admin admin] PATH_INFO: `/v3/users/c9825c72ba684b5791eddb31ff894dad` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:07.414741 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9023c8e-70f6-4de5-811a-1a80d9a0cead admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9825c72ba684b5791eddb31ff894dad)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:07.416698 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9023c8e-70f6-4de5-811a-1a80d9a0cead admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:07.476470 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-d9023c8e-70f6-4de5-811a-1a80d9a0cead admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9825c72ba684b5791eddb31ff894dad'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:07.477399 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-d9023c8e-70f6-4de5-811a-1a80d9a0cead admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9825c72ba684b5791eddb31ff894dad'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:07.487270 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-d9023c8e-70f6-4de5-811a-1a80d9a0cead admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9825c72ba684b5791eddb31ff894dad'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:07.501790 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-d9023c8e-70f6-4de5-811a-1a80d9a0cead admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9825c72ba684b5791eddb31ff894dad'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:07.502579 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-d9023c8e-70f6-4de5-811a-1a80d9a0cead admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9825c72ba684b5791eddb31ff894dad'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:07.518661 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1411/2843] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 14:06:07 2022] DELETE /identity/v3/users/c9825c72ba684b5791eddb31ff894dad => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:06:07.729050 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fdd61a-98cc-4ee0-9240-0ea5933ce00d admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:07.731682 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-b5fdd61a-98cc-4ee0-9240-0ea5933ce00d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:07.748258 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fdd61a-98cc-4ee0-9240-0ea5933ce00d admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:07.829955 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b4762-5a12-4719-92d5-8219a39a7ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:07.830631 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b4762-5a12-4719-92d5-8219a39a7ec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:07.831013 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b4762-5a12-4719-92d5-8219a39a7ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:07.831558 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b4762-5a12-4719-92d5-8219a39a7ec6 admin admin] PATH_INFO: `/v3/projects/04e8c22d1c7f46a18922cf91dca057b3` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:07.833730 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9b4762-5a12-4719-92d5-8219a39a7ec6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04e8c22d1c7f46a18922cf91dca057b3)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:07.836996 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9b4762-5a12-4719-92d5-8219a39a7ec6 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:07.918686 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-3c9b4762-5a12-4719-92d5-8219a39a7ec6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04e8c22d1c7f46a18922cf91dca057b3', 'request_id': 'req-3c9b4762-5a12-4719-92d5-8219a39a7ec6'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:07.930765 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-3c9b4762-5a12-4719-92d5-8219a39a7ec6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04e8c22d1c7f46a18922cf91dca057b3', 'request_id': 'req-3c9b4762-5a12-4719-92d5-8219a39a7ec6'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:07.943510 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-3c9b4762-5a12-4719-92d5-8219a39a7ec6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04e8c22d1c7f46a18922cf91dca057b3', 'request_id': 'req-3c9b4762-5a12-4719-92d5-8219a39a7ec6'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:07.962435 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-3c9b4762-5a12-4719-92d5-8219a39a7ec6 admin admin] The token cache is being invalidate because project 04e8c22d1c7f46a18922cf91dca057b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:06:07.962800 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-3c9b4762-5a12-4719-92d5-8219a39a7ec6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:07.963472 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-3c9b4762-5a12-4719-92d5-8219a39a7ec6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:07.965034 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1433/2844] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 14:06:07 2022] DELETE /identity/v3/projects/04e8c22d1c7f46a18922cf91dca057b3 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:06:10.257815 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9023c8e-70f6-4de5-811a-1a80d9a0cead admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:10.259625 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-d9023c8e-70f6-4de5-811a-1a80d9a0cead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:10.275382 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9023c8e-70f6-4de5-811a-1a80d9a0cead admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:10.355532 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af65869-d19a-4453-a099-775586018b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:10.356164 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af65869-d19a-4453-a099-775586018b5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:10.356451 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af65869-d19a-4453-a099-775586018b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:10.356725 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af65869-d19a-4453-a099-775586018b5a admin admin] PATH_INFO: `/v3/users/e9f555f5de1946bd8b46007c4e378ae2` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:10.358023 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af65869-d19a-4453-a099-775586018b5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9f555f5de1946bd8b46007c4e378ae2)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:10.360124 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af65869-d19a-4453-a099-775586018b5a admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:10.431801 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-7af65869-d19a-4453-a099-775586018b5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9f555f5de1946bd8b46007c4e378ae2'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:10.431801 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-7af65869-d19a-4453-a099-775586018b5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9f555f5de1946bd8b46007c4e378ae2'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:10.445575 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-7af65869-d19a-4453-a099-775586018b5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9f555f5de1946bd8b46007c4e378ae2'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:10.447839 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:10.469021 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-7af65869-d19a-4453-a099-775586018b5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9f555f5de1946bd8b46007c4e378ae2'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:10.470012 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-7af65869-d19a-4453-a099-775586018b5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9f555f5de1946bd8b46007c4e378ae2'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:10.488855 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1412/2845] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 14:06:10 2022] DELETE /identity/v3/users/e9f555f5de1946bd8b46007c4e378ae2 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:06:10.493736 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89833678-c8b4-4fb1-8dba-93490304bbb9 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:10.494332 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89833678-c8b4-4fb1-8dba-93490304bbb9 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:10.494332 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89833678-c8b4-4fb1-8dba-93490304bbb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:10.516313 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-89833678-c8b4-4fb1-8dba-93490304bbb9 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:06:10.517713 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-89833678-c8b4-4fb1-8dba-93490304bbb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:10.534893 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:10.608917 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1434/2846] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:06:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:06:10.620263 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af65869-d19a-4453-a099-775586018b5a admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:10.621905 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-7af65869-d19a-4453-a099-775586018b5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:10.697770 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af65869-d19a-4453-a099-775586018b5a admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:10.701682 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204bc48-6f3b-4dad-941f-7de950afdc8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:10.702847 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204bc48-6f3b-4dad-941f-7de950afdc8f service neutron] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:10.703122 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204bc48-6f3b-4dad-941f-7de950afdc8f service neutron] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:10.703388 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204bc48-6f3b-4dad-941f-7de950afdc8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:10.714658 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a204bc48-6f3b-4dad-941f-7de950afdc8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:10.716110 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a204bc48-6f3b-4dad-941f-7de950afdc8f service neutron] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:10.730572 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1413/2847] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:06:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:06:11.140953 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89833678-c8b4-4fb1-8dba-93490304bbb9 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:11.143550 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-89833678-c8b4-4fb1-8dba-93490304bbb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:11.167868 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89833678-c8b4-4fb1-8dba-93490304bbb9 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:11.176746 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d5941-9413-457e-9e5b-62d8fc680e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:11.178209 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d5941-9413-457e-9e5b-62d8fc680e3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:11.178744 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d5941-9413-457e-9e5b-62d8fc680e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:11.179235 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d5941-9413-457e-9e5b-62d8fc680e3e admin admin] PATH_INFO: `/v3/projects/dd5148cfeb9f49fead4536d48d846873` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:11.181262 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d5941-9413-457e-9e5b-62d8fc680e3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd5148cfeb9f49fead4536d48d846873)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:11.184939 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d5941-9413-457e-9e5b-62d8fc680e3e admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:11.269261 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-288d5941-9413-457e-9e5b-62d8fc680e3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd5148cfeb9f49fead4536d48d846873', 'request_id': 'req-288d5941-9413-457e-9e5b-62d8fc680e3e'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:11.278308 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-288d5941-9413-457e-9e5b-62d8fc680e3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd5148cfeb9f49fead4536d48d846873', 'request_id': 'req-288d5941-9413-457e-9e5b-62d8fc680e3e'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:11.288525 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-288d5941-9413-457e-9e5b-62d8fc680e3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd5148cfeb9f49fead4536d48d846873', 'request_id': 'req-288d5941-9413-457e-9e5b-62d8fc680e3e'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:11.307011 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-288d5941-9413-457e-9e5b-62d8fc680e3e admin admin] The token cache is being invalidate because project dd5148cfeb9f49fead4536d48d846873 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88207) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:06:11.307481 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-288d5941-9413-457e-9e5b-62d8fc680e3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:11.308225 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-288d5941-9413-457e-9e5b-62d8fc680e3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:11.310013 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1435/2848] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 14:06:11 2022] DELETE /identity/v3/projects/dd5148cfeb9f49fead4536d48d846873 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:06:11.316248 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5145e9a-a4cc-4c87-ba0c-13f3405da330 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:11.316969 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5145e9a-a4cc-4c87-ba0c-13f3405da330 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:11.316969 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5145e9a-a4cc-4c87-ba0c-13f3405da330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:11.349677 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-d5145e9a-a4cc-4c87-ba0c-13f3405da330 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:06:11.351756 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-d5145e9a-a4cc-4c87-ba0c-13f3405da330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:11.477072 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1414/2849] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:06:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:06:11.486668 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3b9b1-3534-43ed-b906-ed334be675c2 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:11.486951 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3b9b1-3534-43ed-b906-ed334be675c2 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:11.487215 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3b9b1-3534-43ed-b906-ed334be675c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:11.523176 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-27e3b9b1-3534-43ed-b906-ed334be675c2 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:06:11.525285 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-27e3b9b1-3534-43ed-b906-ed334be675c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:11.539593 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1436/2850] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:06:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:06:11.545356 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5145e9a-a4cc-4c87-ba0c-13f3405da330 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:11.559571 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5145e9a-a4cc-4c87-ba0c-13f3405da330 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:11.567413 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0401295-89a5-4e79-a971-4d8e541da4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:11.568429 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0401295-89a5-4e79-a971-4d8e541da4ca admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:11.568895 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0401295-89a5-4e79-a971-4d8e541da4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:11.569397 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0401295-89a5-4e79-a971-4d8e541da4ca admin admin] PATH_INFO: `/v3/domains` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:11.570836 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0401295-89a5-4e79-a971-4d8e541da4ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88208) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:06:11.571389 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0401295-89a5-4e79-a971-4d8e541da4ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:11.574352 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0401295-89a5-4e79-a971-4d8e541da4ca admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:11.596923 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1415/2851] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 14:06:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:06:11.603877 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3b9b1-3534-43ed-b906-ed334be675c2 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:11.615040 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3b9b1-3534-43ed-b906-ed334be675c2 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:11.621423 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf2cc1-51f1-4c2d-93d8-beeabc27628c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:11.622076 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf2cc1-51f1-4c2d-93d8-beeabc27628c admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:11.622379 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf2cc1-51f1-4c2d-93d8-beeabc27628c admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:11.622658 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cf2cc1-51f1-4c2d-93d8-beeabc27628c admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:11.623593 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf2cc1-51f1-4c2d-93d8-beeabc27628c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:11.626333 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cf2cc1-51f1-4c2d-93d8-beeabc27628c admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:11.664843 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1437/2852] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 14:06:11 2022] POST /identity/v3/projects => generated 387 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:06:11.669759 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0401295-89a5-4e79-a971-4d8e541da4ca admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:11.683569 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0401295-89a5-4e79-a971-4d8e541da4ca admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:11.778377 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa9cca-7918-4e26-b3d1-a718eea17ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:11.778990 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa9cca-7918-4e26-b3d1-a718eea17ae1 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:11.779268 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa9cca-7918-4e26-b3d1-a718eea17ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:11.779543 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa9cca-7918-4e26-b3d1-a718eea17ae1 admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:11.780252 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa9cca-7918-4e26-b3d1-a718eea17ae1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:11.782926 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa9cca-7918-4e26-b3d1-a718eea17ae1 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:11.796913 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:11.815296 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1416/2853] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 14:06:11 2022] POST /identity/v3/users => generated 294 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:06:11.819455 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf2cc1-51f1-4c2d-93d8-beeabc27628c admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:11.832095 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cf2cc1-51f1-4c2d-93d8-beeabc27628c admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:11.837773 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc1ab05-b936-4024-858f-b7c3c01ad4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:11.838388 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1ab05-b936-4024-858f-b7c3c01ad4b4 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:11.838667 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1ab05-b936-4024-858f-b7c3c01ad4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:11.838940 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc1ab05-b936-4024-858f-b7c3c01ad4b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:11.839831 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc1ab05-b936-4024-858f-b7c3c01ad4b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:11.841230 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc1ab05-b936-4024-858f-b7c3c01ad4b4 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:11.864078 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1438/2854] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 14:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:06:11.868656 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa9cca-7918-4e26-b3d1-a718eea17ae1 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:11.880353 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa9cca-7918-4e26-b3d1-a718eea17ae1 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:11.885638 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00b22f-c294-48b8-8847-f1bcbea771b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:11.886277 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00b22f-c294-48b8-8847-f1bcbea771b7 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:11.886552 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00b22f-c294-48b8-8847-f1bcbea771b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:11.886824 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00b22f-c294-48b8-8847-f1bcbea771b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:11.887511 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e00b22f-c294-48b8-8847-f1bcbea771b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:11.889141 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e00b22f-c294-48b8-8847-f1bcbea771b7 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:11.902703 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1417/2855] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 14:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:06:11.908373 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc1ab05-b936-4024-858f-b7c3c01ad4b4 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:11.920007 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc1ab05-b936-4024-858f-b7c3c01ad4b4 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:11.926273 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c433d73-d941-413d-9160-7a70c57a1dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:11.927078 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c433d73-d941-413d-9160-7a70c57a1dea admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:11.927521 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c433d73-d941-413d-9160-7a70c57a1dea admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:11.927865 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c433d73-d941-413d-9160-7a70c57a1dea admin admin] PATH_INFO: `/v3/projects/914b2a13ce6048a789d3c93146e4c85c/users/0f3ddcff019541fc9b82b2a5dd7e0fde/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:11.948548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c433d73-d941-413d-9160-7a70c57a1dea admin admin] RBAC: Authorizing `identity:create_grant(project_id=914b2a13ce6048a789d3c93146e4c85c, user_id=0f3ddcff019541fc9b82b2a5dd7e0fde, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:11.951415 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c433d73-d941-413d-9160-7a70c57a1dea admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:11.967438 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1439/2856] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 14:06:11 2022] PUT /identity/v3/projects/914b2a13ce6048a789d3c93146e4c85c/users/0f3ddcff019541fc9b82b2a5dd7e0fde/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:06:11.981779 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87baeb8c-a0f5-4a08-ace1-78848a91df70 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:11.982148 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87baeb8c-a0f5-4a08-ace1-78848a91df70 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:11.982463 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87baeb8c-a0f5-4a08-ace1-78848a91df70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:12.016780 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-87baeb8c-a0f5-4a08-ace1-78848a91df70 None None] MFA Rules not processed for user `0f3ddcff019541fc9b82b2a5dd7e0fde`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:06:12.018184 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-87baeb8c-a0f5-4a08-ace1-78848a91df70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:12.096739 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1418/2857] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:06:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:06:12.102031 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c433d73-d941-413d-9160-7a70c57a1dea admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:12.153028 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:12.179301 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c433d73-d941-413d-9160-7a70c57a1dea admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:12.184294 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae30d08-61c0-448c-9392-97434c69ff59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:12.184917 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae30d08-61c0-448c-9392-97434c69ff59 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:12.185195 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae30d08-61c0-448c-9392-97434c69ff59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:12.185507 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae30d08-61c0-448c-9392-97434c69ff59 admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:12.186399 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae30d08-61c0-448c-9392-97434c69ff59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:12.189347 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae30d08-61c0-448c-9392-97434c69ff59 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:12.224286 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1440/2858] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 14:06:12 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:06:12.230741 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87baeb8c-a0f5-4a08-ace1-78848a91df70 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:12.244510 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87baeb8c-a0f5-4a08-ace1-78848a91df70 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:12.317253 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e862a5-6828-4d57-aa58-2f266a31492c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:12.318238 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e862a5-6828-4d57-aa58-2f266a31492c admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:12.318238 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e862a5-6828-4d57-aa58-2f266a31492c admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:12.318524 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e862a5-6828-4d57-aa58-2f266a31492c admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:12.319305 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e862a5-6828-4d57-aa58-2f266a31492c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:12.321632 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e862a5-6828-4d57-aa58-2f266a31492c admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:12.347954 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1419/2859] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 14:06:12 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:06:12.353164 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae30d08-61c0-448c-9392-97434c69ff59 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:12.365750 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae30d08-61c0-448c-9392-97434c69ff59 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:12.371049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb205b-1642-4165-986b-ca6464b6c982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:12.371772 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb205b-1642-4165-986b-ca6464b6c982 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:12.372260 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb205b-1642-4165-986b-ca6464b6c982 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:12.372737 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb205b-1642-4165-986b-ca6464b6c982 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:12.373686 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb205b-1642-4165-986b-ca6464b6c982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:12.376410 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb205b-1642-4165-986b-ca6464b6c982 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:12.390075 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1441/2860] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 14:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:06:12.394715 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e862a5-6828-4d57-aa58-2f266a31492c admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:12.407733 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e862a5-6828-4d57-aa58-2f266a31492c admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:12.413471 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a2b3c-d248-4455-a4de-74598cf57423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:12.414128 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a2b3c-d248-4455-a4de-74598cf57423 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:12.414407 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a2b3c-d248-4455-a4de-74598cf57423 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:12.414683 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a2b3c-d248-4455-a4de-74598cf57423 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:12.415361 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2a2b3c-d248-4455-a4de-74598cf57423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:12.417062 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2a2b3c-d248-4455-a4de-74598cf57423 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:12.429298 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1420/2861] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 14:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:06:12.434672 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb205b-1642-4165-986b-ca6464b6c982 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:12.447203 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb205b-1642-4165-986b-ca6464b6c982 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:12.453703 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea753e-cf9a-4b03-9e24-7fd49ec2b75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:12.454396 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea753e-cf9a-4b03-9e24-7fd49ec2b75c admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:12.454676 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea753e-cf9a-4b03-9e24-7fd49ec2b75c admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:12.454951 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea753e-cf9a-4b03-9e24-7fd49ec2b75c admin admin] PATH_INFO: `/v3/projects/b0839c9e6f5a4f738caeb653e9d4f199/users/b13a4c4f44984bb38dfe54d82692f085/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:12.473210 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea753e-cf9a-4b03-9e24-7fd49ec2b75c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0839c9e6f5a4f738caeb653e9d4f199, user_id=b13a4c4f44984bb38dfe54d82692f085, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:12.476365 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea753e-cf9a-4b03-9e24-7fd49ec2b75c admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:12.493662 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1442/2862] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 14:06:12 2022] PUT /identity/v3/projects/b0839c9e6f5a4f738caeb653e9d4f199/users/b13a4c4f44984bb38dfe54d82692f085/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:06:12.505676 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27594f-742c-4f5d-aad3-a31ce93a1a21 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:12.505962 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27594f-742c-4f5d-aad3-a31ce93a1a21 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:12.506149 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27594f-742c-4f5d-aad3-a31ce93a1a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:12.542674 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-5b27594f-742c-4f5d-aad3-a31ce93a1a21 None None] MFA Rules not processed for user `b13a4c4f44984bb38dfe54d82692f085`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:06:12.543971 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-5b27594f-742c-4f5d-aad3-a31ce93a1a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:12.595934 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:12.629861 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1421/2863] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:06:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:06:12.634740 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea753e-cf9a-4b03-9e24-7fd49ec2b75c admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:12.711449 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea753e-cf9a-4b03-9e24-7fd49ec2b75c admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:12.716793 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74c33a-2771-4976-b669-16413bfa8f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:12.717609 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74c33a-2771-4976-b669-16413bfa8f56 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:12.718467 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74c33a-2771-4976-b669-16413bfa8f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:12.718797 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74c33a-2771-4976-b669-16413bfa8f56 admin admin] PATH_INFO: `/v3/projects` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:12.719510 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac74c33a-2771-4976-b669-16413bfa8f56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:12.721715 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac74c33a-2771-4976-b669-16413bfa8f56 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:12.755137 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1443/2864] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 14:06:12 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:06:12.760096 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27594f-742c-4f5d-aad3-a31ce93a1a21 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:12.774757 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27594f-742c-4f5d-aad3-a31ce93a1a21 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:12.851080 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fab42-1d21-4846-986d-b5826f0db751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:12.851879 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fab42-1d21-4846-986d-b5826f0db751 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:12.852162 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fab42-1d21-4846-986d-b5826f0db751 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:12.852435 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fab42-1d21-4846-986d-b5826f0db751 admin admin] PATH_INFO: `/v3/users` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:12.853393 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2fab42-1d21-4846-986d-b5826f0db751 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:12.855386 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2fab42-1d21-4846-986d-b5826f0db751 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:12.879415 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1422/2865] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 14:06:12 2022] POST /identity/v3/users => generated 299 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:06:12.884001 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74c33a-2771-4976-b669-16413bfa8f56 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:12.896169 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74c33a-2771-4976-b669-16413bfa8f56 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:12.901477 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac162603-d3aa-4768-9503-bb53c47c7546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:12.902125 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac162603-d3aa-4768-9503-bb53c47c7546 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:12.902413 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac162603-d3aa-4768-9503-bb53c47c7546 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:12.902680 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac162603-d3aa-4768-9503-bb53c47c7546 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:12.903331 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac162603-d3aa-4768-9503-bb53c47c7546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:12.904974 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac162603-d3aa-4768-9503-bb53c47c7546 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:12.917950 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1444/2866] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 14:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:06:12.923728 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fab42-1d21-4846-986d-b5826f0db751 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:12.937970 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fab42-1d21-4846-986d-b5826f0db751 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:12.947557 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a8ec0-79f1-45cd-bfa7-eb4b999f83da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:12.948718 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a8ec0-79f1-45cd-bfa7-eb4b999f83da admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:12.949223 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a8ec0-79f1-45cd-bfa7-eb4b999f83da admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:12.949874 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a8ec0-79f1-45cd-bfa7-eb4b999f83da admin admin] PATH_INFO: `/v3/projects/ace2da9b05c44985be07883609d01e06/users/2467cf172954487abeafc85d741c4510/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:12.975983 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a8ec0-79f1-45cd-bfa7-eb4b999f83da admin admin] RBAC: Authorizing `identity:create_grant(project_id=ace2da9b05c44985be07883609d01e06, user_id=2467cf172954487abeafc85d741c4510, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:12.979660 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a8ec0-79f1-45cd-bfa7-eb4b999f83da admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:12.998577 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1423/2867] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 14:06:12 2022] PUT /identity/v3/projects/ace2da9b05c44985be07883609d01e06/users/2467cf172954487abeafc85d741c4510/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:06:13.006358 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac162603-d3aa-4768-9503-bb53c47c7546 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:13.018986 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac162603-d3aa-4768-9503-bb53c47c7546 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:13.106575 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96912c15-3f8e-436b-b954-5b6c9bab8ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:13.107275 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96912c15-3f8e-436b-b954-5b6c9bab8ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:13.107595 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96912c15-3f8e-436b-b954-5b6c9bab8ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:13.107907 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96912c15-3f8e-436b-b954-5b6c9bab8ef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:13.108745 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96912c15-3f8e-436b-b954-5b6c9bab8ef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:13.110598 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96912c15-3f8e-436b-b954-5b6c9bab8ef6 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:13.113358 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:13.126052 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1445/2868] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 14:06:13 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:06:13.130581 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a8ec0-79f1-45cd-bfa7-eb4b999f83da admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:13.142826 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a8ec0-79f1-45cd-bfa7-eb4b999f83da admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:13.148007 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2970684-fe2d-4391-b863-114775b58d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:13.148685 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2970684-fe2d-4391-b863-114775b58d20 admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:13.148934 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2970684-fe2d-4391-b863-114775b58d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:13.149218 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2970684-fe2d-4391-b863-114775b58d20 admin admin] PATH_INFO: `/v3/projects/ace2da9b05c44985be07883609d01e06/users/2467cf172954487abeafc85d741c4510/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:13.151307 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2970684-fe2d-4391-b863-114775b58d20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ace2da9b05c44985be07883609d01e06, user_id=2467cf172954487abeafc85d741c4510, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:13.154020 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2970684-fe2d-4391-b863-114775b58d20 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:13.167494 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1424/2869] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 14:06:13 2022] PUT /identity/v3/projects/ace2da9b05c44985be07883609d01e06/users/2467cf172954487abeafc85d741c4510/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:06:13.178331 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3991c-cb1e-4e38-a1c1-1e1548a574c2 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:13.178657 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3991c-cb1e-4e38-a1c1-1e1548a574c2 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:13.178877 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3991c-cb1e-4e38-a1c1-1e1548a574c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:13.213131 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-e2f3991c-cb1e-4e38-a1c1-1e1548a574c2 None None] MFA Rules not processed for user `2467cf172954487abeafc85d741c4510`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:06:13.214472 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-e2f3991c-cb1e-4e38-a1c1-1e1548a574c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:13.302658 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1446/2870] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:06:13 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:06:13.315533 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2970684-fe2d-4391-b863-114775b58d20 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:13.317569 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-c2970684-fe2d-4391-b863-114775b58d20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:13.387294 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2970684-fe2d-4391-b863-114775b58d20 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:13.392268 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461fc4d-ca81-4958-a66b-a2cf875b33e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:13.392982 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461fc4d-ca81-4958-a66b-a2cf875b33e2 service cinder] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:13.393184 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461fc4d-ca81-4958-a66b-a2cf875b33e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:13.393567 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461fc4d-ca81-4958-a66b-a2cf875b33e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:13.404390 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b461fc4d-ca81-4958-a66b-a2cf875b33e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:13.405965 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b461fc4d-ca81-4958-a66b-a2cf875b33e2 service cinder] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:13.418730 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1425/2871] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:06:13 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:06:14.188445 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3991c-cb1e-4e38-a1c1-1e1548a574c2 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:14.190806 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-e2f3991c-cb1e-4e38-a1c1-1e1548a574c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:14.212539 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3991c-cb1e-4e38-a1c1-1e1548a574c2 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:14.219875 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12742919-2405-41f0-8012-731e866c7bae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:14.220955 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12742919-2405-41f0-8012-731e866c7bae service cinder] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:14.221491 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12742919-2405-41f0-8012-731e866c7bae service cinder] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:14.221963 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12742919-2405-41f0-8012-731e866c7bae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:14.323100 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12742919-2405-41f0-8012-731e866c7bae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:14.325949 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12742919-2405-41f0-8012-731e866c7bae service cinder] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:14.338283 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1447/2872] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:06:14 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:06:18.812028 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461fc4d-ca81-4958-a66b-a2cf875b33e2 service cinder] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:18.826831 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461fc4d-ca81-4958-a66b-a2cf875b33e2 service cinder] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:18.834409 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bce057-1913-4c94-954c-4e2d2a745cde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:18.835473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bce057-1913-4c94-954c-4e2d2a745cde service cinder] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:18.835976 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bce057-1913-4c94-954c-4e2d2a745cde service cinder] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:18.836417 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bce057-1913-4c94-954c-4e2d2a745cde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:18.901766 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:18.951643 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bce057-1913-4c94-954c-4e2d2a745cde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:18.955100 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bce057-1913-4c94-954c-4e2d2a745cde service cinder] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:18.973658 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1426/2873] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:06:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:06:21.734567 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12742919-2405-41f0-8012-731e866c7bae service cinder] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:21.817667 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12742919-2405-41f0-8012-731e866c7bae service cinder] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:21.823301 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bfdb44-715d-4dac-99e7-8c12d9f1be6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:21.824138 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfdb44-715d-4dac-99e7-8c12d9f1be6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:21.824543 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfdb44-715d-4dac-99e7-8c12d9f1be6a admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:21.824921 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfdb44-715d-4dac-99e7-8c12d9f1be6a admin admin] PATH_INFO: `/v3/users/0f3ddcff019541fc9b82b2a5dd7e0fde` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:21.826626 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bfdb44-715d-4dac-99e7-8c12d9f1be6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f3ddcff019541fc9b82b2a5dd7e0fde)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:21.829491 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bfdb44-715d-4dac-99e7-8c12d9f1be6a admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:21.861613 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:21.896640 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-a1bfdb44-715d-4dac-99e7-8c12d9f1be6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f3ddcff019541fc9b82b2a5dd7e0fde'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:21.897842 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-a1bfdb44-715d-4dac-99e7-8c12d9f1be6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f3ddcff019541fc9b82b2a5dd7e0fde'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:21.898868 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-a1bfdb44-715d-4dac-99e7-8c12d9f1be6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f3ddcff019541fc9b82b2a5dd7e0fde'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:21.914521 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-a1bfdb44-715d-4dac-99e7-8c12d9f1be6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f3ddcff019541fc9b82b2a5dd7e0fde'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:21.933454 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-a1bfdb44-715d-4dac-99e7-8c12d9f1be6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f3ddcff019541fc9b82b2a5dd7e0fde'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:21.951138 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1448/2874] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 14:06:21 2022] DELETE /identity/v3/users/0f3ddcff019541fc9b82b2a5dd7e0fde => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:06:21.956968 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f91c3d-9901-41e8-8bb8-e1af201d6f2c None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:21.957636 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f91c3d-9901-41e8-8bb8-e1af201d6f2c None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:21.957850 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f91c3d-9901-41e8-8bb8-e1af201d6f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:21.982857 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-f0f91c3d-9901-41e8-8bb8-e1af201d6f2c None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:06:21.985265 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-f0f91c3d-9901-41e8-8bb8-e1af201d6f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:22.060255 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1427/2875] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:06:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:06:22.072875 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bfdb44-715d-4dac-99e7-8c12d9f1be6a admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:22.074626 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-a1bfdb44-715d-4dac-99e7-8c12d9f1be6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:22.146641 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bfdb44-715d-4dac-99e7-8c12d9f1be6a admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:22.150874 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c42eb-5301-4484-8951-0769b5e66634 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:22.151552 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c42eb-5301-4484-8951-0769b5e66634 service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:22.151968 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c42eb-5301-4484-8951-0769b5e66634 service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:22.152287 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c42eb-5301-4484-8951-0769b5e66634 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:22.165096 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c42eb-5301-4484-8951-0769b5e66634 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:22.166688 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c42eb-5301-4484-8951-0769b5e66634 service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:22.180514 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1449/2876] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:06:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:06:22.614187 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f91c3d-9901-41e8-8bb8-e1af201d6f2c None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:22.616887 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-f0f91c3d-9901-41e8-8bb8-e1af201d6f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:22.640133 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f91c3d-9901-41e8-8bb8-e1af201d6f2c None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:22.648121 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667413b-433b-461e-9275-6f071b6bbf4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:22.649260 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667413b-433b-461e-9275-6f071b6bbf4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:22.649821 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667413b-433b-461e-9275-6f071b6bbf4f admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:22.650357 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4667413b-433b-461e-9275-6f071b6bbf4f admin admin] PATH_INFO: `/v3/projects/914b2a13ce6048a789d3c93146e4c85c` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:22.652278 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4667413b-433b-461e-9275-6f071b6bbf4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=914b2a13ce6048a789d3c93146e4c85c)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:22.656560 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4667413b-433b-461e-9275-6f071b6bbf4f admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:22.739232 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-4667413b-433b-461e-9275-6f071b6bbf4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '914b2a13ce6048a789d3c93146e4c85c', 'request_id': 'req-4667413b-433b-461e-9275-6f071b6bbf4f'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:22.750994 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-4667413b-433b-461e-9275-6f071b6bbf4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '914b2a13ce6048a789d3c93146e4c85c', 'request_id': 'req-4667413b-433b-461e-9275-6f071b6bbf4f'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:22.759956 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-4667413b-433b-461e-9275-6f071b6bbf4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '914b2a13ce6048a789d3c93146e4c85c', 'request_id': 'req-4667413b-433b-461e-9275-6f071b6bbf4f'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:22.779100 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-4667413b-433b-461e-9275-6f071b6bbf4f admin admin] The token cache is being invalidate because project 914b2a13ce6048a789d3c93146e4c85c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:06:22.779603 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-4667413b-433b-461e-9275-6f071b6bbf4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:22.780658 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-4667413b-433b-461e-9275-6f071b6bbf4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:22.783194 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1428/2877] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 14:06:22 2022] DELETE /identity/v3/projects/914b2a13ce6048a789d3c93146e4c85c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:06:22.788003 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c42eb-5301-4484-8951-0769b5e66634 service neutron] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:22.804249 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c42eb-5301-4484-8951-0769b5e66634 service neutron] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:22.916748 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc0cd49-bbf4-4216-ac26-56bf0ec8a9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:22.917780 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0cd49-bbf4-4216-ac26-56bf0ec8a9be admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:22.918274 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0cd49-bbf4-4216-ac26-56bf0ec8a9be admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:22.918758 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0cd49-bbf4-4216-ac26-56bf0ec8a9be admin admin] PATH_INFO: `/v3/users/b13a4c4f44984bb38dfe54d82692f085` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:22.920931 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc0cd49-bbf4-4216-ac26-56bf0ec8a9be admin admin] RBAC: Authorizing `identity:delete_user(user_id=b13a4c4f44984bb38dfe54d82692f085)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:22.924767 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc0cd49-bbf4-4216-ac26-56bf0ec8a9be admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:23.006711 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:23.010066 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-1bc0cd49-bbf4-4216-ac26-56bf0ec8a9be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b13a4c4f44984bb38dfe54d82692f085'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:23.011418 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-1bc0cd49-bbf4-4216-ac26-56bf0ec8a9be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b13a4c4f44984bb38dfe54d82692f085'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:23.012225 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-1bc0cd49-bbf4-4216-ac26-56bf0ec8a9be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b13a4c4f44984bb38dfe54d82692f085'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:23.024791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-1bc0cd49-bbf4-4216-ac26-56bf0ec8a9be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b13a4c4f44984bb38dfe54d82692f085'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:23.041583 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-1bc0cd49-bbf4-4216-ac26-56bf0ec8a9be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b13a4c4f44984bb38dfe54d82692f085'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:23.064089 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1450/2878] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 14:06:22 2022] DELETE /identity/v3/users/b13a4c4f44984bb38dfe54d82692f085 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:06:23.758962 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667413b-433b-461e-9275-6f071b6bbf4f admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:23.761075 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-4667413b-433b-461e-9275-6f071b6bbf4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:23.781724 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4667413b-433b-461e-9275-6f071b6bbf4f admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:23.855224 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:23.865864 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac8035a-9bce-46a8-80d7-53f2f3b0fd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:23.866707 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8035a-9bce-46a8-80d7-53f2f3b0fd81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:23.867230 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8035a-9bce-46a8-80d7-53f2f3b0fd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:23.867726 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8035a-9bce-46a8-80d7-53f2f3b0fd81 admin admin] PATH_INFO: `/v3/projects/b0839c9e6f5a4f738caeb653e9d4f199` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:23.870055 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac8035a-9bce-46a8-80d7-53f2f3b0fd81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0839c9e6f5a4f738caeb653e9d4f199)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:23.872520 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac8035a-9bce-46a8-80d7-53f2f3b0fd81 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:23.942446 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-3ac8035a-9bce-46a8-80d7-53f2f3b0fd81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0839c9e6f5a4f738caeb653e9d4f199', 'request_id': 'req-3ac8035a-9bce-46a8-80d7-53f2f3b0fd81'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:23.951446 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-3ac8035a-9bce-46a8-80d7-53f2f3b0fd81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0839c9e6f5a4f738caeb653e9d4f199', 'request_id': 'req-3ac8035a-9bce-46a8-80d7-53f2f3b0fd81'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:23.958839 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-3ac8035a-9bce-46a8-80d7-53f2f3b0fd81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0839c9e6f5a4f738caeb653e9d4f199', 'request_id': 'req-3ac8035a-9bce-46a8-80d7-53f2f3b0fd81'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:23.979413 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-3ac8035a-9bce-46a8-80d7-53f2f3b0fd81 admin admin] The token cache is being invalidate because project b0839c9e6f5a4f738caeb653e9d4f199 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:06:23.979944 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-3ac8035a-9bce-46a8-80d7-53f2f3b0fd81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:23.981086 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-3ac8035a-9bce-46a8-80d7-53f2f3b0fd81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:23.985017 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1429/2879] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 14:06:23 2022] DELETE /identity/v3/projects/b0839c9e6f5a4f738caeb653e9d4f199 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:06:23.992107 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc0cd49-bbf4-4216-ac26-56bf0ec8a9be admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:24.004538 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-1bc0cd49-bbf4-4216-ac26-56bf0ec8a9be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:24.029123 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc0cd49-bbf4-4216-ac26-56bf0ec8a9be admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:24.106149 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2accb7e6-dab0-4eae-b903-4aeec2d962f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:24.106937 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accb7e6-dab0-4eae-b903-4aeec2d962f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:24.107260 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accb7e6-dab0-4eae-b903-4aeec2d962f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:24.107565 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accb7e6-dab0-4eae-b903-4aeec2d962f3 admin admin] PATH_INFO: `/v3/users/2467cf172954487abeafc85d741c4510` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:24.109916 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2accb7e6-dab0-4eae-b903-4aeec2d962f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2467cf172954487abeafc85d741c4510)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:24.109916 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2accb7e6-dab0-4eae-b903-4aeec2d962f3 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:24.181788 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-2accb7e6-dab0-4eae-b903-4aeec2d962f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2467cf172954487abeafc85d741c4510'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:24.182903 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-2accb7e6-dab0-4eae-b903-4aeec2d962f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2467cf172954487abeafc85d741c4510'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:24.183702 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-2accb7e6-dab0-4eae-b903-4aeec2d962f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2467cf172954487abeafc85d741c4510'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:24.194022 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-2accb7e6-dab0-4eae-b903-4aeec2d962f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2467cf172954487abeafc85d741c4510'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:24.212908 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-2accb7e6-dab0-4eae-b903-4aeec2d962f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2467cf172954487abeafc85d741c4510'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:24.232313 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1451/2880] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 14:06:23 2022] DELETE /identity/v3/users/2467cf172954487abeafc85d741c4510 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:06:24.699070 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac8035a-9bce-46a8-80d7-53f2f3b0fd81 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:24.703734 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-3ac8035a-9bce-46a8-80d7-53f2f3b0fd81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:24.728323 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac8035a-9bce-46a8-80d7-53f2f3b0fd81 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:24.825814 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4468a-ca74-4827-b836-c90594166eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:24.827782 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4468a-ca74-4827-b836-c90594166eba admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:24.827782 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4468a-ca74-4827-b836-c90594166eba admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:24.827782 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4468a-ca74-4827-b836-c90594166eba admin admin] PATH_INFO: `/v3/projects/ace2da9b05c44985be07883609d01e06` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:24.829258 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a4468a-ca74-4827-b836-c90594166eba admin admin] RBAC: Authorizing `identity:delete_project(project_id=ace2da9b05c44985be07883609d01e06)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:24.832285 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a4468a-ca74-4827-b836-c90594166eba admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:24.919231 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-44a4468a-ca74-4827-b836-c90594166eba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ace2da9b05c44985be07883609d01e06', 'request_id': 'req-44a4468a-ca74-4827-b836-c90594166eba'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:24.933124 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-44a4468a-ca74-4827-b836-c90594166eba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ace2da9b05c44985be07883609d01e06', 'request_id': 'req-44a4468a-ca74-4827-b836-c90594166eba'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:24.964175 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-44a4468a-ca74-4827-b836-c90594166eba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ace2da9b05c44985be07883609d01e06', 'request_id': 'req-44a4468a-ca74-4827-b836-c90594166eba'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:24.991576 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-44a4468a-ca74-4827-b836-c90594166eba admin admin] The token cache is being invalidate because project ace2da9b05c44985be07883609d01e06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:06:24.992184 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-44a4468a-ca74-4827-b836-c90594166eba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:24.993733 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-44a4468a-ca74-4827-b836-c90594166eba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:24.996621 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1430/2881] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 14:06:24 2022] DELETE /identity/v3/projects/ace2da9b05c44985be07883609d01e06 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:06:25.006493 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7cba5a-a4e2-4bb7-a1d2-9ba6d502b84d None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:25.007299 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7cba5a-a4e2-4bb7-a1d2-9ba6d502b84d None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:25.007465 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7cba5a-a4e2-4bb7-a1d2-9ba6d502b84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:25.047151 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-6f7cba5a-a4e2-4bb7-a1d2-9ba6d502b84d None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:06:25.051981 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-6f7cba5a-a4e2-4bb7-a1d2-9ba6d502b84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:25.114885 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:25.144943 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1452/2882] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:06:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:06:25.158590 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b4686-a1b7-4619-ba96-1eb9c2bc93df None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:25.159017 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b4686-a1b7-4619-ba96-1eb9c2bc93df None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:25.159400 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b4686-a1b7-4619-ba96-1eb9c2bc93df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:25.188986 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-801b4686-a1b7-4619-ba96-1eb9c2bc93df None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:06:25.191139 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-801b4686-a1b7-4619-ba96-1eb9c2bc93df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:25.203943 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1431/2883] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:06:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:06:25.209058 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7cba5a-a4e2-4bb7-a1d2-9ba6d502b84d None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:25.222285 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7cba5a-a4e2-4bb7-a1d2-9ba6d502b84d None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:25.229119 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aebb91a-7e0c-4630-91a9-52cad5a8cdcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:25.229863 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebb91a-7e0c-4630-91a9-52cad5a8cdcc admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:25.230172 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebb91a-7e0c-4630-91a9-52cad5a8cdcc admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:25.230417 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebb91a-7e0c-4630-91a9-52cad5a8cdcc admin admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:25.231292 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aebb91a-7e0c-4630-91a9-52cad5a8cdcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:06:25.231596 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aebb91a-7e0c-4630-91a9-52cad5a8cdcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:25.233860 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aebb91a-7e0c-4630-91a9-52cad5a8cdcc admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:25.249639 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1453/2884] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 14:06:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:06:25.255936 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b4686-a1b7-4619-ba96-1eb9c2bc93df None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:25.274852 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b4686-a1b7-4619-ba96-1eb9c2bc93df None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:25.282909 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907bab9c-0c53-4c30-b13f-c9fcc5149810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:25.283574 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907bab9c-0c53-4c30-b13f-c9fcc5149810 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:25.283925 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907bab9c-0c53-4c30-b13f-c9fcc5149810 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:25.284250 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907bab9c-0c53-4c30-b13f-c9fcc5149810 admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:25.286767 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907bab9c-0c53-4c30-b13f-c9fcc5149810 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:25.288833 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907bab9c-0c53-4c30-b13f-c9fcc5149810 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:25.300347 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:25.326353 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1432/2885] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 14:06:25 2022] POST /identity/v3/projects => generated 409 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:06:25.338029 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aebb91a-7e0c-4630-91a9-52cad5a8cdcc admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:25.359791 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aebb91a-7e0c-4630-91a9-52cad5a8cdcc admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:25.449273 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc710c77-ac35-4e84-8931-478c2752a2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:25.449273 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc710c77-ac35-4e84-8931-478c2752a2a3 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:25.449273 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc710c77-ac35-4e84-8931-478c2752a2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:25.449620 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc710c77-ac35-4e84-8931-478c2752a2a3 admin admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:25.450616 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc710c77-ac35-4e84-8931-478c2752a2a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:25.455183 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc710c77-ac35-4e84-8931-478c2752a2a3 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:25.488129 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1454/2886] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 14:06:25 2022] POST /identity/v3/users => generated 305 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:06:25.493044 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907bab9c-0c53-4c30-b13f-c9fcc5149810 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:25.506812 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907bab9c-0c53-4c30-b13f-c9fcc5149810 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:25.512275 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29e864-096e-4bed-ba24-51f2ae106e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:25.513028 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29e864-096e-4bed-ba24-51f2ae106e33 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:25.513352 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29e864-096e-4bed-ba24-51f2ae106e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:25.513689 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29e864-096e-4bed-ba24-51f2ae106e33 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:25.514417 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb29e864-096e-4bed-ba24-51f2ae106e33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:25.516352 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb29e864-096e-4bed-ba24-51f2ae106e33 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:25.529110 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1433/2887] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 14:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:06:25.533862 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc710c77-ac35-4e84-8931-478c2752a2a3 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:25.544928 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc710c77-ac35-4e84-8931-478c2752a2a3 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:25.551489 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89485bbb-5cf9-45a1-b9fc-723c8ecfb36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:25.552105 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89485bbb-5cf9-45a1-b9fc-723c8ecfb36c admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:25.552381 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89485bbb-5cf9-45a1-b9fc-723c8ecfb36c admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:25.552811 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89485bbb-5cf9-45a1-b9fc-723c8ecfb36c admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:25.553523 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89485bbb-5cf9-45a1-b9fc-723c8ecfb36c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:25.555453 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89485bbb-5cf9-45a1-b9fc-723c8ecfb36c admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:25.569976 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1455/2888] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 14:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:06:25.574535 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29e864-096e-4bed-ba24-51f2ae106e33 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:25.586050 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29e864-096e-4bed-ba24-51f2ae106e33 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:25.596176 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99cb7a-3b9e-4c69-ae7d-dec04cd9cda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:25.597424 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99cb7a-3b9e-4c69-ae7d-dec04cd9cda3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:25.597928 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99cb7a-3b9e-4c69-ae7d-dec04cd9cda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:25.598411 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99cb7a-3b9e-4c69-ae7d-dec04cd9cda3 admin admin] PATH_INFO: `/v3/projects/96502d5c95c4474582ab521684d8504e/users/d07bada8f9f6491eb80149d29c0c3001/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:25.631022 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f99cb7a-3b9e-4c69-ae7d-dec04cd9cda3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96502d5c95c4474582ab521684d8504e, user_id=d07bada8f9f6491eb80149d29c0c3001, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:25.636663 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f99cb7a-3b9e-4c69-ae7d-dec04cd9cda3 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:25.656954 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1434/2889] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 14:06:25 2022] PUT /identity/v3/projects/96502d5c95c4474582ab521684d8504e/users/d07bada8f9f6491eb80149d29c0c3001/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:06:25.672833 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7031b8b-4b26-4eb6-b71a-5346ccc42f68 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:25.673326 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7031b8b-4b26-4eb6-b71a-5346ccc42f68 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:25.673897 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7031b8b-4b26-4eb6-b71a-5346ccc42f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:25.728379 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-e7031b8b-4b26-4eb6-b71a-5346ccc42f68 None None] MFA Rules not processed for user `d07bada8f9f6491eb80149d29c0c3001`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:06:25.730537 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-e7031b8b-4b26-4eb6-b71a-5346ccc42f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:25.854919 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1456/2890] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:06:25 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:06:25.862179 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99cb7a-3b9e-4c69-ae7d-dec04cd9cda3 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:25.970113 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99cb7a-3b9e-4c69-ae7d-dec04cd9cda3 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:25.975306 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434b3b0-ab21-4590-ab79-3df358169a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:25.975959 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434b3b0-ab21-4590-ab79-3df358169a20 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:25.976449 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434b3b0-ab21-4590-ab79-3df358169a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:25.976930 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434b3b0-ab21-4590-ab79-3df358169a20 admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:25.977457 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434b3b0-ab21-4590-ab79-3df358169a20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:25.979887 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434b3b0-ab21-4590-ab79-3df358169a20 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:26.020302 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1435/2891] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 14:06:25 2022] POST /identity/v3/projects => generated 407 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:06:26.024867 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7031b8b-4b26-4eb6-b71a-5346ccc42f68 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:26.040469 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7031b8b-4b26-4eb6-b71a-5346ccc42f68 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:26.092857 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:26.140611 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c599665-8613-47c1-904c-28e4b00c14e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:26.141252 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c599665-8613-47c1-904c-28e4b00c14e4 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:26.141565 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c599665-8613-47c1-904c-28e4b00c14e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:26.141840 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c599665-8613-47c1-904c-28e4b00c14e4 admin admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:26.142515 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c599665-8613-47c1-904c-28e4b00c14e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:26.144517 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c599665-8613-47c1-904c-28e4b00c14e4 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:26.171435 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1457/2892] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 14:06:26 2022] POST /identity/v3/users => generated 310 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:06:26.177357 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434b3b0-ab21-4590-ab79-3df358169a20 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:26.190017 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434b3b0-ab21-4590-ab79-3df358169a20 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:26.195419 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ee0b6-cbb4-4875-a55b-ec2598e1f554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:26.196112 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ee0b6-cbb4-4875-a55b-ec2598e1f554 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:26.196501 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ee0b6-cbb4-4875-a55b-ec2598e1f554 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:26.196887 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ee0b6-cbb4-4875-a55b-ec2598e1f554 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:26.197742 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ee0b6-cbb4-4875-a55b-ec2598e1f554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:26.199749 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ee0b6-cbb4-4875-a55b-ec2598e1f554 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:26.214171 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1436/2893] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 14:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:06:26.219811 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c599665-8613-47c1-904c-28e4b00c14e4 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:26.231567 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c599665-8613-47c1-904c-28e4b00c14e4 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:26.237656 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1832b-44bd-4547-9f89-9460286a3b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:26.238386 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1832b-44bd-4547-9f89-9460286a3b79 admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:26.238775 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1832b-44bd-4547-9f89-9460286a3b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:26.239210 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1832b-44bd-4547-9f89-9460286a3b79 admin admin] PATH_INFO: `/v3/projects/e0aa371ee855420cb9b61a25ade79204/users/3987ca2350d8447d8ab8802d3cfc1a8c/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:26.268744 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b1832b-44bd-4547-9f89-9460286a3b79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0aa371ee855420cb9b61a25ade79204, user_id=3987ca2350d8447d8ab8802d3cfc1a8c, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:26.274337 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b1832b-44bd-4547-9f89-9460286a3b79 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:26.298694 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1458/2894] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 14:06:26 2022] PUT /identity/v3/projects/e0aa371ee855420cb9b61a25ade79204/users/3987ca2350d8447d8ab8802d3cfc1a8c/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:06:26.304599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ee0b6-cbb4-4875-a55b-ec2598e1f554 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:26.317414 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ee0b6-cbb4-4875-a55b-ec2598e1f554 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:26.393900 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9488b5f7-1c7b-414b-94c7-71f69ff016c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:26.394409 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488b5f7-1c7b-414b-94c7-71f69ff016c8 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:26.394689 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488b5f7-1c7b-414b-94c7-71f69ff016c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:26.394962 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488b5f7-1c7b-414b-94c7-71f69ff016c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:26.395625 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9488b5f7-1c7b-414b-94c7-71f69ff016c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:26.397411 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9488b5f7-1c7b-414b-94c7-71f69ff016c8 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:26.422258 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1437/2895] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 14:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:06:26.427767 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1832b-44bd-4547-9f89-9460286a3b79 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:26.446692 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1832b-44bd-4547-9f89-9460286a3b79 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:26.452133 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8baa7af-5de1-41a0-80c4-7c14b4bf5a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:26.452943 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8baa7af-5de1-41a0-80c4-7c14b4bf5a91 admin admin] REQUEST_METHOD: `PUT` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:26.453323 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8baa7af-5de1-41a0-80c4-7c14b4bf5a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:26.453757 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8baa7af-5de1-41a0-80c4-7c14b4bf5a91 admin admin] PATH_INFO: `/v3/projects/e0aa371ee855420cb9b61a25ade79204/users/3987ca2350d8447d8ab8802d3cfc1a8c/roles/9c76f398c9e04caeab83842e70eb824b` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:26.456388 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8baa7af-5de1-41a0-80c4-7c14b4bf5a91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0aa371ee855420cb9b61a25ade79204, user_id=3987ca2350d8447d8ab8802d3cfc1a8c, role_id=9c76f398c9e04caeab83842e70eb824b)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:26.459590 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8baa7af-5de1-41a0-80c4-7c14b4bf5a91 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:26.472284 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1459/2896] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 14:06:26 2022] PUT /identity/v3/projects/e0aa371ee855420cb9b61a25ade79204/users/3987ca2350d8447d8ab8802d3cfc1a8c/roles/9c76f398c9e04caeab83842e70eb824b => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:06:26.491724 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2a25f-4e5a-4566-a3ff-9252322dfb56 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:26.492225 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2a25f-4e5a-4566-a3ff-9252322dfb56 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:26.492619 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2a25f-4e5a-4566-a3ff-9252322dfb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:26.527350 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-47c2a25f-4e5a-4566-a3ff-9252322dfb56 None None] MFA Rules not processed for user `3987ca2350d8447d8ab8802d3cfc1a8c`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:06:26.528645 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-47c2a25f-4e5a-4566-a3ff-9252322dfb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:26.555216 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:26.658649 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1438/2897] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:06:26 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:06:26.673701 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8baa7af-5de1-41a0-80c4-7c14b4bf5a91 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:26.675900 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-d8baa7af-5de1-41a0-80c4-7c14b4bf5a91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:26.766416 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8baa7af-5de1-41a0-80c4-7c14b4bf5a91 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:26.770649 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb8b0e-c2e6-4c97-acd8-83af58746ff3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:26.771486 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb8b0e-c2e6-4c97-acd8-83af58746ff3 service cinder] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:26.771760 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb8b0e-c2e6-4c97-acd8-83af58746ff3 service cinder] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:26.772026 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb8b0e-c2e6-4c97-acd8-83af58746ff3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:26.786165 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceb8b0e-c2e6-4c97-acd8-83af58746ff3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:26.791334 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceb8b0e-c2e6-4c97-acd8-83af58746ff3 service cinder] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:26.809233 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1460/2898] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:06:26 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:06:27.031712 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c2a25f-4e5a-4566-a3ff-9252322dfb56 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:27.043769 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c2a25f-4e5a-4566-a3ff-9252322dfb56 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:27.050430 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148ed752-b617-4f26-80b5-20a19af1a05a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:27.051361 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ed752-b617-4f26-80b5-20a19af1a05a service cinder] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:27.051786 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ed752-b617-4f26-80b5-20a19af1a05a service cinder] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:27.052191 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148ed752-b617-4f26-80b5-20a19af1a05a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:27.145494 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ed752-b617-4f26-80b5-20a19af1a05a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:27.146968 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148ed752-b617-4f26-80b5-20a19af1a05a service cinder] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:27.158898 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1439/2899] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:06:27 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:06:33.179458 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb8b0e-c2e6-4c97-acd8-83af58746ff3 service cinder] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:33.276603 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb8b0e-c2e6-4c97-acd8-83af58746ff3 service cinder] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:33.284008 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609d6fd-d5f4-46f2-9b90-aea15fc434c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:33.284470 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609d6fd-d5f4-46f2-9b90-aea15fc434c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:33.284758 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609d6fd-d5f4-46f2-9b90-aea15fc434c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:33.285190 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609d6fd-d5f4-46f2-9b90-aea15fc434c7 admin admin] PATH_INFO: `/v3/users/d07bada8f9f6491eb80149d29c0c3001` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:33.286675 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5609d6fd-d5f4-46f2-9b90-aea15fc434c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d07bada8f9f6491eb80149d29c0c3001)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:33.288823 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5609d6fd-d5f4-46f2-9b90-aea15fc434c7 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:33.360046 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:33.375266 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-5609d6fd-d5f4-46f2-9b90-aea15fc434c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd07bada8f9f6491eb80149d29c0c3001'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:33.376603 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-5609d6fd-d5f4-46f2-9b90-aea15fc434c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd07bada8f9f6491eb80149d29c0c3001'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:33.377793 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-5609d6fd-d5f4-46f2-9b90-aea15fc434c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd07bada8f9f6491eb80149d29c0c3001'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:33.392638 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-5609d6fd-d5f4-46f2-9b90-aea15fc434c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd07bada8f9f6491eb80149d29c0c3001'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:33.417210 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-5609d6fd-d5f4-46f2-9b90-aea15fc434c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd07bada8f9f6491eb80149d29c0c3001'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:33.441792 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1461/2900] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 14:06:33 2022] DELETE /identity/v3/users/d07bada8f9f6491eb80149d29c0c3001 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:06:33.448822 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ed026-8072-423e-9af4-f85c7a034a70 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:33.449665 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ed026-8072-423e-9af4-f85c7a034a70 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:33.449665 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ed026-8072-423e-9af4-f85c7a034a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:33.476873 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-1a4ed026-8072-423e-9af4-f85c7a034a70 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:06:33.478598 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-1a4ed026-8072-423e-9af4-f85c7a034a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:33.571541 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1440/2901] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:06:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:06:33.583769 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609d6fd-d5f4-46f2-9b90-aea15fc434c7 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:33.586044 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-5609d6fd-d5f4-46f2-9b90-aea15fc434c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:33.678966 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609d6fd-d5f4-46f2-9b90-aea15fc434c7 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:33.684252 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd527ab-d534-467f-816e-daa58d1be700 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:33.685254 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd527ab-d534-467f-816e-daa58d1be700 service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:33.685759 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd527ab-d534-467f-816e-daa58d1be700 service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:33.686347 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd527ab-d534-467f-816e-daa58d1be700 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:33.697518 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd527ab-d534-467f-816e-daa58d1be700 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:33.698913 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd527ab-d534-467f-816e-daa58d1be700 service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:33.710785 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1462/2902] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:06:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:06:34.153830 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ed026-8072-423e-9af4-f85c7a034a70 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:34.157291 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-1a4ed026-8072-423e-9af4-f85c7a034a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:34.181202 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ed026-8072-423e-9af4-f85c7a034a70 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:34.189837 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666f051-9e16-43e4-ae7c-d692748eed5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:34.190953 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666f051-9e16-43e4-ae7c-d692748eed5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:34.191419 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666f051-9e16-43e4-ae7c-d692748eed5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:34.191944 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666f051-9e16-43e4-ae7c-d692748eed5c admin admin] PATH_INFO: `/v3/projects/96502d5c95c4474582ab521684d8504e` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:34.194374 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d666f051-9e16-43e4-ae7c-d692748eed5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=96502d5c95c4474582ab521684d8504e)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:34.198026 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d666f051-9e16-43e4-ae7c-d692748eed5c admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:34.282146 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:34.287105 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-d666f051-9e16-43e4-ae7c-d692748eed5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96502d5c95c4474582ab521684d8504e', 'request_id': 'req-d666f051-9e16-43e4-ae7c-d692748eed5c'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:34.297756 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-d666f051-9e16-43e4-ae7c-d692748eed5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96502d5c95c4474582ab521684d8504e', 'request_id': 'req-d666f051-9e16-43e4-ae7c-d692748eed5c'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:34.305008 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-d666f051-9e16-43e4-ae7c-d692748eed5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96502d5c95c4474582ab521684d8504e', 'request_id': 'req-d666f051-9e16-43e4-ae7c-d692748eed5c'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:34.328715 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-d666f051-9e16-43e4-ae7c-d692748eed5c admin admin] The token cache is being invalidate because project 96502d5c95c4474582ab521684d8504e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:06:34.329168 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-d666f051-9e16-43e4-ae7c-d692748eed5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:34.330197 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-d666f051-9e16-43e4-ae7c-d692748eed5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:34.332402 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1441/2903] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 14:06:34 2022] DELETE /identity/v3/projects/96502d5c95c4474582ab521684d8504e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:06:34.338387 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd527ab-d534-467f-816e-daa58d1be700 service neutron] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:34.354627 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd527ab-d534-467f-816e-daa58d1be700 service neutron] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:34.462245 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00182f-8583-46f4-8207-7add9a7d907d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:34.463256 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00182f-8583-46f4-8207-7add9a7d907d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:34.463755 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00182f-8583-46f4-8207-7add9a7d907d admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:34.464238 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00182f-8583-46f4-8207-7add9a7d907d admin admin] PATH_INFO: `/v3/users/3987ca2350d8447d8ab8802d3cfc1a8c` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:34.466367 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca00182f-8583-46f4-8207-7add9a7d907d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3987ca2350d8447d8ab8802d3cfc1a8c)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:34.470691 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca00182f-8583-46f4-8207-7add9a7d907d admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:34.544343 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-ca00182f-8583-46f4-8207-7add9a7d907d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3987ca2350d8447d8ab8802d3cfc1a8c'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:34.545834 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-ca00182f-8583-46f4-8207-7add9a7d907d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3987ca2350d8447d8ab8802d3cfc1a8c'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:34.547243 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-ca00182f-8583-46f4-8207-7add9a7d907d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3987ca2350d8447d8ab8802d3cfc1a8c'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:34.556981 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-ca00182f-8583-46f4-8207-7add9a7d907d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3987ca2350d8447d8ab8802d3cfc1a8c'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:34.558517 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:34.577429 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-ca00182f-8583-46f4-8207-7add9a7d907d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3987ca2350d8447d8ab8802d3cfc1a8c'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:34.597012 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1463/2904] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 14:06:34 2022] DELETE /identity/v3/users/3987ca2350d8447d8ab8802d3cfc1a8c => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:06:35.023903 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666f051-9e16-43e4-ae7c-d692748eed5c admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:35.026291 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-d666f051-9e16-43e4-ae7c-d692748eed5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:35.051866 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d666f051-9e16-43e4-ae7c-d692748eed5c admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:35.143319 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d9b3c-bc74-4fad-bcb5-4a6df1142dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:35.144262 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d9b3c-bc74-4fad-bcb5-4a6df1142dff admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:35.144661 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d9b3c-bc74-4fad-bcb5-4a6df1142dff admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:35.145045 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d9b3c-bc74-4fad-bcb5-4a6df1142dff admin admin] PATH_INFO: `/v3/projects/e0aa371ee855420cb9b61a25ade79204` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:35.147074 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d9b3c-bc74-4fad-bcb5-4a6df1142dff admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0aa371ee855420cb9b61a25ade79204)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:35.150434 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d9b3c-bc74-4fad-bcb5-4a6df1142dff admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:35.237000 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-578d9b3c-bc74-4fad-bcb5-4a6df1142dff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0aa371ee855420cb9b61a25ade79204', 'request_id': 'req-578d9b3c-bc74-4fad-bcb5-4a6df1142dff'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:35.250287 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-578d9b3c-bc74-4fad-bcb5-4a6df1142dff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0aa371ee855420cb9b61a25ade79204', 'request_id': 'req-578d9b3c-bc74-4fad-bcb5-4a6df1142dff'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:35.262011 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-578d9b3c-bc74-4fad-bcb5-4a6df1142dff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0aa371ee855420cb9b61a25ade79204', 'request_id': 'req-578d9b3c-bc74-4fad-bcb5-4a6df1142dff'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:35.290201 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-578d9b3c-bc74-4fad-bcb5-4a6df1142dff admin admin] The token cache is being invalidate because project e0aa371ee855420cb9b61a25ade79204 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:06:35.290735 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-578d9b3c-bc74-4fad-bcb5-4a6df1142dff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:35.291928 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-578d9b3c-bc74-4fad-bcb5-4a6df1142dff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:35.294652 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1442/2905] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 14:06:35 2022] DELETE /identity/v3/projects/e0aa371ee855420cb9b61a25ade79204 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:06:35.305080 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d97d8b-ed76-45da-becc-4283b65fbd99 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:35.305644 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d97d8b-ed76-45da-becc-4283b65fbd99 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:35.306135 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d97d8b-ed76-45da-becc-4283b65fbd99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:35.342191 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-86d97d8b-ed76-45da-becc-4283b65fbd99 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:06:35.344081 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-86d97d8b-ed76-45da-becc-4283b65fbd99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:35.447494 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1464/2906] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:06:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:06:35.460943 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83aa6ba-c33c-46b9-ab8f-b10714bfe970 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:35.461451 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83aa6ba-c33c-46b9-ab8f-b10714bfe970 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:35.461968 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83aa6ba-c33c-46b9-ab8f-b10714bfe970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:35.498109 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-b83aa6ba-c33c-46b9-ab8f-b10714bfe970 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:06:35.501537 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-b83aa6ba-c33c-46b9-ab8f-b10714bfe970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:35.516364 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1443/2907] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:06:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:06:35.521160 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d97d8b-ed76-45da-becc-4283b65fbd99 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:35.532922 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d97d8b-ed76-45da-becc-4283b65fbd99 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:35.539137 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c02577-d043-4650-9cae-bb100b668bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:35.539822 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c02577-d043-4650-9cae-bb100b668bfc admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:35.540141 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c02577-d043-4650-9cae-bb100b668bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:35.540454 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c02577-d043-4650-9cae-bb100b668bfc admin admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:35.541175 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c02577-d043-4650-9cae-bb100b668bfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:06:35.541568 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c02577-d043-4650-9cae-bb100b668bfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:35.543302 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c02577-d043-4650-9cae-bb100b668bfc admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:35.560772 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1465/2908] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 14:06:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 14:06:35.566552 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83aa6ba-c33c-46b9-ab8f-b10714bfe970 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:35.584969 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83aa6ba-c33c-46b9-ab8f-b10714bfe970 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:35.590697 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73bf2e-7448-4355-a1b9-cc4605a279c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:35.591484 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73bf2e-7448-4355-a1b9-cc4605a279c1 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:35.591919 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73bf2e-7448-4355-a1b9-cc4605a279c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:35.592921 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73bf2e-7448-4355-a1b9-cc4605a279c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:35.595585 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da73bf2e-7448-4355-a1b9-cc4605a279c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:35.597078 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da73bf2e-7448-4355-a1b9-cc4605a279c1 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:35.637027 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1444/2909] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 14:06:35 2022] POST /identity/v3/projects => generated 383 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:06:35.643560 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c02577-d043-4650-9cae-bb100b668bfc admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:35.657265 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c02577-d043-4650-9cae-bb100b668bfc admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:35.762455 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6da67-3554-4a6c-b60a-4cfc706560b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:35.763399 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6da67-3554-4a6c-b60a-4cfc706560b4 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:35.763849 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6da67-3554-4a6c-b60a-4cfc706560b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:35.764951 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6da67-3554-4a6c-b60a-4cfc706560b4 admin admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:35.766109 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6da67-3554-4a6c-b60a-4cfc706560b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:35.769749 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6da67-3554-4a6c-b60a-4cfc706560b4 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:35.812769 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1466/2910] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 14:06:35 2022] POST /identity/v3/users => generated 292 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:06:35.824144 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73bf2e-7448-4355-a1b9-cc4605a279c1 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:35.838406 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73bf2e-7448-4355-a1b9-cc4605a279c1 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:35.844216 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780e544-ce44-4a48-bdcc-d41fbb5953d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:35.844893 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780e544-ce44-4a48-bdcc-d41fbb5953d2 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:35.845209 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780e544-ce44-4a48-bdcc-d41fbb5953d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:35.845566 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780e544-ce44-4a48-bdcc-d41fbb5953d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:35.846269 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7780e544-ce44-4a48-bdcc-d41fbb5953d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:35.848553 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7780e544-ce44-4a48-bdcc-d41fbb5953d2 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:35.862829 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1445/2911] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 14:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:06:35.867529 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6da67-3554-4a6c-b60a-4cfc706560b4 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:35.881748 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6da67-3554-4a6c-b60a-4cfc706560b4 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:35.887221 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10229c2c-049a-4168-86a4-0a397e103560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:35.887895 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10229c2c-049a-4168-86a4-0a397e103560 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:35.888215 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10229c2c-049a-4168-86a4-0a397e103560 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:35.888548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10229c2c-049a-4168-86a4-0a397e103560 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:35.889902 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10229c2c-049a-4168-86a4-0a397e103560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:35.892829 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10229c2c-049a-4168-86a4-0a397e103560 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:35.910175 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1467/2912] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 14:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:06:35.915867 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780e544-ce44-4a48-bdcc-d41fbb5953d2 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:35.930525 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780e544-ce44-4a48-bdcc-d41fbb5953d2 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:35.936407 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9ffed-c065-49d6-b5b9-69cf37d7c4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:35.937492 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9ffed-c065-49d6-b5b9-69cf37d7c4ec admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:35.938473 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9ffed-c065-49d6-b5b9-69cf37d7c4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:35.938695 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9ffed-c065-49d6-b5b9-69cf37d7c4ec admin admin] PATH_INFO: `/v3/projects/5137e8d8614f4aa2abd2af9f68001e84/users/e02bd00d20a84ef899f26c01cd9fd286/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:35.959809 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9ffed-c065-49d6-b5b9-69cf37d7c4ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=5137e8d8614f4aa2abd2af9f68001e84, user_id=e02bd00d20a84ef899f26c01cd9fd286, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:35.962844 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9ffed-c065-49d6-b5b9-69cf37d7c4ec admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:35.974409 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:35.986556 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1446/2913] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 14:06:35 2022] PUT /identity/v3/projects/5137e8d8614f4aa2abd2af9f68001e84/users/e02bd00d20a84ef899f26c01cd9fd286/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:06:36.003459 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487eb09-e9ec-44ce-ba1f-22839f018920 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:36.003973 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487eb09-e9ec-44ce-ba1f-22839f018920 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:36.004386 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487eb09-e9ec-44ce-ba1f-22839f018920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:36.053557 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-8487eb09-e9ec-44ce-ba1f-22839f018920 None None] MFA Rules not processed for user `e02bd00d20a84ef899f26c01cd9fd286`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:06:36.055448 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-8487eb09-e9ec-44ce-ba1f-22839f018920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:36.112595 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:36.187846 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1468/2914] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:06:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:06:36.205481 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9ffed-c065-49d6-b5b9-69cf37d7c4ec admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:36.208270 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-2ff9ffed-c065-49d6-b5b9-69cf37d7c4ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:36.301864 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9ffed-c065-49d6-b5b9-69cf37d7c4ec admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:36.306231 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357bd0b-bf13-4064-b921-9610524a60c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:36.306993 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357bd0b-bf13-4064-b921-9610524a60c4 service cinder] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:36.307370 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357bd0b-bf13-4064-b921-9610524a60c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:36.307784 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357bd0b-bf13-4064-b921-9610524a60c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:36.318683 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357bd0b-bf13-4064-b921-9610524a60c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:36.320300 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357bd0b-bf13-4064-b921-9610524a60c4 service cinder] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:36.331098 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1447/2915] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:06:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:06:39.176130 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8487eb09-e9ec-44ce-ba1f-22839f018920 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:39.297751 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8487eb09-e9ec-44ce-ba1f-22839f018920 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:39.306393 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bad7e2-b5a7-4239-81ac-a5ae64350dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:39.307461 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bad7e2-b5a7-4239-81ac-a5ae64350dd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:39.307924 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bad7e2-b5a7-4239-81ac-a5ae64350dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:39.308414 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bad7e2-b5a7-4239-81ac-a5ae64350dd5 admin admin] PATH_INFO: `/v3/users/e02bd00d20a84ef899f26c01cd9fd286` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:39.310606 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bad7e2-b5a7-4239-81ac-a5ae64350dd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e02bd00d20a84ef899f26c01cd9fd286)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:39.314640 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bad7e2-b5a7-4239-81ac-a5ae64350dd5 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:39.403362 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-22bad7e2-b5a7-4239-81ac-a5ae64350dd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e02bd00d20a84ef899f26c01cd9fd286'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:39.404087 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-22bad7e2-b5a7-4239-81ac-a5ae64350dd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e02bd00d20a84ef899f26c01cd9fd286'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:39.405454 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-22bad7e2-b5a7-4239-81ac-a5ae64350dd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e02bd00d20a84ef899f26c01cd9fd286'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:39.414931 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-22bad7e2-b5a7-4239-81ac-a5ae64350dd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e02bd00d20a84ef899f26c01cd9fd286'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:39.437518 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-22bad7e2-b5a7-4239-81ac-a5ae64350dd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e02bd00d20a84ef899f26c01cd9fd286'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:39.460613 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1469/2916] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 14:06:39 2022] DELETE /identity/v3/users/e02bd00d20a84ef899f26c01cd9fd286 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:06:39.466712 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d9be5-1118-49a9-84b7-d6e64b29c50a None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:39.468082 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d9be5-1118-49a9-84b7-d6e64b29c50a None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:39.468276 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d9be5-1118-49a9-84b7-d6e64b29c50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:39.492739 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-ba9d9be5-1118-49a9-84b7-d6e64b29c50a None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:06:39.494046 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-ba9d9be5-1118-49a9-84b7-d6e64b29c50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:39.580447 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1448/2917] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:06:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:06:39.594692 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bad7e2-b5a7-4239-81ac-a5ae64350dd5 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:39.596790 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-22bad7e2-b5a7-4239-81ac-a5ae64350dd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:39.720729 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:39.727358 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bad7e2-b5a7-4239-81ac-a5ae64350dd5 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:39.736476 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f037e66-1421-4017-9003-755addc8b551 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:39.737552 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f037e66-1421-4017-9003-755addc8b551 service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:39.738046 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f037e66-1421-4017-9003-755addc8b551 service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:39.738812 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f037e66-1421-4017-9003-755addc8b551 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:39.755542 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f037e66-1421-4017-9003-755addc8b551 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:39.757714 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f037e66-1421-4017-9003-755addc8b551 service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:39.776354 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1470/2918] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:06:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:06:40.190334 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d9be5-1118-49a9-84b7-d6e64b29c50a None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:40.191954 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-ba9d9be5-1118-49a9-84b7-d6e64b29c50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:40.211138 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d9be5-1118-49a9-84b7-d6e64b29c50a None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:40.219246 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462e9fd-2fa8-4c37-8058-d9710997cd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:40.220332 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462e9fd-2fa8-4c37-8058-d9710997cd1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:40.220814 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462e9fd-2fa8-4c37-8058-d9710997cd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:40.221321 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462e9fd-2fa8-4c37-8058-d9710997cd1a admin admin] PATH_INFO: `/v3/projects/5137e8d8614f4aa2abd2af9f68001e84` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:40.223810 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1462e9fd-2fa8-4c37-8058-d9710997cd1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5137e8d8614f4aa2abd2af9f68001e84)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:40.227837 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1462e9fd-2fa8-4c37-8058-d9710997cd1a admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:40.310553 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-1462e9fd-2fa8-4c37-8058-d9710997cd1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5137e8d8614f4aa2abd2af9f68001e84', 'request_id': 'req-1462e9fd-2fa8-4c37-8058-d9710997cd1a'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:40.323183 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-1462e9fd-2fa8-4c37-8058-d9710997cd1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5137e8d8614f4aa2abd2af9f68001e84', 'request_id': 'req-1462e9fd-2fa8-4c37-8058-d9710997cd1a'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:40.332227 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-1462e9fd-2fa8-4c37-8058-d9710997cd1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5137e8d8614f4aa2abd2af9f68001e84', 'request_id': 'req-1462e9fd-2fa8-4c37-8058-d9710997cd1a'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:40.353409 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-1462e9fd-2fa8-4c37-8058-d9710997cd1a admin admin] The token cache is being invalidate because project 5137e8d8614f4aa2abd2af9f68001e84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:06:40.353768 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-1462e9fd-2fa8-4c37-8058-d9710997cd1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:40.354448 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-1462e9fd-2fa8-4c37-8058-d9710997cd1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:06:40.356028 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1449/2919] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 14:06:40 2022] DELETE /identity/v3/projects/5137e8d8614f4aa2abd2af9f68001e84 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:06:40.363205 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdffea7-1ec9-4d8a-8de5-dfa95bd3bf2b None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:40.364103 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdffea7-1ec9-4d8a-8de5-dfa95bd3bf2b None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:40.364103 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdffea7-1ec9-4d8a-8de5-dfa95bd3bf2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:40.392676 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-8bdffea7-1ec9-4d8a-8de5-dfa95bd3bf2b None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:06:40.394269 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-8bdffea7-1ec9-4d8a-8de5-dfa95bd3bf2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:40.495972 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1471/2920] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:06:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:06:40.512344 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8e253-0a7b-4349-993d-3bb1cf29266c None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:40.513204 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8e253-0a7b-4349-993d-3bb1cf29266c None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:40.513433 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8e253-0a7b-4349-993d-3bb1cf29266c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:40.541838 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-01e8e253-0a7b-4349-993d-3bb1cf29266c None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:06:40.543119 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-01e8e253-0a7b-4349-993d-3bb1cf29266c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:40.552396 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1450/2921] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:06:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:06:40.558942 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdffea7-1ec9-4d8a-8de5-dfa95bd3bf2b None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:40.573140 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdffea7-1ec9-4d8a-8de5-dfa95bd3bf2b None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:40.581686 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72127a2a-220b-4efc-a7ba-b12813e81c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:40.582737 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72127a2a-220b-4efc-a7ba-b12813e81c8a admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:40.583242 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72127a2a-220b-4efc-a7ba-b12813e81c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:40.583723 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72127a2a-220b-4efc-a7ba-b12813e81c8a admin admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:40.584946 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72127a2a-220b-4efc-a7ba-b12813e81c8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:06:40.585544 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72127a2a-220b-4efc-a7ba-b12813e81c8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:40.588625 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72127a2a-220b-4efc-a7ba-b12813e81c8a admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:40.612973 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1472/2922] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 14:06:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 08 14:06:40.619670 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e8e253-0a7b-4349-993d-3bb1cf29266c None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:40.637969 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e8e253-0a7b-4349-993d-3bb1cf29266c None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:40.646415 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfcb8c7-8052-4ab5-b746-35a2adfd332a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:40.647468 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcb8c7-8052-4ab5-b746-35a2adfd332a admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:40.647961 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcb8c7-8052-4ab5-b746-35a2adfd332a admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:40.648434 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcb8c7-8052-4ab5-b746-35a2adfd332a admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:40.649670 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfcb8c7-8052-4ab5-b746-35a2adfd332a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:40.653411 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfcb8c7-8052-4ab5-b746-35a2adfd332a admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:40.682481 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:40.705252 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1451/2923] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 14:06:40 2022] POST /identity/v3/projects => generated 365 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:06:40.707394 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72127a2a-220b-4efc-a7ba-b12813e81c8a admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:40.720194 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72127a2a-220b-4efc-a7ba-b12813e81c8a admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:40.815750 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3501c0c-3f77-4c7b-92f0-bb10d29b36f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:40.816258 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3501c0c-3f77-4c7b-92f0-bb10d29b36f6 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:40.816536 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3501c0c-3f77-4c7b-92f0-bb10d29b36f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:40.816806 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3501c0c-3f77-4c7b-92f0-bb10d29b36f6 admin admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:40.817480 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3501c0c-3f77-4c7b-92f0-bb10d29b36f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:40.819462 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3501c0c-3f77-4c7b-92f0-bb10d29b36f6 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:40.848555 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1473/2924] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 14:06:40 2022] POST /identity/v3/users => generated 283 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:06:40.854073 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfcb8c7-8052-4ab5-b746-35a2adfd332a admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:40.874219 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfcb8c7-8052-4ab5-b746-35a2adfd332a admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:40.882424 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3682bb9e-5715-46d3-832f-83c5ddc352e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:40.883507 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682bb9e-5715-46d3-832f-83c5ddc352e1 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:40.883995 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682bb9e-5715-46d3-832f-83c5ddc352e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:40.884515 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3682bb9e-5715-46d3-832f-83c5ddc352e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:40.885777 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3682bb9e-5715-46d3-832f-83c5ddc352e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:40.889586 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3682bb9e-5715-46d3-832f-83c5ddc352e1 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:40.910266 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1452/2925] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 14:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:06:40.917763 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3501c0c-3f77-4c7b-92f0-bb10d29b36f6 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:40.943879 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3501c0c-3f77-4c7b-92f0-bb10d29b36f6 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:40.955219 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264c7e7-a63d-4795-81b8-1fe621cee645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:40.956293 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264c7e7-a63d-4795-81b8-1fe621cee645 admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:40.956706 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264c7e7-a63d-4795-81b8-1fe621cee645 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:40.957171 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264c7e7-a63d-4795-81b8-1fe621cee645 admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:40.958613 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264c7e7-a63d-4795-81b8-1fe621cee645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:40.961943 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264c7e7-a63d-4795-81b8-1fe621cee645 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:40.985650 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1474/2926] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 14:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:06:40.991005 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3682bb9e-5715-46d3-832f-83c5ddc352e1 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:41.004302 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3682bb9e-5715-46d3-832f-83c5ddc352e1 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:41.011606 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e2c1b8-8bac-4838-b383-dc9b6204f790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:41.013660 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2c1b8-8bac-4838-b383-dc9b6204f790 admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:41.014651 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2c1b8-8bac-4838-b383-dc9b6204f790 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:41.014971 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2c1b8-8bac-4838-b383-dc9b6204f790 admin admin] PATH_INFO: `/v3/projects/34723fe2a3034701b05f05611248c257/users/b6c311645e89405f97a1550059d97446/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:41.038773 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e2c1b8-8bac-4838-b383-dc9b6204f790 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34723fe2a3034701b05f05611248c257, user_id=b6c311645e89405f97a1550059d97446, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:41.041476 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e2c1b8-8bac-4838-b383-dc9b6204f790 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:41.059599 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1453/2927] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 14:06:40 2022] PUT /identity/v3/projects/34723fe2a3034701b05f05611248c257/users/b6c311645e89405f97a1550059d97446/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:06:41.074541 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af82f5-0e43-46d0-97bc-8b7abcf2797a None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:41.074854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af82f5-0e43-46d0-97bc-8b7abcf2797a None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:41.075235 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af82f5-0e43-46d0-97bc-8b7abcf2797a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:41.126197 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-75af82f5-0e43-46d0-97bc-8b7abcf2797a None None] MFA Rules not processed for user `b6c311645e89405f97a1550059d97446`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:06:41.128052 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-75af82f5-0e43-46d0-97bc-8b7abcf2797a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:41.211459 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:41.247292 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1475/2928] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:06:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:06:41.266310 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e2c1b8-8bac-4838-b383-dc9b6204f790 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:06:41.269258 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-45e2c1b8-8bac-4838-b383-dc9b6204f790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:06:41.383996 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e2c1b8-8bac-4838-b383-dc9b6204f790 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:06:41.391503 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990d2ad-fb59-4ede-9281-124e33216e0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:06:41.392598 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990d2ad-fb59-4ede-9281-124e33216e0d service cinder] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:06:41.393085 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990d2ad-fb59-4ede-9281-124e33216e0d service cinder] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:06:41.393746 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990d2ad-fb59-4ede-9281-124e33216e0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:06:41.411968 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e990d2ad-fb59-4ede-9281-124e33216e0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:06:41.414926 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e990d2ad-fb59-4ede-9281-124e33216e0d service cinder] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:06:41.433451 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1454/2929] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:06:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:06:51.241567 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=6 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:51.424713 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=43,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:16.394294 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af82f5-0e43-46d0-97bc-8b7abcf2797a None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:16.527250 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af82f5-0e43-46d0-97bc-8b7abcf2797a None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:16.537063 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973c299-20b6-4f84-956d-deb4473594de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:16.538129 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973c299-20b6-4f84-956d-deb4473594de admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:16.538618 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973c299-20b6-4f84-956d-deb4473594de admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:16.539117 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973c299-20b6-4f84-956d-deb4473594de admin admin] PATH_INFO: `/v3/users/b6c311645e89405f97a1550059d97446` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:16.541177 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5973c299-20b6-4f84-956d-deb4473594de admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6c311645e89405f97a1550059d97446)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:16.546000 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5973c299-20b6-4f84-956d-deb4473594de admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:16.629557 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-5973c299-20b6-4f84-956d-deb4473594de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6c311645e89405f97a1550059d97446'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:16.630980 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-5973c299-20b6-4f84-956d-deb4473594de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6c311645e89405f97a1550059d97446'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:16.632268 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-5973c299-20b6-4f84-956d-deb4473594de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6c311645e89405f97a1550059d97446'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:16.652055 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-5973c299-20b6-4f84-956d-deb4473594de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6c311645e89405f97a1550059d97446'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:16.673959 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-5973c299-20b6-4f84-956d-deb4473594de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6c311645e89405f97a1550059d97446'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:16.694859 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1476/2930] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 14:07:16 2022] DELETE /identity/v3/users/b6c311645e89405f97a1550059d97446 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:07:16.702135 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b0278-9b81-45e4-a2b0-8c683b952899 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:16.703092 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b0278-9b81-45e4-a2b0-8c683b952899 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:16.703092 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b0278-9b81-45e4-a2b0-8c683b952899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:16.735407 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-a87b0278-9b81-45e4-a2b0-8c683b952899 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:07:16.737589 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-a87b0278-9b81-45e4-a2b0-8c683b952899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:16.843361 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1455/2931] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:07:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 08 14:07:16.854382 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973c299-20b6-4f84-956d-deb4473594de admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:16.855997 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-5973c299-20b6-4f84-956d-deb4473594de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:16.958534 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973c299-20b6-4f84-956d-deb4473594de admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:16.964875 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647041ab-3b05-42a4-816a-e2a887f83ebb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:16.965989 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647041ab-3b05-42a4-816a-e2a887f83ebb service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:16.966952 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647041ab-3b05-42a4-816a-e2a887f83ebb service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:16.967457 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647041ab-3b05-42a4-816a-e2a887f83ebb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:16.986224 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647041ab-3b05-42a4-816a-e2a887f83ebb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:16.989063 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647041ab-3b05-42a4-816a-e2a887f83ebb service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:17.008943 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1477/2932] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:07:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:07:17.512952 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b0278-9b81-45e4-a2b0-8c683b952899 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:17.514656 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-a87b0278-9b81-45e4-a2b0-8c683b952899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:17.534096 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b0278-9b81-45e4-a2b0-8c683b952899 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:17.540398 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd0f3a0-ef60-46db-b2eb-82a06fca478a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:17.541293 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0f3a0-ef60-46db-b2eb-82a06fca478a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:17.541715 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0f3a0-ef60-46db-b2eb-82a06fca478a admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:17.542120 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd0f3a0-ef60-46db-b2eb-82a06fca478a admin admin] PATH_INFO: `/v3/projects/34723fe2a3034701b05f05611248c257` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:17.543728 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd0f3a0-ef60-46db-b2eb-82a06fca478a admin admin] RBAC: Authorizing `identity:delete_project(project_id=34723fe2a3034701b05f05611248c257)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:17.546811 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd0f3a0-ef60-46db-b2eb-82a06fca478a admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:17.625315 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-4fd0f3a0-ef60-46db-b2eb-82a06fca478a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34723fe2a3034701b05f05611248c257', 'request_id': 'req-4fd0f3a0-ef60-46db-b2eb-82a06fca478a'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:17.634806 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-4fd0f3a0-ef60-46db-b2eb-82a06fca478a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34723fe2a3034701b05f05611248c257', 'request_id': 'req-4fd0f3a0-ef60-46db-b2eb-82a06fca478a'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:17.643448 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-4fd0f3a0-ef60-46db-b2eb-82a06fca478a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34723fe2a3034701b05f05611248c257', 'request_id': 'req-4fd0f3a0-ef60-46db-b2eb-82a06fca478a'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:17.663429 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-4fd0f3a0-ef60-46db-b2eb-82a06fca478a admin admin] The token cache is being invalidate because project 34723fe2a3034701b05f05611248c257 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:07:17.663836 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-4fd0f3a0-ef60-46db-b2eb-82a06fca478a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:17.665015 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-4fd0f3a0-ef60-46db-b2eb-82a06fca478a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:17.667235 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1456/2933] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 14:07:17 2022] DELETE /identity/v3/projects/34723fe2a3034701b05f05611248c257 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:07:17.674826 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6a85c-ea59-4573-88e5-f30c7eae7e80 None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:17.675674 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6a85c-ea59-4573-88e5-f30c7eae7e80 None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:17.675674 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a6a85c-ea59-4573-88e5-f30c7eae7e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:17.711512 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-05a6a85c-ea59-4573-88e5-f30c7eae7e80 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:07:17.712847 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-05a6a85c-ea59-4573-88e5-f30c7eae7e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:17.738613 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:17.822803 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1478/2934] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:07:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:07:17.833145 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f444f1f-418b-4bb2-8da8-c51ec7cac477 None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:17.834058 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f444f1f-418b-4bb2-8da8-c51ec7cac477 None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:17.834058 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f444f1f-418b-4bb2-8da8-c51ec7cac477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:17.870016 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-5f444f1f-418b-4bb2-8da8-c51ec7cac477 None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:07:17.871354 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-5f444f1f-418b-4bb2-8da8-c51ec7cac477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:17.880122 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1457/2935] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:07:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:07:17.886417 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a6a85c-ea59-4573-88e5-f30c7eae7e80 None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:17.898111 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a6a85c-ea59-4573-88e5-f30c7eae7e80 None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:17.904117 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce096ec-edec-49c1-a330-50e8951dfeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:17.905033 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce096ec-edec-49c1-a330-50e8951dfeaf admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:17.905838 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce096ec-edec-49c1-a330-50e8951dfeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:17.906321 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce096ec-edec-49c1-a330-50e8951dfeaf admin admin] PATH_INFO: `/v3/domains` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:17.907511 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce096ec-edec-49c1-a330-50e8951dfeaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88207) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 08 14:07:17.908049 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce096ec-edec-49c1-a330-50e8951dfeaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:17.911219 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce096ec-edec-49c1-a330-50e8951dfeaf admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:17.929357 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1479/2936] 10.222.0.69 () {58 vars in 1153 bytes} [Thu Sep 8 14:07:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 08 14:07:17.937521 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f444f1f-418b-4bb2-8da8-c51ec7cac477 None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:17.957712 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f444f1f-418b-4bb2-8da8-c51ec7cac477 None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:17.967122 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280b702-9bc3-4ae3-b84d-0bcadb81ce10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:17.968160 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280b702-9bc3-4ae3-b84d-0bcadb81ce10 admin admin] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:17.968653 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280b702-9bc3-4ae3-b84d-0bcadb81ce10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:17.969108 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d280b702-9bc3-4ae3-b84d-0bcadb81ce10 admin admin] PATH_INFO: `/v3/projects` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:17.970338 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d280b702-9bc3-4ae3-b84d-0bcadb81ce10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:17.974528 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d280b702-9bc3-4ae3-b84d-0bcadb81ce10 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:18.023792 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1458/2937] 10.222.0.69 () {60 vars in 1153 bytes} [Thu Sep 8 14:07:17 2022] POST /identity/v3/projects => generated 389 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 08 14:07:18.028758 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce096ec-edec-49c1-a330-50e8951dfeaf admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:18.042315 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce096ec-edec-49c1-a330-50e8951dfeaf admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:18.120548 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ffd54-8739-43c9-8475-0d8d14c173c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:18.121167 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ffd54-8739-43c9-8475-0d8d14c173c4 admin admin] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:18.121477 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ffd54-8739-43c9-8475-0d8d14c173c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:18.121747 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ffd54-8739-43c9-8475-0d8d14c173c4 admin admin] PATH_INFO: `/v3/users` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:18.122582 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ffd54-8739-43c9-8475-0d8d14c173c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:18.124538 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ffd54-8739-43c9-8475-0d8d14c173c4 admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:18.154302 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1480/2938] 10.222.0.69 () {60 vars in 1144 bytes} [Thu Sep 8 14:07:18 2022] POST /identity/v3/users => generated 295 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 08 14:07:18.161556 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280b702-9bc3-4ae3-b84d-0bcadb81ce10 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:18.181427 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d280b702-9bc3-4ae3-b84d-0bcadb81ce10 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:18.191445 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d8c0a-1b1f-4126-901f-9624b05d1f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:18.192885 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d8c0a-1b1f-4126-901f-9624b05d1f65 admin admin] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:18.193434 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d8c0a-1b1f-4126-901f-9624b05d1f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:18.193928 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d8c0a-1b1f-4126-901f-9624b05d1f65 admin admin] PATH_INFO: `/v3/roles` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:18.195139 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3d8c0a-1b1f-4126-901f-9624b05d1f65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:18.198827 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3d8c0a-1b1f-4126-901f-9624b05d1f65 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:18.222110 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1459/2939] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 14:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 08 14:07:18.227042 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ffd54-8739-43c9-8475-0d8d14c173c4 admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:18.238601 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ffd54-8739-43c9-8475-0d8d14c173c4 admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:18.244801 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a386f9-b7bd-4e6d-ab25-4758c28fc55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:18.245708 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a386f9-b7bd-4e6d-ab25-4758c28fc55d admin admin] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:18.246148 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a386f9-b7bd-4e6d-ab25-4758c28fc55d admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:18.246580 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a386f9-b7bd-4e6d-ab25-4758c28fc55d admin admin] PATH_INFO: `/v3/roles` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:18.247660 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a386f9-b7bd-4e6d-ab25-4758c28fc55d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:18.250379 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a386f9-b7bd-4e6d-ab25-4758c28fc55d admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:18.265747 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1481/2940] 10.222.0.69 () {58 vars in 1122 bytes} [Thu Sep 8 14:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 08 14:07:18.270258 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d8c0a-1b1f-4126-901f-9624b05d1f65 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:18.282664 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d8c0a-1b1f-4126-901f-9624b05d1f65 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:18.287866 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b581846b-1fc8-42d8-8b05-fd3fdf0b2938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:18.288559 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581846b-1fc8-42d8-8b05-fd3fdf0b2938 admin admin] REQUEST_METHOD: `PUT` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:18.288842 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581846b-1fc8-42d8-8b05-fd3fdf0b2938 admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:18.289122 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581846b-1fc8-42d8-8b05-fd3fdf0b2938 admin admin] PATH_INFO: `/v3/projects/5335d5ef086f4dd68070effbc5953e0e/users/6cd95ad80212479ebb4d198d9c49c832/roles/0735c260e70441cc87ad611b789d5c56` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:18.309608 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b581846b-1fc8-42d8-8b05-fd3fdf0b2938 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5335d5ef086f4dd68070effbc5953e0e, user_id=6cd95ad80212479ebb4d198d9c49c832, role_id=0735c260e70441cc87ad611b789d5c56)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:18.312517 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b581846b-1fc8-42d8-8b05-fd3fdf0b2938 admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:18.331679 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1460/2941] 10.222.0.69 () {60 vars in 1483 bytes} [Thu Sep 8 14:07:18 2022] PUT /identity/v3/projects/5335d5ef086f4dd68070effbc5953e0e/users/6cd95ad80212479ebb4d198d9c49c832/roles/0735c260e70441cc87ad611b789d5c56 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:07:18.343576 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d49d23-3e91-4177-b2f9-84ac0c6ad5ad None None] REQUEST_METHOD: `POST` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:18.343915 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d49d23-3e91-4177-b2f9-84ac0c6ad5ad None None] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:18.344229 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d49d23-3e91-4177-b2f9-84ac0c6ad5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:18.377357 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.auth.core [None req-f1d49d23-3e91-4177-b2f9-84ac0c6ad5ad None None] MFA Rules not processed for user `6cd95ad80212479ebb4d198d9c49c832`. Rule list: `[]` (Enabled: `True`). {{(pid=88207) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:07:18.378871 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-f1d49d23-3e91-4177-b2f9-84ac0c6ad5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:18.499337 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1482/2942] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:07:18 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:07:18.516243 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b581846b-1fc8-42d8-8b05-fd3fdf0b2938 admin admin] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:18.518191 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-b581846b-1fc8-42d8-8b05-fd3fdf0b2938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:18.552147 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:18.603761 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b581846b-1fc8-42d8-8b05-fd3fdf0b2938 admin admin] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:18.609104 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f92826-ae2b-475f-90a8-128c2b2f33df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd311099f51484141bd8504184b818ee8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:18.609773 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f92826-ae2b-475f-90a8-128c2b2f33df service cinder] REQUEST_METHOD: `GET` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:18.610052 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f92826-ae2b-475f-90a8-128c2b2f33df service cinder] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:18.610323 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f92826-ae2b-475f-90a8-128c2b2f33df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:18.620773 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f92826-ae2b-475f-90a8-128c2b2f33df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:18.622349 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f92826-ae2b-475f-90a8-128c2b2f33df service cinder] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:18.634729 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1461/2943] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:07:18 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:07:28.493568 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:28.628151 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=17 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:30.335886 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d49d23-3e91-4177-b2f9-84ac0c6ad5ad None None] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:30.462258 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d49d23-3e91-4177-b2f9-84ac0c6ad5ad None None] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:30.470995 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afbc674-897c-48b4-95f0-6924991b282f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:30.472111 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbc674-897c-48b4-95f0-6924991b282f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:30.472611 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbc674-897c-48b4-95f0-6924991b282f admin admin] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:30.473096 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbc674-897c-48b4-95f0-6924991b282f admin admin] PATH_INFO: `/v3/users/6cd95ad80212479ebb4d198d9c49c832` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:30.480313 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afbc674-897c-48b4-95f0-6924991b282f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cd95ad80212479ebb4d198d9c49c832)` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:30.483140 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afbc674-897c-48b4-95f0-6924991b282f admin admin] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:30.569981 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-4afbc674-897c-48b4-95f0-6924991b282f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cd95ad80212479ebb4d198d9c49c832'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:30.571016 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-4afbc674-897c-48b4-95f0-6924991b282f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cd95ad80212479ebb4d198d9c49c832'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:30.571755 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-4afbc674-897c-48b4-95f0-6924991b282f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cd95ad80212479ebb4d198d9c49c832'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:30.583869 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-4afbc674-897c-48b4-95f0-6924991b282f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cd95ad80212479ebb4d198d9c49c832'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:30.614972 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.notifications [None req-4afbc674-897c-48b4-95f0-6924991b282f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cd95ad80212479ebb4d198d9c49c832'} {{(pid=88207) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:30.637883 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1483/2944] 10.222.0.69 () {58 vars in 1224 bytes} [Thu Sep 8 14:07:30 2022] DELETE /identity/v3/users/6cd95ad80212479ebb4d198d9c49c832 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 08 14:07:30.644251 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4eaad-7be2-4faf-9d4b-496ca868ca5d None None] REQUEST_METHOD: `POST` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:30.644877 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4eaad-7be2-4faf-9d4b-496ca868ca5d None None] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:30.645189 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4eaad-7be2-4faf-9d4b-496ca868ca5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:30.679946 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.auth.core [None req-afc4eaad-7be2-4faf-9d4b-496ca868ca5d None None] MFA Rules not processed for user `fe0feabca86e4c0ea888e85fba6302d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88208) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 08 14:07:30.682257 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-afc4eaad-7be2-4faf-9d4b-496ca868ca5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:30.797856 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1462/2945] 10.222.0.69 () {58 vars in 958 bytes} [Thu Sep 8 14:07:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 08 14:07:30.813722 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afbc674-897c-48b4-95f0-6924991b282f admin admin] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:30.819041 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-4afbc674-897c-48b4-95f0-6924991b282f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:30.908418 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afbc674-897c-48b4-95f0-6924991b282f admin admin] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:30.914712 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd428a4d-7e3a-4465-b42f-1ef98d9a41a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'db898158553743d3a28f3d6237e91a8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:30.915717 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd428a4d-7e3a-4465-b42f-1ef98d9a41a9 service neutron] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:30.916178 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd428a4d-7e3a-4465-b42f-1ef98d9a41a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:30.916635 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd428a4d-7e3a-4465-b42f-1ef98d9a41a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:30.935272 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd428a4d-7e3a-4465-b42f-1ef98d9a41a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:30.937861 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd428a4d-7e3a-4465-b42f-1ef98d9a41a9 service neutron] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:30.959641 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1484/2946] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:07:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 08 14:07:31.444534 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4eaad-7be2-4faf-9d4b-496ca868ca5d None None] Authenticating user token {{(pid=88208) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:07:31.447243 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.fernet_utils [None req-afc4eaad-7be2-4faf-9d4b-496ca868ca5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88208) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:07:31.476259 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4eaad-7be2-4faf-9d4b-496ca868ca5d None None] Validating token access rules against request {{(pid=88208) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:07:31.487431 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcbf014-2be0-4d5a-b7af-f1566d8a6bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fe0feabca86e4c0ea888e85fba6302d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a72572f147214da489cf8bb75dc22284', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88208) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:07:31.488600 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbf014-2be0-4d5a-b7af-f1566d8a6bab admin admin] REQUEST_METHOD: `DELETE` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:07:31.489074 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbf014-2be0-4d5a-b7af-f1566d8a6bab admin admin] SCRIPT_NAME: `/identity` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:07:31.491180 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbf014-2be0-4d5a-b7af-f1566d8a6bab admin admin] PATH_INFO: `/v3/projects/5335d5ef086f4dd68070effbc5953e0e` {{(pid=88208) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:07:31.491631 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcbf014-2be0-4d5a-b7af-f1566d8a6bab admin admin] RBAC: Authorizing `identity:delete_project(project_id=5335d5ef086f4dd68070effbc5953e0e)` {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:07:31.493749 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcbf014-2be0-4d5a-b7af-f1566d8a6bab admin admin] RBAC: Authorization granted {{(pid=88208) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:07:31.575588 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-5bcbf014-2be0-4d5a-b7af-f1566d8a6bab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5335d5ef086f4dd68070effbc5953e0e', 'request_id': 'req-5bcbf014-2be0-4d5a-b7af-f1566d8a6bab'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:31.585758 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-5bcbf014-2be0-4d5a-b7af-f1566d8a6bab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5335d5ef086f4dd68070effbc5953e0e', 'request_id': 'req-5bcbf014-2be0-4d5a-b7af-f1566d8a6bab'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:31.594387 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-5bcbf014-2be0-4d5a-b7af-f1566d8a6bab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5335d5ef086f4dd68070effbc5953e0e', 'request_id': 'req-5bcbf014-2be0-4d5a-b7af-f1566d8a6bab'} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:31.614153 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-5bcbf014-2be0-4d5a-b7af-f1566d8a6bab admin admin] The token cache is being invalidate because project 5335d5ef086f4dd68070effbc5953e0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88208) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 08 14:07:31.614439 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-5bcbf014-2be0-4d5a-b7af-f1566d8a6bab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:31.615195 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG keystone.notifications [None req-5bcbf014-2be0-4d5a-b7af-f1566d8a6bab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88208) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 08 14:07:31.617235 dv-cinder-856463-2-smb devstack@keystone.service[88208]: [pid: 88208|app: 0|req: 1463/2947] 10.222.0.69 () {58 vars in 1233 bytes} [Thu Sep 8 14:07:31 2022] DELETE /identity/v3/projects/5335d5ef086f4dd68070effbc5953e0e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 08 14:07:40.950940 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:41.609969 dv-cinder-856463-2-smb devstack@keystone.service[88208]: DEBUG dbcounter [-] [88208] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:19.428700 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd428a4d-7e3a-4465-b42f-1ef98d9a41a9 service neutron] Authenticating user token {{(pid=88207) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 08 14:10:19.431087 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-cd428a4d-7e3a-4465-b42f-1ef98d9a41a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:19.612412 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd428a4d-7e3a-4465-b42f-1ef98d9a41a9 service neutron] Validating token access rules against request {{(pid=88207) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 08 14:10:19.690468 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333af3f7-c943-4222-8843-3b65a7833075 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '733797f12a1741e1a55332991e867aab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88de9f1470c6415b97866ad5a3256ef2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88207) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 08 14:10:19.691144 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333af3f7-c943-4222-8843-3b65a7833075 service placement] REQUEST_METHOD: `GET` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 08 14:10:19.691470 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333af3f7-c943-4222-8843-3b65a7833075 service placement] SCRIPT_NAME: `/identity` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 08 14:10:19.691854 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333af3f7-c943-4222-8843-3b65a7833075 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88207) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 08 14:10:19.693980 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.fernet_utils [None req-333af3f7-c943-4222-8843-3b65a7833075 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88207) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 08 14:10:19.707866 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333af3f7-c943-4222-8843-3b65a7833075 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 08 14:10:19.709677 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333af3f7-c943-4222-8843-3b65a7833075 service placement] RBAC: Authorization granted {{(pid=88207) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 08 14:10:19.722440 dv-cinder-856463-2-smb devstack@keystone.service[88207]: [pid: 88207|app: 0|req: 1485/2948] 10.222.0.69 () {60 vars in 1365 bytes} [Thu Sep 8 14:10:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 08 14:10:29.717593 dv-cinder-856463-2-smb devstack@keystone.service[88207]: DEBUG dbcounter [-] [88207] Writing DB stats keystone:SELECT=89 {{(pid=88207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}